-- Logs begin at Fri 2021-12-24 04:20:00 UTC, end at Fri 2021-12-24 05:29:01 UTC. -- Dec 24 04:46:00.373664 dv-cinder-816443-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Dec 24 04:46:00.384628 dv-cinder-816443-2-iscsi devstack@keystone.service[79098]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Dec 24 04:46:00.385215 dv-cinder-816443-2-iscsi devstack@keystone.service[79098]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Dec 24 04:46:00 2021] *** Dec 24 04:46:00.385215 dv-cinder-816443-2-iscsi devstack@keystone.service[79098]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 24 04:46:00.385215 dv-cinder-816443-2-iscsi devstack@keystone.service[79098]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 24 04:46:00.385215 dv-cinder-816443-2-iscsi devstack@keystone.service[79098]: nodename: dv-cinder-816443-2-iscsi Dec 24 04:46:00.385215 dv-cinder-816443-2-iscsi devstack@keystone.service[79098]: machine: x86_64 Dec 24 04:46:00.385215 dv-cinder-816443-2-iscsi devstack@keystone.service[79098]: clock source: unix Dec 24 04:46:00.385215 dv-cinder-816443-2-iscsi devstack@keystone.service[79098]: pcre jit disabled Dec 24 04:46:00.385215 dv-cinder-816443-2-iscsi devstack@keystone.service[79098]: detected number of CPU cores: 4 Dec 24 04:46:00.385215 dv-cinder-816443-2-iscsi devstack@keystone.service[79098]: current working directory: / Dec 24 04:46:00.385215 dv-cinder-816443-2-iscsi devstack@keystone.service[79098]: detected binary path: /usr/bin/uwsgi-core Dec 24 04:46:00.385215 dv-cinder-816443-2-iscsi devstack@keystone.service[79098]: your processes number limit is 47680 Dec 24 04:46:00.385215 dv-cinder-816443-2-iscsi devstack@keystone.service[79098]: your memory page size is 4096 bytes Dec 24 04:46:00.385215 dv-cinder-816443-2-iscsi devstack@keystone.service[79098]: detected max file descriptor number: 2048 Dec 24 04:46:00.385215 dv-cinder-816443-2-iscsi devstack@keystone.service[79098]: lock engine: pthread robust mutexes Dec 24 04:46:00.385215 dv-cinder-816443-2-iscsi devstack@keystone.service[79098]: thunder lock: enabled Dec 24 04:46:00.385215 dv-cinder-816443-2-iscsi devstack@keystone.service[79098]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Dec 24 04:46:00.386193 dv-cinder-816443-2-iscsi devstack@keystone.service[79098]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Dec 24 04:46:00.430777 dv-cinder-816443-2-iscsi devstack@keystone.service[79098]: Python main interpreter initialized at 0x5570aca439c0 Dec 24 04:46:00.430777 dv-cinder-816443-2-iscsi devstack@keystone.service[79098]: python threads support enabled Dec 24 04:46:00.430777 dv-cinder-816443-2-iscsi devstack@keystone.service[79098]: your server socket listen backlog is limited to 100 connections Dec 24 04:46:00.430777 dv-cinder-816443-2-iscsi devstack@keystone.service[79098]: your mercy for graceful operations on workers is 90 seconds Dec 24 04:46:00.431143 dv-cinder-816443-2-iscsi devstack@keystone.service[79098]: mapped 403077 bytes (393 KB) for 2 cores Dec 24 04:46:00.431230 dv-cinder-816443-2-iscsi devstack@keystone.service[79098]: *** Operational MODE: preforking *** Dec 24 04:46:00.431516 dv-cinder-816443-2-iscsi devstack@keystone.service[79098]: *** uWSGI is running in multiple interpreter mode *** Dec 24 04:46:00.431516 dv-cinder-816443-2-iscsi devstack@keystone.service[79098]: spawned uWSGI master process (pid: 79098) Dec 24 04:46:00.431722 dv-cinder-816443-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Dec 24 04:46:00.436564 dv-cinder-816443-2-iscsi devstack@keystone.service[79098]: spawned uWSGI worker 1 (pid: 79112, cores: 1) Dec 24 04:46:00.436564 dv-cinder-816443-2-iscsi devstack@keystone.service[79098]: spawned uWSGI worker 2 (pid: 79113, cores: 1) Dec 24 04:46:00.436564 dv-cinder-816443-2-iscsi devstack@keystone.service[79098]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 24 04:46:05.735177 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 24 04:46:05.735177 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: from cryptography.utils import int_from_bytes Dec 24 04:46:05.735967 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 24 04:46:05.735967 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: from cryptography.utils import int_from_bytes Dec 24 04:46:05.738249 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 24 04:46:05.738249 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: from cryptography.utils import int_from_bytes Dec 24 04:46:05.738773 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 24 04:46:05.738773 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: from cryptography.utils import int_from_bytes Dec 24 04:46:05.785946 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 24 04:46:05.786168 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 24 04:46:05.786378 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] command line args: [] {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 24 04:46:05.786484 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 24 04:46:05.786555 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 24 04:46:05.786620 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 24 04:46:05.786684 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] ================================================================================ {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 24 04:46:05.786753 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] command line args: [] {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 24 04:46:05.786926 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] admin_token = **** {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.787012 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 24 04:46:05.787169 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] config_dir = [] {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.787260 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ================================================================================ {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 24 04:46:05.793778 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.793914 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] admin_token = **** {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.793990 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] config_source = [] {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.794052 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] config_dir = [] {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.794116 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] debug = True {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.794175 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.794237 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.795551 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] config_source = [] {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.795551 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] debug = True {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.795683 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.795845 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.795948 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.796017 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.796081 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.796145 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.796209 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.796272 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.796342 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] list_limit = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.796407 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.796471 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] log_config_append = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.796471 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.796608 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] list_limit = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.796674 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] log_dir = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.796744 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] log_config_append = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.796804 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] log_file = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.796860 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.796860 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] log_dir = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.796971 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.797035 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] log_file = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.797103 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.797169 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.797238 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.797301 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.797364 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.797432 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.797500 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.797500 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.798330 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.798525 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.798721 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.798721 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.799101 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.799296 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.799485 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.799678 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.799867 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.800094 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.800304 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.800497 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.800760 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.800966 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.801128 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.801349 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.801557 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.801718 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.801911 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.802109 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.802109 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.802461 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.43/identity {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.802461 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] publish_errors = False {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.802461 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.802873 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.43/identity {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.802873 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] publish_errors = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.803182 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.803182 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.803432 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.803568 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.803731 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.803731 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.804041 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.804041 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] standard_threads = False {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.804299 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.804433 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.804590 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.804724 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.804868 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] standard_threads = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.805008 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.805175 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.805306 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] use_journal = False {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.805432 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.805563 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] use_json = False {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.805696 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.805835 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] use_stderr = False {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.805969 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] use_journal = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.806101 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] use_syslog = False {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.806228 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] use_json = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.806354 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.806479 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] use_stderr = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.806616 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.806754 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] use_syslog = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.806887 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.807014 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:46:05.807139 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.807271 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.807410 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.807544 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.807671 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.807836 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.808004 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.808139 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.808342 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.808473 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.808638 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.808777 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.808914 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.809042 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.809176 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.809305 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.809431 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.809556 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.809688 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.809815 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.809953 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.810081 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.810222 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.810357 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.810499 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.810631 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.810766 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.810895 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.811027 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.811154 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.811286 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.811428 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.811567 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.811700 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.811833 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.811960 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.812092 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.812230 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.812365 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.812500 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.812665 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.812792 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.812923 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.813054 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.813191 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.813320 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.813446 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.813574 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.813705 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.813839 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.813967 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.814103 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.814230 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.814361 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.814488 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.814691 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.814821 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.814954 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.815081 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.815213 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.815340 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.815478 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.815613 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.815741 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.815876 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.816009 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.816137 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.816273 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.816400 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.816613 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.816749 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.816878 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.817005 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.817142 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.817276 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.817409 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.817537 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.817671 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.817816 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.817956 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.818084 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.818216 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.818349 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.818483 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.818610 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.818745 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.818879 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.819006 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.819138 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.819265 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.819392 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.820691 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.820866 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.821057 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.821252 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.821252 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.821620 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.821620 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.822055 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.822218 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.822412 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.822608 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.822829 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.822829 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.823178 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.823376 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.823571 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.823759 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.823953 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.824190 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.824359 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.824606 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.824797 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.824985 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.825209 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.825405 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.825581 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.825750 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.825924 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.826067 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.826206 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.826364 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.826505 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.826634 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.826761 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.826888 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.827203 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.827370 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.827510 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.827640 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.827768 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.827908 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.828037 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.828178 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.828316 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.828476 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.828689 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.828820 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.828948 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.829075 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.829210 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.829347 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.829481 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.829617 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.829752 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.829891 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.830028 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.830158 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.830287 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.830415 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.830542 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.830690 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.830977 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.831203 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.831388 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.831538 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.831700 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.832222 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.832411 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.832609 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.832758 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.832896 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.833032 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.833163 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.833299 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.833430 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.833571 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.833701 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.833828 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.834264 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.834402 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.834538 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.834694 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.834835 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.834964 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.835091 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.835217 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.835353 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.835481 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.835609 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.835735 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.835869 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.835997 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.836132 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] auth.external = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.836267 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.836468 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.836658 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.836790 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.836935 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.837073 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.837202 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] auth.external = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.837330 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] auth.password = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.837457 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.837583 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] auth.token = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.837711 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.837847 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.837976 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.838103 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.838230 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] auth.password = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.838368 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.838495 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] auth.token = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.838630 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.838760 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.838894 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.839023 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.839156 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.839285 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.839423 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.839551 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.839679 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] credential.caching = True {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.839807 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.839965 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.840104 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.840245 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.840374 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.840513 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.840666 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] credential.caching = True {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.840796 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.840935 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.841065 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.841199 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.841199 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.841452 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.841580 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.841707 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.841836 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.841974 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.842111 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.842241 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.842377 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.842507 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.842676 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.842883 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.843121 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.843328 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.843473 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.843603 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.843733 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.843862 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.844001 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.844144 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.844273 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.844402 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] federation.caching = True {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.844595 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.844731 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.844877 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.845010 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.845140 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] federation.caching = True {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.845268 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.845396 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.845523 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.845660 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.845790 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.845918 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.846058 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.846187 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.846315 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.846452 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.846591 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.846720 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.846849 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.846977 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.847116 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.847247 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.847374 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.847502 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.847630 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] identity.caching = True {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.847767 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.847970 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.848104 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.848233 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.848362 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] identity.caching = True {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.848497 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.848745 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.848904 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.849039 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.849169 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.849297 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.849432 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.849561 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.849709 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.849845 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.849974 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.850104 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.850233 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.850372 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.850510 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.850640 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.850769 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.850896 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.851023 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.851150 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.851291 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.851421 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.851562 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.851692 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.851821 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.851948 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.852084 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.852215 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.852344 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.852472 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.852623 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.852753 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.852893 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.853030 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.853162 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.853162 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.853427 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.853555 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.853691 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.853827 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.853956 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.854084 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.854218 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.854346 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.854483 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.854612 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.854740 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.854869 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.855003 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.855145 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.855282 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.855418 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.855547 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.855683 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.855812 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.855940 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.856075 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.856204 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.856340 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.856474 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.856638 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.856776 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.856914 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.857060 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.857189 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.857324 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.857453 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.857583 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.857719 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.857848 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.857976 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.858104 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.858293 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.858425 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.858562 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.858694 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.858833 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.858963 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.859091 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.859219 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.859357 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.859486 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.859614 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.859743 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.859870 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.860005 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.860143 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.860273 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.860401 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.860547 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.860692 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.860833 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.860968 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.861100 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.861227 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.861356 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] ldap.user = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.861484 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.861620 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.861751 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.861879 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.862007 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.862135 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.862262 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.user = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.862399 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.862539 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.862667 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.862796 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.862925 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.863059 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.863199 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.863329 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.863457 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.863593 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.863723 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.863851 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.863988 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.864119 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.864265 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.864394 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.864540 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.864680 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.864821 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.864952 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.865081 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.865213 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.865342 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.865469 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.865606 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.866028 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.866166 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.866295 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.866434 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.866563 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.866700 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.866830 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.866958 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.867087 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.867214 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.867341 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.867477 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.867607 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.867735 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.867862 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.867991 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.868119 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.868264 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.868394 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.868623 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.868759 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.868887 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.869015 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.869156 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.869321 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.869454 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.869583 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.869711 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.869839 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.869976 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.870117 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.870248 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.870377 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.870505 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.870632 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.870769 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.870898 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.871026 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.871155 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.871284 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.871411 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.871552 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] resource.caching = True {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.871683 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.871812 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.871950 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.872085 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.872216 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.872362 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.872494 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] resource.caching = True {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.872647 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.872777 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.872906 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.872906 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.873171 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.873302 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.873437 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.873566 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.873695 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.873864 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.874069 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.874203 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] role.caching = True {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.874333 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.874563 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] role.driver = sql {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.874806 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.874942 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.875080 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.875212 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.875341 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.875471 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.875601 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] role.caching = True {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.875737 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.875879 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] role.driver = sql {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.876009 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.876137 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.876299 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.876434 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.876652 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.876788 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.876918 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.877046 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.877175 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.877303 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.877439 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.877569 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.877698 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.877836 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.877964 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.878093 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.878282 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.878421 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.878552 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.878681 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.878681 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.878923 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.879061 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.879192 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.879320 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.879448 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.879588 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.879717 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.879717 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.879969 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.880097 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.880226 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.880353 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.880481 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.880643 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.880775 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.880904 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.881031 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.881159 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.881307 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.881445 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.881575 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.881705 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.881833 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.881961 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.882096 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.882226 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.882354 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.882483 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.882610 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.882738 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.882874 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.883021 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.883156 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.883288 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.883418 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.883546 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.883682 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.883813 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] token.caching = True {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.883941 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.884069 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.884203 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.884332 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.884469 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.884620 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.884750 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.884890 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.885019 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] token.caching = True {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.885147 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.885290 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.885421 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.885550 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.885679 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.885806 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.885935 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.886071 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.886202 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.886329 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.886457 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.886585 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.886722 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.886859 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.886990 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.887118 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.887246 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.887373 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.887501 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.887638 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.887769 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.887896 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.888026 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.888153 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.888281 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.888427 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.888575 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] database.connection = **** {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.888710 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.888839 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.888966 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.889095 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.889234 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.889364 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.889558 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.889688 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.889866 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] database.connection = **** {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.890004 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.890004 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.890263 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.890402 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.890531 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.890660 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.890788 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.890788 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.891043 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.891043 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.891296 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.891296 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.891551 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.891679 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.891816 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.891953 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.892089 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.892089 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.892345 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.892474 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.892729 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.892889 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.893034 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.893166 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.893303 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.893433 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.893562 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.893691 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 24 04:46:05.893828 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.893828 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.893828 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.893828 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.893828 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:46:05.893828 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 24 04:46:05.895972 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 24 04:46:05.896200 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 24 04:46:05.896418 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 24 04:46:05.897023 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 24 04:46:05.897253 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 24 04:46:05.897483 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 24 04:46:05.905014 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 24 04:46:05.906072 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 24 04:46:05.934993 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 24 04:46:05.935264 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 24 04:46:05.935771 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 24 04:46:05.936004 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 24 04:46:05.988160 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 24 04:46:05.988514 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 24 04:46:06.037717 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 24 04:46:06.038081 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 24 04:46:06.038081 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 24 04:46:06.038361 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 24 04:46:06.105439 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 24 04:46:06.105815 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 24 04:46:06.105991 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 24 04:46:06.106143 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 24 04:46:06.106282 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 24 04:46:06.106420 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 24 04:46:06.106556 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 24 04:46:06.106694 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 24 04:46:06.106876 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 24 04:46:06.107020 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 24 04:46:06.107173 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 24 04:46:06.107173 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 24 04:46:06.130242 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 24 04:46:06.130616 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 24 04:46:06.130930 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 24 04:46:06.131097 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 24 04:46:06.131253 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 24 04:46:06.131394 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 24 04:46:06.131542 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 24 04:46:06.131542 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 24 04:46:06.131806 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 24 04:46:06.131806 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 24 04:46:06.132081 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 24 04:46:06.132218 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 24 04:46:06.132365 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 24 04:46:06.132506 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 24 04:46:06.143213 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 24 04:46:06.143553 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 24 04:46:06.156481 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 24 04:46:06.156846 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 24 04:46:06.157000 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 24 04:46:06.157198 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 24 04:46:06.157340 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 24 04:46:06.157546 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 24 04:46:06.157699 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 24 04:46:06.157837 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 24 04:46:06.157972 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 24 04:46:06.158106 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 24 04:46:06.158241 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 24 04:46:06.158374 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 24 04:46:06.158518 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 24 04:46:06.158655 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 24 04:46:06.174975 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.175255 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 24 04:46:06.175403 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.175403 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 24 04:46:06.175686 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.175686 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 24 04:46:06.175940 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.175940 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 24 04:46:06.176202 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.176340 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.176514 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.176755 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.176911 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.177047 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.177195 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.177330 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.187165 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.187390 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.187538 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.187674 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.187826 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.187965 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.188100 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.188249 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.196268 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 24 04:46:06.198770 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 24 04:46:06.199474 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 24 04:46:06.199750 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.200024 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.200297 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.200722 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.200981 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.201244 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.201517 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.201779 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.202173 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.202519 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.203380 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 24 04:46:06.203762 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.204137 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.204510 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.204911 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.205262 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.205626 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.206007 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.206375 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.206742 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.207103 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.229022 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.230621 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 24 04:46:06.230905 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.233772 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.235445 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 24 04:46:06.235791 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.238212 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 24 04:46:06.238442 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.238719 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.243133 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 24 04:46:06.243470 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.243808 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.245848 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 24 04:46:06.246129 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.250561 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 24 04:46:06.250840 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.251113 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.251386 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.251543 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 24 04:46:06.251653 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.251918 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.252030 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.252183 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.252437 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.256461 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 24 04:46:06.256825 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.257158 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.257493 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.257830 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.258164 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.258492 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.258819 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.270680 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.270950 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.275360 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 24 04:46:06.278100 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.278442 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.278990 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.279279 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.283857 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 24 04:46:06.284255 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 24 04:46:06.287694 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.287879 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 24 04:46:06.288113 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.291369 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.291667 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.291943 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.292220 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.292508 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.292812 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.293438 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 24 04:46:06.297089 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 24 04:46:06.300847 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.301204 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.301619 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.301958 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.302304 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.302658 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.312563 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 24 04:46:06.312563 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.312563 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.312843 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.320289 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.322104 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.322372 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.322684 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 24 04:46:06.323031 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.323354 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.323673 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.325337 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 24 04:46:06.325619 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.325917 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.326192 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.326462 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.331729 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.333615 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.334229 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.337312 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 24 04:46:06.337599 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.337962 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.338274 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.338645 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.339826 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 24 04:46:06.340099 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.340375 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.340678 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.340954 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.341227 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.341472 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.352306 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 24 04:46:06.352671 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.353010 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.353351 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.353692 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.354041 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.354376 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.359041 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 24 04:46:06.362248 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 24 04:46:06.365626 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.367188 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.368792 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 24 04:46:06.369066 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.369344 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.372820 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 24 04:46:06.376087 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 24 04:46:06.376564 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.378146 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 24 04:46:06.379665 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.381314 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.381498 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.381676 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.381973 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.382249 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.383238 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 24 04:46:06.383581 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.383921 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.391083 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.391281 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 24 04:46:06.391534 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.391852 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.393002 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 24 04:46:06.396345 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.396767 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.397074 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.397423 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.399659 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 24 04:46:06.399945 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.400218 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.400499 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.400789 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.401073 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.401340 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.401611 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.401854 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.402148 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.402402 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.402666 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.402920 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.403183 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.407630 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 24 04:46:06.408033 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.408432 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.416247 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 24 04:46:06.416582 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.416949 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.417278 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.417621 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.417970 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.418300 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.418621 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.418947 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.419274 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.419604 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.419938 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.420257 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.420579 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 24 04:46:06.440030 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5570aca439c0 pid: 79113 (default app) Dec 24 04:46:06.443497 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4fb3b-b215-4c68-8913-1708f9a7bb61 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:06.443786 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4fb3b-b215-4c68-8913-1708f9a7bb61 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:06.444063 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4fb3b-b215-4c68-8913-1708f9a7bb61 None None] PATH_INFO: `/v3` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:06.450089 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1/1] 10.222.0.43 () {50 vars in 791 bytes} [Fri Dec 24 04:46:06 2021] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:06.458075 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5570aca439c0 pid: 79112 (default app) Dec 24 04:46:14.332195 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7831430-cd3e-495f-8757-72f2fcabba2b None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:14.332761 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7831430-cd3e-495f-8757-72f2fcabba2b None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:14.332761 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7831430-cd3e-495f-8757-72f2fcabba2b None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:14.335275 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 2/2] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:46:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 24 04:46:14.343971 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e426376-22be-4340-ac00-67e8a80141c4 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:14.344420 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e426376-22be-4340-ac00-67e8a80141c4 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:14.344552 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e426376-22be-4340-ac00-67e8a80141c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:14.378036 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG oslo_db.sqlalchemy.engines [None req-1e426376-22be-4340-ac00-67e8a80141c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79112) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 24 04:46:14.581643 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG passlib.handlers.bcrypt [None req-1e426376-22be-4340-ac00-67e8a80141c4 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79112) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Dec 24 04:46:14.581950 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG passlib.handlers.bcrypt [None req-1e426376-22be-4340-ac00-67e8a80141c4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79112) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Dec 24 04:46:14.637648 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-1e426376-22be-4340-ac00-67e8a80141c4 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:46:14.639296 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-1e426376-22be-4340-ac00-67e8a80141c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:46:14.770727 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1/3] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:46:14 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 430 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:46:14.962595 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7831430-cd3e-495f-8757-72f2fcabba2b None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:15.010987 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG oslo_db.sqlalchemy.engines [None req-d7831430-cd3e-495f-8757-72f2fcabba2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79113) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 24 04:46:15.153338 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7831430-cd3e-495f-8757-72f2fcabba2b None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:15.158193 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1522e852-7f29-4ef1-9984-4c0b96442423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:15.158844 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1522e852-7f29-4ef1-9984-4c0b96442423 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:15.159126 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1522e852-7f29-4ef1-9984-4c0b96442423 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:15.159394 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1522e852-7f29-4ef1-9984-4c0b96442423 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:15.168237 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1522e852-7f29-4ef1-9984-4c0b96442423 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:15.221096 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1522e852-7f29-4ef1-9984-4c0b96442423 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Dec 24 04:46:15.221351 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1522e852-7f29-4ef1-9984-4c0b96442423 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:15.231730 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 3/4] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:46:14 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 24 04:46:15.241875 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e426376-22be-4340-ac00-67e8a80141c4 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:15.256807 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e426376-22be-4340-ac00-67e8a80141c4 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:15.262380 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f5e3b-81cb-41e5-ba93-8b94bd34d066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:15.263469 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f5e3b-81cb-41e5-ba93-8b94bd34d066 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:15.263748 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f5e3b-81cb-41e5-ba93-8b94bd34d066 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:15.264015 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f5e3b-81cb-41e5-ba93-8b94bd34d066 admin admin] PATH_INFO: `/v3/projects/49af853a7d674e84987f8788493d4239` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:15.267949 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815f5e3b-81cb-41e5-ba93-8b94bd34d066 admin admin] RBAC: Authorizing `identity:get_project(project_id=49af853a7d674e84987f8788493d4239)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:15.317933 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.common.rbac_enforcer.enforcer [None req-815f5e3b-81cb-41e5-ba93-8b94bd34d066 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Dec 24 04:46:15.318270 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815f5e3b-81cb-41e5-ba93-8b94bd34d066 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:15.322977 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 2/5] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:46:15 2021] GET /identity/v3/projects/49af853a7d674e84987f8788493d4239 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:46:17.701039 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dbfbd5-f606-4d7d-89ba-76a1225415fb None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:17.701548 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dbfbd5-f606-4d7d-89ba-76a1225415fb None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:17.701548 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dbfbd5-f606-4d7d-89ba-76a1225415fb None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:17.706657 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 4/6] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:46:17 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:46:17.717555 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb755b-b261-408d-aea3-21036ddc2ee2 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:17.718222 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb755b-b261-408d-aea3-21036ddc2ee2 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:17.718563 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb755b-b261-408d-aea3-21036ddc2ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:17.749612 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-30cb755b-b261-408d-aea3-21036ddc2ee2 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:46:17.752016 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-30cb755b-b261-408d-aea3-21036ddc2ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:46:17.766350 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 3/7] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:46:17 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:46:17.801400 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dbfbd5-f606-4d7d-89ba-76a1225415fb None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:17.823131 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dbfbd5-f606-4d7d-89ba-76a1225415fb None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:17.829943 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27028448-9b86-4e25-b99c-39f6553d3d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:17.830583 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27028448-9b86-4e25-b99c-39f6553d3d18 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:17.830871 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27028448-9b86-4e25-b99c-39f6553d3d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:17.831138 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27028448-9b86-4e25-b99c-39f6553d3d18 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:17.839509 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27028448-9b86-4e25-b99c-39f6553d3d18 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:17.841336 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27028448-9b86-4e25-b99c-39f6553d3d18 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:17.849969 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 5/8] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:46:17 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 24 04:46:17.856401 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb755b-b261-408d-aea3-21036ddc2ee2 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:17.866304 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb755b-b261-408d-aea3-21036ddc2ee2 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:17.872815 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153f42f-880c-43e0-94e6-c2f447c5add0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:17.873722 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153f42f-880c-43e0-94e6-c2f447c5add0 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:17.874013 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153f42f-880c-43e0-94e6-c2f447c5add0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:17.874292 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153f42f-880c-43e0-94e6-c2f447c5add0 admin admin] PATH_INFO: `/v3/users/d2031cc40bf6488b8dc6976b8c829c5e` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:17.875938 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e153f42f-880c-43e0-94e6-c2f447c5add0 admin admin] RBAC: Authorizing `identity:get_user(user_id=d2031cc40bf6488b8dc6976b8c829c5e)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:17.877844 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e153f42f-880c-43e0-94e6-c2f447c5add0 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:17.879415 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 4/9] 10.222.0.43 () {56 vars in 1198 bytes} [Fri Dec 24 04:46:17 2021] GET /identity/v3/users/d2031cc40bf6488b8dc6976b8c829c5e => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:20.269993 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c994a9-2bbf-4333-aa1c-8e9e43ec1d4b None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:20.270542 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c994a9-2bbf-4333-aa1c-8e9e43ec1d4b None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:20.270542 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c994a9-2bbf-4333-aa1c-8e9e43ec1d4b None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:20.272308 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 6/10] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:46:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:46:20.278042 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a4dbe-439c-49cc-ae88-998a128af509 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:20.278457 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a4dbe-439c-49cc-ae88-998a128af509 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:20.278693 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a4dbe-439c-49cc-ae88-998a128af509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:20.297994 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-b32a4dbe-439c-49cc-ae88-998a128af509 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:46:20.299169 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-b32a4dbe-439c-49cc-ae88-998a128af509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:46:20.308423 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 5/11] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:46:20 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:46:20.332457 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c994a9-2bbf-4333-aa1c-8e9e43ec1d4b None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:20.334295 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64ae69-f86e-41df-8c2e-965afc377470 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:20.334584 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64ae69-f86e-41df-8c2e-965afc377470 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:20.334859 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64ae69-f86e-41df-8c2e-965afc377470 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:20.337011 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 6/12] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:46:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 24 04:46:20.342683 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171a882-75c2-447d-8770-1db3d14ec3e6 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:20.342974 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171a882-75c2-447d-8770-1db3d14ec3e6 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:20.343258 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171a882-75c2-447d-8770-1db3d14ec3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:20.346438 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c994a9-2bbf-4333-aa1c-8e9e43ec1d4b None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:20.351366 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b9d6e-ad36-4463-979d-82d5ef68faa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:20.352157 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b9d6e-ad36-4463-979d-82d5ef68faa8 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:20.352439 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b9d6e-ad36-4463-979d-82d5ef68faa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:20.352742 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b9d6e-ad36-4463-979d-82d5ef68faa8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:20.360792 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-f171a882-75c2-447d-8770-1db3d14ec3e6 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:46:20.362003 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-f171a882-75c2-447d-8770-1db3d14ec3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:46:20.369346 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3b9d6e-ad36-4463-979d-82d5ef68faa8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:46:20.369756 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 7/13] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:46:20 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:46:20.376714 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-5a3b9d6e-ad36-4463-979d-82d5ef68faa8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 24 04:46:20.378090 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 7/14] 10.222.0.43 () {56 vars in 1117 bytes} [Fri Dec 24 04:46:20 2021] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:46:20.384011 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171a882-75c2-447d-8770-1db3d14ec3e6 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:20.393233 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b9d6e-ad36-4463-979d-82d5ef68faa8 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:20.394061 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171a882-75c2-447d-8770-1db3d14ec3e6 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:20.399548 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e77a13-fc0f-4d10-bac0-105520bb20fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:20.400215 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e77a13-fc0f-4d10-bac0-105520bb20fb admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:20.400502 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e77a13-fc0f-4d10-bac0-105520bb20fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:20.400803 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e77a13-fc0f-4d10-bac0-105520bb20fb admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:20.401734 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e77a13-fc0f-4d10-bac0-105520bb20fb admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:46:20.402047 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e77a13-fc0f-4d10-bac0-105520bb20fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:20.403605 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b9d6e-ad36-4463-979d-82d5ef68faa8 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:20.403910 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING py.warnings [None req-61e77a13-fc0f-4d10-bac0-105520bb20fb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:46:20.403910 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: warnings.warn(msg) Dec 24 04:46:20.403910 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: Dec 24 04:46:20.405161 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e77a13-fc0f-4d10-bac0-105520bb20fb admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:20.408019 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3864aa8-288c-4c1a-b4ad-c51696440422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:20.408667 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3864aa8-288c-4c1a-b4ad-c51696440422 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:20.408954 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3864aa8-288c-4c1a-b4ad-c51696440422 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:20.409228 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3864aa8-288c-4c1a-b4ad-c51696440422 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:20.417110 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3864aa8-288c-4c1a-b4ad-c51696440422 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:20.418924 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3864aa8-288c-4c1a-b4ad-c51696440422 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:20.421073 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 8/15] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:46:20 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:20.426722 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e77a13-fc0f-4d10-bac0-105520bb20fb admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:20.427725 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 8/16] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:46:20 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 24 04:46:20.433376 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3864aa8-288c-4c1a-b4ad-c51696440422 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:20.437069 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e77a13-fc0f-4d10-bac0-105520bb20fb admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:20.441909 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3864aa8-288c-4c1a-b4ad-c51696440422 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:20.442298 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78047c0-ae3c-49eb-865b-d4f39f45e8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:20.443148 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78047c0-ae3c-49eb-865b-d4f39f45e8b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:20.443436 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78047c0-ae3c-49eb-865b-d4f39f45e8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:20.443684 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78047c0-ae3c-49eb-865b-d4f39f45e8b2 admin admin] PATH_INFO: `/v3/users/d2031cc40bf6488b8dc6976b8c829c5e` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:20.445092 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78047c0-ae3c-49eb-865b-d4f39f45e8b2 admin admin] RBAC: Authorizing `identity:get_user(user_id=d2031cc40bf6488b8dc6976b8c829c5e)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:20.446961 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78047c0-ae3c-49eb-865b-d4f39f45e8b2 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:20.447217 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8169f7d-699b-49c7-8cf5-b6f6a837fcbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:20.447988 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8169f7d-699b-49c7-8cf5-b6f6a837fcbd admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:20.448271 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8169f7d-699b-49c7-8cf5-b6f6a837fcbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:20.448553 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 9/17] 10.222.0.43 () {56 vars in 1198 bytes} [Fri Dec 24 04:46:20 2021] GET /identity/v3/users/d2031cc40bf6488b8dc6976b8c829c5e => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:20.448684 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8169f7d-699b-49c7-8cf5-b6f6a837fcbd admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:20.450197 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8169f7d-699b-49c7-8cf5-b6f6a837fcbd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:20.452052 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8169f7d-699b-49c7-8cf5-b6f6a837fcbd admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:20.453625 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 9/18] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:46:20 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:46:20.454369 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78047c0-ae3c-49eb-865b-d4f39f45e8b2 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:20.465305 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78047c0-ae3c-49eb-865b-d4f39f45e8b2 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:20.470682 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c730abbf-47cf-4c49-8a65-d2d66c9b3156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:20.471515 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730abbf-47cf-4c49-8a65-d2d66c9b3156 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:20.471806 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730abbf-47cf-4c49-8a65-d2d66c9b3156 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:20.472083 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730abbf-47cf-4c49-8a65-d2d66c9b3156 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:20.473469 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c730abbf-47cf-4c49-8a65-d2d66c9b3156 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:20.475265 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c730abbf-47cf-4c49-8a65-d2d66c9b3156 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:20.477026 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 10/19] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:46:20 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:20.484197 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8169f7d-699b-49c7-8cf5-b6f6a837fcbd admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:20.494678 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8169f7d-699b-49c7-8cf5-b6f6a837fcbd admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:20.499853 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee32148-b29f-4723-8649-1b6b7dcdfae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:20.500561 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee32148-b29f-4723-8649-1b6b7dcdfae0 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:20.500841 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee32148-b29f-4723-8649-1b6b7dcdfae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:20.501120 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee32148-b29f-4723-8649-1b6b7dcdfae0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:20.501989 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee32148-b29f-4723-8649-1b6b7dcdfae0 admin admin] RBAC: Adding query filter params (role.id=d5e6fc257d8541d5a5ed1988eacd5be7, scope.domain.id=default, user.id=d2031cc40bf6488b8dc6976b8c829c5e) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:46:20.502372 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee32148-b29f-4723-8649-1b6b7dcdfae0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:20.504183 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING py.warnings [None req-fee32148-b29f-4723-8649-1b6b7dcdfae0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:46:20.504183 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: warnings.warn(msg) Dec 24 04:46:20.504183 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: Dec 24 04:46:20.505415 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee32148-b29f-4723-8649-1b6b7dcdfae0 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:20.516226 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 10/20] 10.222.0.43 () {56 vars in 1343 bytes} [Fri Dec 24 04:46:20 2021] GET /identity/v3/role_assignments?user.id=d2031cc40bf6488b8dc6976b8c829c5e&scope.domain.id=default&role.id=d5e6fc257d8541d5a5ed1988eacd5be7 => generated 233 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:46:23.102852 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6bbe65-10fb-41eb-b64f-3fc22c8b28b7 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:23.103777 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6bbe65-10fb-41eb-b64f-3fc22c8b28b7 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:23.104223 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6bbe65-10fb-41eb-b64f-3fc22c8b28b7 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:23.106460 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 11/21] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:46:23 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:46:23.113168 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38456a65-cf41-48cd-8004-e284ccd4b21e None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:23.114071 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38456a65-cf41-48cd-8004-e284ccd4b21e None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:23.114569 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38456a65-cf41-48cd-8004-e284ccd4b21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:23.166052 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG passlib.handlers.bcrypt [None req-38456a65-cf41-48cd-8004-e284ccd4b21e None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79113) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Dec 24 04:46:23.166839 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG passlib.handlers.bcrypt [None req-38456a65-cf41-48cd-8004-e284ccd4b21e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79113) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Dec 24 04:46:23.214067 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-38456a65-cf41-48cd-8004-e284ccd4b21e None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:46:23.216047 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-38456a65-cf41-48cd-8004-e284ccd4b21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:46:23.244656 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885ee25-ef24-4d6d-bbcc-e3ac86f3967a None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:23.245269 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885ee25-ef24-4d6d-bbcc-e3ac86f3967a None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:23.245764 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885ee25-ef24-4d6d-bbcc-e3ac86f3967a None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:23.247455 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 11/22] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:46:23 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:46:23.247938 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 12/23] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:46:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 24 04:46:23.254178 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3ae5a-174c-4b8e-9b40-dc88fa6cbdbd None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:23.254508 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3ae5a-174c-4b8e-9b40-dc88fa6cbdbd None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:23.254790 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3ae5a-174c-4b8e-9b40-dc88fa6cbdbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:23.279374 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-90c3ae5a-174c-4b8e-9b40-dc88fa6cbdbd None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:46:23.280966 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-90c3ae5a-174c-4b8e-9b40-dc88fa6cbdbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:46:23.290141 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885ee25-ef24-4d6d-bbcc-e3ac86f3967a None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:23.295276 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 12/24] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:46:23 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:46:23.316983 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885ee25-ef24-4d6d-bbcc-e3ac86f3967a None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:23.329228 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a5077-8fd9-4789-857a-602950eea2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:23.330358 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a5077-8fd9-4789-857a-602950eea2c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:23.330834 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a5077-8fd9-4789-857a-602950eea2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:23.331302 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a5077-8fd9-4789-857a-602950eea2c5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:23.339822 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3ae5a-174c-4b8e-9b40-dc88fa6cbdbd None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:23.349934 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3ae5a-174c-4b8e-9b40-dc88fa6cbdbd None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:23.368413 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e395e43-2a44-4759-a716-d4bab1bddc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:23.369050 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e395e43-2a44-4759-a716-d4bab1bddc35 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:23.369332 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e395e43-2a44-4759-a716-d4bab1bddc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:23.369607 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e395e43-2a44-4759-a716-d4bab1bddc35 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:23.370404 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e395e43-2a44-4759-a716-d4bab1bddc35 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:23.371511 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING py.warnings [None req-8e395e43-2a44-4759-a716-d4bab1bddc35 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:46:23.371511 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: warnings.warn(msg) Dec 24 04:46:23.371511 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: Dec 24 04:46:23.372449 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e395e43-2a44-4759-a716-d4bab1bddc35 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:23.502039 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2a5077-8fd9-4789-857a-602950eea2c5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:23.503939 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2a5077-8fd9-4789-857a-602950eea2c5 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:23.537953 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-ec2a5077-8fd9-4789-857a-602950eea2c5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:46:23.549151 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 13/25] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:46:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:46:23.550817 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053350f-29bd-4706-a059-3dce7c3b187e None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:23.551105 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053350f-29bd-4706-a059-3dce7c3b187e None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:23.551381 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053350f-29bd-4706-a059-3dce7c3b187e None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:23.553254 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 14/26] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:46:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:46:23.559945 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a3924-0a2e-494d-b601-31954fda14f3 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:23.560247 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a3924-0a2e-494d-b601-31954fda14f3 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:23.560508 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a3924-0a2e-494d-b601-31954fda14f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:23.590442 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-b47a3924-0a2e-494d-b601-31954fda14f3 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:46:23.591997 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-b47a3924-0a2e-494d-b601-31954fda14f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:46:23.611488 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 15/27] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:46:23 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 24 04:46:23.612782 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a3924-0a2e-494d-b601-31954fda14f3 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:23.629835 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a3924-0a2e-494d-b601-31954fda14f3 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:23.646251 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2684979f-3f8b-4099-b8f8-fbc18d88a0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:23.647283 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684979f-3f8b-4099-b8f8-fbc18d88a0fe admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:23.647758 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684979f-3f8b-4099-b8f8-fbc18d88a0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:23.648223 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684979f-3f8b-4099-b8f8-fbc18d88a0fe admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:23.649247 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2684979f-3f8b-4099-b8f8-fbc18d88a0fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:46:23.649745 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2684979f-3f8b-4099-b8f8-fbc18d88a0fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:23.653585 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING py.warnings [None req-2684979f-3f8b-4099-b8f8-fbc18d88a0fe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:46:23.653585 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: warnings.warn(msg) Dec 24 04:46:23.653585 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: Dec 24 04:46:23.655039 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2684979f-3f8b-4099-b8f8-fbc18d88a0fe admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:23.673393 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 13/28] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 04:46:23 2021] POST /identity/v3/roles => generated 219 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:46:23.674201 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e395e43-2a44-4759-a716-d4bab1bddc35 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:23.680387 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 16/29] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:46:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:23.692573 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2684979f-3f8b-4099-b8f8-fbc18d88a0fe admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:23.701215 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e395e43-2a44-4759-a716-d4bab1bddc35 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:23.714460 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2684979f-3f8b-4099-b8f8-fbc18d88a0fe admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:23.718155 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d5025-3912-4799-9fca-1d79d19c4081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:23.718989 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d5025-3912-4799-9fca-1d79d19c4081 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:23.719277 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d5025-3912-4799-9fca-1d79d19c4081 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:23.719552 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d5025-3912-4799-9fca-1d79d19c4081 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:23.731729 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e1aea-1ee3-4524-b279-263f6b3de618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:23.732468 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e1aea-1ee3-4524-b279-263f6b3de618 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:23.732887 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e1aea-1ee3-4524-b279-263f6b3de618 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:23.733175 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e1aea-1ee3-4524-b279-263f6b3de618 admin admin] PATH_INFO: `/v3/projects` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:23.734119 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e1aea-1ee3-4524-b279-263f6b3de618 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:23.735173 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING py.warnings [None req-327e1aea-1ee3-4524-b279-263f6b3de618 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:46:23.735173 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: warnings.warn(msg) Dec 24 04:46:23.735173 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: Dec 24 04:46:23.736426 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e1aea-1ee3-4524-b279-263f6b3de618 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:23.753009 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d5025-3912-4799-9fca-1d79d19c4081 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:46:23.763300 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-565d5025-3912-4799-9fca-1d79d19c4081 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 24 04:46:23.765292 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 14/30] 10.222.0.43 () {56 vars in 1117 bytes} [Fri Dec 24 04:46:23 2021] GET /identity/v3/roles/admin => generated 83 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:46:23.771293 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d5025-3912-4799-9fca-1d79d19c4081 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:23.795634 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d5025-3912-4799-9fca-1d79d19c4081 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:23.809449 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fed4e5-84de-4c56-9c46-e613cc8131ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:23.810276 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fed4e5-84de-4c56-9c46-e613cc8131ff admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:23.810595 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fed4e5-84de-4c56-9c46-e613cc8131ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:23.810944 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fed4e5-84de-4c56-9c46-e613cc8131ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:23.812050 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fed4e5-84de-4c56-9c46-e613cc8131ff admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:46:23.812482 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fed4e5-84de-4c56-9c46-e613cc8131ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:23.816675 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING py.warnings [None req-67fed4e5-84de-4c56-9c46-e613cc8131ff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:46:23.816675 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: warnings.warn(msg) Dec 24 04:46:23.816675 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: Dec 24 04:46:23.817660 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fed4e5-84de-4c56-9c46-e613cc8131ff admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:23.840841 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 15/31] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:46:23 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:46:23.847812 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fed4e5-84de-4c56-9c46-e613cc8131ff admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:23.862198 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fed4e5-84de-4c56-9c46-e613cc8131ff admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:23.874793 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f59b2-8cab-41f1-aebb-f74365564e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:23.875699 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f59b2-8cab-41f1-aebb-f74365564e0a admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:23.876019 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f59b2-8cab-41f1-aebb-f74365564e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:23.876267 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f59b2-8cab-41f1-aebb-f74365564e0a admin admin] PATH_INFO: `/v3/users/d2031cc40bf6488b8dc6976b8c829c5e` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:23.878219 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f59b2-8cab-41f1-aebb-f74365564e0a admin admin] RBAC: Authorizing `identity:get_user(user_id=d2031cc40bf6488b8dc6976b8c829c5e)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:23.880128 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f59b2-8cab-41f1-aebb-f74365564e0a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:23.881749 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 16/32] 10.222.0.43 () {56 vars in 1198 bytes} [Fri Dec 24 04:46:23 2021] GET /identity/v3/users/d2031cc40bf6488b8dc6976b8c829c5e => generated 247 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:46:23.891252 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f59b2-8cab-41f1-aebb-f74365564e0a admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:23.904995 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f59b2-8cab-41f1-aebb-f74365564e0a admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:23.919361 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2401cbf-d15d-47b5-84f4-d71022aa65a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:23.920177 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2401cbf-d15d-47b5-84f4-d71022aa65a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:23.920557 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2401cbf-d15d-47b5-84f4-d71022aa65a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:23.920835 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2401cbf-d15d-47b5-84f4-d71022aa65a6 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:23.922220 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2401cbf-d15d-47b5-84f4-d71022aa65a6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:23.923970 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2401cbf-d15d-47b5-84f4-d71022aa65a6 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:23.926051 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 17/33] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:46:23 2021] GET /identity/v3/domains/default => generated 199 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:46:23.933019 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2401cbf-d15d-47b5-84f4-d71022aa65a6 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:23.944810 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 17/34] 10.222.0.43 () {60 vars in 1162 bytes} [Fri Dec 24 04:46:23 2021] POST /identity/v3/projects => generated 301 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:46:23.952404 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2401cbf-d15d-47b5-84f4-d71022aa65a6 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:24.068821 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a669282-12e1-4740-bbdd-58e9bdd1a456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:24.069717 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a669282-12e1-4740-bbdd-58e9bdd1a456 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:24.069996 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a669282-12e1-4740-bbdd-58e9bdd1a456 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:24.070271 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a669282-12e1-4740-bbdd-58e9bdd1a456 admin admin] PATH_INFO: `/v3/domains/default/users/d2031cc40bf6488b8dc6976b8c829c5e/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:24.078788 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a669282-12e1-4740-bbdd-58e9bdd1a456 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=d2031cc40bf6488b8dc6976b8c829c5e, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:24.079855 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING py.warnings [None req-2a669282-12e1-4740-bbdd-58e9bdd1a456 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:46:24.079855 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: warnings.warn(msg) Dec 24 04:46:24.079855 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: Dec 24 04:46:24.081878 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a669282-12e1-4740-bbdd-58e9bdd1a456 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:24.118847 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 18/35] 10.222.0.43 () {58 vars in 1382 bytes} [Fri Dec 24 04:46:23 2021] PUT /identity/v3/domains/default/users/d2031cc40bf6488b8dc6976b8c829c5e/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 04:46:24.226211 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d615383-1d8c-4765-a139-8570b2353415 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:24.226779 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d615383-1d8c-4765-a139-8570b2353415 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:24.226779 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d615383-1d8c-4765-a139-8570b2353415 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:24.229308 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 18/36] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:46:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:46:24.236078 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceee481-68ac-409c-80cb-8cf3e9167484 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:24.236409 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceee481-68ac-409c-80cb-8cf3e9167484 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:24.236659 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceee481-68ac-409c-80cb-8cf3e9167484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:24.261306 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-3ceee481-68ac-409c-80cb-8cf3e9167484 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:46:24.262956 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-3ceee481-68ac-409c-80cb-8cf3e9167484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:46:24.335844 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 19/37] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:46:24 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:46:24.361184 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d615383-1d8c-4765-a139-8570b2353415 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:24.375478 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d615383-1d8c-4765-a139-8570b2353415 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:24.380430 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821928ab-4b8e-4fe9-98ea-8618111568cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:24.381345 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821928ab-4b8e-4fe9-98ea-8618111568cc admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:24.381804 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821928ab-4b8e-4fe9-98ea-8618111568cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:24.382270 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821928ab-4b8e-4fe9-98ea-8618111568cc admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:24.383290 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821928ab-4b8e-4fe9-98ea-8618111568cc admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:24.384778 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING py.warnings [None req-821928ab-4b8e-4fe9-98ea-8618111568cc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:46:24.384778 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: warnings.warn(msg) Dec 24 04:46:24.384778 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: Dec 24 04:46:24.386142 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821928ab-4b8e-4fe9-98ea-8618111568cc admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:24.405091 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 19/38] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 04:46:24 2021] POST /identity/v3/roles => generated 225 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:46:24.929164 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aec45b-b9d1-4226-a65e-515f64b749c9 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:24.929537 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aec45b-b9d1-4226-a65e-515f64b749c9 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:24.929724 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aec45b-b9d1-4226-a65e-515f64b749c9 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:24.931569 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 20/39] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:46:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:46:24.937357 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56107b6a-43f1-442c-981b-c3f850eaed88 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:24.937646 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56107b6a-43f1-442c-981b-c3f850eaed88 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:24.937933 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56107b6a-43f1-442c-981b-c3f850eaed88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:24.956362 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-56107b6a-43f1-442c-981b-c3f850eaed88 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:46:24.957976 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-56107b6a-43f1-442c-981b-c3f850eaed88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:46:24.968621 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 20/40] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:46:24 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:46:24.988914 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb565c-ab20-41cd-914d-b9c731f393ba None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:24.989201 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb565c-ab20-41cd-914d-b9c731f393ba None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:24.989475 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb565c-ab20-41cd-914d-b9c731f393ba None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:24.989627 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56107b6a-43f1-442c-981b-c3f850eaed88 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:24.991373 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 21/41] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:46:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:46:24.997001 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a585cc5-67f3-4287-9719-12265960cd27 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:24.997258 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a585cc5-67f3-4287-9719-12265960cd27 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:24.997565 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a585cc5-67f3-4287-9719-12265960cd27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:24.999126 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56107b6a-43f1-442c-981b-c3f850eaed88 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:25.007394 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c62377f-ea8a-4b51-baab-73b79535c892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:25.007780 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62377f-ea8a-4b51-baab-73b79535c892 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:25.008065 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62377f-ea8a-4b51-baab-73b79535c892 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:25.008341 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62377f-ea8a-4b51-baab-73b79535c892 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:25.009601 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c62377f-ea8a-4b51-baab-73b79535c892 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:25.011337 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c62377f-ea8a-4b51-baab-73b79535c892 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:25.013182 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 21/42] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:46:24 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:46:25.017733 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-5a585cc5-67f3-4287-9719-12265960cd27 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:46:25.018937 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-5a585cc5-67f3-4287-9719-12265960cd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:46:25.019112 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c62377f-ea8a-4b51-baab-73b79535c892 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:25.026607 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 22/43] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:46:24 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 24 04:46:25.029060 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c62377f-ea8a-4b51-baab-73b79535c892 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:25.034156 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7f060e-21d7-4bc5-aad5-e5c7817189e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:25.035000 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f060e-21d7-4bc5-aad5-e5c7817189e6 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:25.035450 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f060e-21d7-4bc5-aad5-e5c7817189e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:25.035913 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f060e-21d7-4bc5-aad5-e5c7817189e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:25.036854 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7f060e-21d7-4bc5-aad5-e5c7817189e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:25.038928 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7f060e-21d7-4bc5-aad5-e5c7817189e6 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:25.052365 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a585cc5-67f3-4287-9719-12265960cd27 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:25.062133 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a585cc5-67f3-4287-9719-12265960cd27 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:25.065887 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 22/44] 10.222.0.43 () {60 vars in 1162 bytes} [Fri Dec 24 04:46:25 2021] POST /identity/v3/projects => generated 312 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 04:46:25.073911 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa2a05-c709-415b-b2f2-9dc6dc5597da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:25.074621 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa2a05-c709-415b-b2f2-9dc6dc5597da admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:25.074984 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa2a05-c709-415b-b2f2-9dc6dc5597da admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:25.075237 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa2a05-c709-415b-b2f2-9dc6dc5597da admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:25.076092 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa2a05-c709-415b-b2f2-9dc6dc5597da admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:25.077926 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa2a05-c709-415b-b2f2-9dc6dc5597da admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:25.093324 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 23/45] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 04:46:25 2021] POST /identity/v3/roles => generated 223 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 04:46:26.690795 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0abb47-19a5-41a0-800f-e7fd6d685241 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:26.691316 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0abb47-19a5-41a0-800f-e7fd6d685241 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:26.691316 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0abb47-19a5-41a0-800f-e7fd6d685241 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:26.693104 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 23/46] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:46:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:46:26.699130 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0778d9c-b5c9-4659-bd11-490cd210a072 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:26.699605 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0778d9c-b5c9-4659-bd11-490cd210a072 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:26.699691 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0778d9c-b5c9-4659-bd11-490cd210a072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:26.719393 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-a0778d9c-b5c9-4659-bd11-490cd210a072 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:46:26.720582 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-a0778d9c-b5c9-4659-bd11-490cd210a072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:46:26.781417 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 24/47] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:46:26 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:46:26.805287 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0abb47-19a5-41a0-800f-e7fd6d685241 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:26.818198 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0abb47-19a5-41a0-800f-e7fd6d685241 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:26.822842 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ec7cc-b9f6-4fed-9788-287bc01f5549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:26.823620 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ec7cc-b9f6-4fed-9788-287bc01f5549 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:26.823901 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ec7cc-b9f6-4fed-9788-287bc01f5549 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:26.824176 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ec7cc-b9f6-4fed-9788-287bc01f5549 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:26.837050 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114ec7cc-b9f6-4fed-9788-287bc01f5549 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:46:26.844204 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-114ec7cc-b9f6-4fed-9788-287bc01f5549 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 24 04:46:26.845421 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 24/48] 10.222.0.43 () {56 vars in 1117 bytes} [Fri Dec 24 04:46:26 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:46:26.851912 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0778d9c-b5c9-4659-bd11-490cd210a072 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:26.861201 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0778d9c-b5c9-4659-bd11-490cd210a072 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:26.866111 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa40422-0460-44f9-8cb6-06c235981798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:26.866867 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa40422-0460-44f9-8cb6-06c235981798 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:26.867217 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa40422-0460-44f9-8cb6-06c235981798 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:26.867496 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa40422-0460-44f9-8cb6-06c235981798 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:26.868267 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa40422-0460-44f9-8cb6-06c235981798 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:46:26.868561 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa40422-0460-44f9-8cb6-06c235981798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:26.870226 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa40422-0460-44f9-8cb6-06c235981798 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:26.878941 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 25/49] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:46:26 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:26.884962 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ec7cc-b9f6-4fed-9788-287bc01f5549 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:26.896242 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ec7cc-b9f6-4fed-9788-287bc01f5549 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:26.902135 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41f205-6d44-4e7b-878c-d3d4aaf5a65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:26.903008 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41f205-6d44-4e7b-878c-d3d4aaf5a65a admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:26.903292 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41f205-6d44-4e7b-878c-d3d4aaf5a65a admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:26.903567 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41f205-6d44-4e7b-878c-d3d4aaf5a65a admin admin] PATH_INFO: `/v3/users/d2031cc40bf6488b8dc6976b8c829c5e` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:26.905286 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c41f205-6d44-4e7b-878c-d3d4aaf5a65a admin admin] RBAC: Authorizing `identity:get_user(user_id=d2031cc40bf6488b8dc6976b8c829c5e)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:26.907273 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c41f205-6d44-4e7b-878c-d3d4aaf5a65a admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:26.908979 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 25/50] 10.222.0.43 () {56 vars in 1198 bytes} [Fri Dec 24 04:46:26 2021] GET /identity/v3/users/d2031cc40bf6488b8dc6976b8c829c5e => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:26.915423 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa40422-0460-44f9-8cb6-06c235981798 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:26.926196 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa40422-0460-44f9-8cb6-06c235981798 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:26.931945 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd89a9b9-3634-49c3-8e2a-3253c998695c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:26.932769 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89a9b9-3634-49c3-8e2a-3253c998695c admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:26.933049 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89a9b9-3634-49c3-8e2a-3253c998695c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:26.933324 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89a9b9-3634-49c3-8e2a-3253c998695c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:26.934530 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd89a9b9-3634-49c3-8e2a-3253c998695c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:26.936427 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd89a9b9-3634-49c3-8e2a-3253c998695c admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:26.938093 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 26/51] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:46:26 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:26.944366 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41f205-6d44-4e7b-878c-d3d4aaf5a65a admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:26.954845 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41f205-6d44-4e7b-878c-d3d4aaf5a65a admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:26.960933 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9407040-2e5d-4b4c-b88f-c522cd58f402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:26.961585 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9407040-2e5d-4b4c-b88f-c522cd58f402 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:26.961868 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9407040-2e5d-4b4c-b88f-c522cd58f402 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:26.962138 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9407040-2e5d-4b4c-b88f-c522cd58f402 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:26.962996 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9407040-2e5d-4b4c-b88f-c522cd58f402 admin admin] RBAC: Adding query filter params (role.id=d5e6fc257d8541d5a5ed1988eacd5be7, scope.domain.id=default, user.id=d2031cc40bf6488b8dc6976b8c829c5e) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:46:26.963302 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9407040-2e5d-4b4c-b88f-c522cd58f402 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:26.964310 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING py.warnings [None req-c9407040-2e5d-4b4c-b88f-c522cd58f402 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:46:26.964310 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: warnings.warn(msg) Dec 24 04:46:26.964310 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: Dec 24 04:46:26.965528 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9407040-2e5d-4b4c-b88f-c522cd58f402 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:26.973407 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 26/52] 10.222.0.43 () {56 vars in 1343 bytes} [Fri Dec 24 04:46:26 2021] GET /identity/v3/role_assignments?user.id=d2031cc40bf6488b8dc6976b8c829c5e&scope.domain.id=default&role.id=d5e6fc257d8541d5a5ed1988eacd5be7 => generated 530 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:27.464090 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408e9ca-99bf-4fd7-a665-178368d4a46a None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:27.464507 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408e9ca-99bf-4fd7-a665-178368d4a46a None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:27.464859 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408e9ca-99bf-4fd7-a665-178368d4a46a None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:27.467921 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 27/53] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:46:27 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:46:27.477693 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a5836-3fd9-4181-9251-174666840ff9 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:27.478116 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a5836-3fd9-4181-9251-174666840ff9 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:27.478526 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a5836-3fd9-4181-9251-174666840ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:27.500476 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-479a5836-3fd9-4181-9251-174666840ff9 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:46:27.501717 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-479a5836-3fd9-4181-9251-174666840ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:46:27.511887 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 27/54] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:46:27 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:46:27.548870 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408e9ca-99bf-4fd7-a665-178368d4a46a None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:27.564131 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408e9ca-99bf-4fd7-a665-178368d4a46a None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:27.569785 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda5f5ef-eabc-4470-ab9e-37f94b76edcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:27.570507 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5f5ef-eabc-4470-ab9e-37f94b76edcb admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:27.570794 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5f5ef-eabc-4470-ab9e-37f94b76edcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:27.571073 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5f5ef-eabc-4470-ab9e-37f94b76edcb admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:27.572365 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda5f5ef-eabc-4470-ab9e-37f94b76edcb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:27.574108 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda5f5ef-eabc-4470-ab9e-37f94b76edcb admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:27.575662 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 28/55] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:46:27 2021] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:27.581951 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a5836-3fd9-4181-9251-174666840ff9 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:27.596981 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a5836-3fd9-4181-9251-174666840ff9 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:27.606147 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b505eb7f-32c3-4443-85e6-271fc7f6b005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:27.607150 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b505eb7f-32c3-4443-85e6-271fc7f6b005 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:27.607586 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b505eb7f-32c3-4443-85e6-271fc7f6b005 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:27.608192 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b505eb7f-32c3-4443-85e6-271fc7f6b005 admin admin] PATH_INFO: `/v3/projects` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:27.609193 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b505eb7f-32c3-4443-85e6-271fc7f6b005 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:27.611159 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b505eb7f-32c3-4443-85e6-271fc7f6b005 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:27.641792 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 28/56] 10.222.0.43 () {60 vars in 1161 bytes} [Fri Dec 24 04:46:27 2021] POST /identity/v3/projects => generated 298 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:46:29.984807 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b46c58-07d6-41b1-82b6-98cadc3f5a51 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:29.985358 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b46c58-07d6-41b1-82b6-98cadc3f5a51 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:29.985358 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b46c58-07d6-41b1-82b6-98cadc3f5a51 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:29.987140 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 29/57] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:46:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:46:29.994069 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d544e-f3da-4036-9733-2b35a69d446a None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:29.994785 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d544e-f3da-4036-9733-2b35a69d446a None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:29.994926 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d544e-f3da-4036-9733-2b35a69d446a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:30.021793 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-cd1d544e-f3da-4036-9733-2b35a69d446a None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:46:30.022992 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-cd1d544e-f3da-4036-9733-2b35a69d446a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:46:30.088142 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 29/58] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:46:29 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:46:30.127713 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b46c58-07d6-41b1-82b6-98cadc3f5a51 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:30.142816 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b46c58-07d6-41b1-82b6-98cadc3f5a51 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:30.148158 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be745a3-f22f-4931-beaf-27dfeeb00888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:30.148974 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be745a3-f22f-4931-beaf-27dfeeb00888 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:30.149260 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be745a3-f22f-4931-beaf-27dfeeb00888 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:30.149535 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be745a3-f22f-4931-beaf-27dfeeb00888 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:30.150799 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be745a3-f22f-4931-beaf-27dfeeb00888 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:30.152502 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be745a3-f22f-4931-beaf-27dfeeb00888 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:30.154102 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 30/59] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:46:30 2021] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:30.160843 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d544e-f3da-4036-9733-2b35a69d446a None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:30.175421 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d544e-f3da-4036-9733-2b35a69d446a None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:30.184568 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f5780-bee2-4835-afa6-5b36fead6b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:30.185552 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f5780-bee2-4835-afa6-5b36fead6b42 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:30.185959 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f5780-bee2-4835-afa6-5b36fead6b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:30.186240 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f5780-bee2-4835-afa6-5b36fead6b42 admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:30.186983 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f5780-bee2-4835-afa6-5b36fead6b42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:30.188038 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING py.warnings [None req-e06f5780-bee2-4835-afa6-5b36fead6b42 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:46:30.188038 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: warnings.warn(msg) Dec 24 04:46:30.188038 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: Dec 24 04:46:30.189306 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f5780-bee2-4835-afa6-5b36fead6b42 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:30.221616 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 30/60] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Dec 24 04:46:30 2021] POST /identity/v3/users => generated 275 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:46:33.702096 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28090c44-21ce-46c5-8fa4-00dc68f2a547 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:33.703216 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28090c44-21ce-46c5-8fa4-00dc68f2a547 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:33.703729 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28090c44-21ce-46c5-8fa4-00dc68f2a547 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:33.706089 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 31/61] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:46:33 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:46:33.712160 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4784c-106f-4175-a52f-3a70c503e9be None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:33.713056 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4784c-106f-4175-a52f-3a70c503e9be None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:33.713547 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4784c-106f-4175-a52f-3a70c503e9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:33.739095 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-56e4784c-106f-4175-a52f-3a70c503e9be None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:46:33.740740 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-56e4784c-106f-4175-a52f-3a70c503e9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:46:33.755213 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 31/62] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:46:33 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:46:33.787119 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28090c44-21ce-46c5-8fa4-00dc68f2a547 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:33.804759 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28090c44-21ce-46c5-8fa4-00dc68f2a547 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:33.809699 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d6113-81a8-4fad-9c1f-3a2c00d5fd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:33.810607 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00a740-0c8c-45ca-84e5-47788dc62923 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:33.810848 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d6113-81a8-4fad-9c1f-3a2c00d5fd32 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:33.811134 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d6113-81a8-4fad-9c1f-3a2c00d5fd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:33.811518 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d6113-81a8-4fad-9c1f-3a2c00d5fd32 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:33.811721 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00a740-0c8c-45ca-84e5-47788dc62923 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:33.812207 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00a740-0c8c-45ca-84e5-47788dc62923 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:33.814289 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 32/63] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:46:33 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 24 04:46:33.820894 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e68242-210c-43bf-b30c-4666640b275c None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:33.821976 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e68242-210c-43bf-b30c-4666640b275c None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:33.822582 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e68242-210c-43bf-b30c-4666640b275c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:33.837177 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35d6113-81a8-4fad-9c1f-3a2c00d5fd32 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:46:33.842406 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-56e68242-210c-43bf-b30c-4666640b275c None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:46:33.843899 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-56e68242-210c-43bf-b30c-4666640b275c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:46:33.845506 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-d35d6113-81a8-4fad-9c1f-3a2c00d5fd32 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 24 04:46:33.847084 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 32/64] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:46:33 2021] GET /identity/v3/roles/member => generated 84 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:46:33.853081 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d6113-81a8-4fad-9c1f-3a2c00d5fd32 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:33.864844 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 33/65] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:46:33 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:46:33.872154 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d6113-81a8-4fad-9c1f-3a2c00d5fd32 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:33.886146 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19e96f-4894-4358-9b67-97e081d72d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:33.887144 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19e96f-4894-4358-9b67-97e081d72d9a admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:33.887629 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19e96f-4894-4358-9b67-97e081d72d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:33.888102 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19e96f-4894-4358-9b67-97e081d72d9a admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:33.889136 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa19e96f-4894-4358-9b67-97e081d72d9a admin admin] RBAC: Adding query filter params (name=member) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:46:33.889648 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa19e96f-4894-4358-9b67-97e081d72d9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:33.891528 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa19e96f-4894-4358-9b67-97e081d72d9a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:33.904593 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 33/66] 10.222.0.43 () {56 vars in 1122 bytes} [Fri Dec 24 04:46:33 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:46:33.910649 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e68242-210c-43bf-b30c-4666640b275c None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:33.923865 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19e96f-4894-4358-9b67-97e081d72d9a admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:33.927731 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e68242-210c-43bf-b30c-4666640b275c None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:33.940783 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19e96f-4894-4358-9b67-97e081d72d9a admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:33.941715 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fc14b8-b3a2-4970-b8bf-d30425d142c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:33.942887 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc14b8-b3a2-4970-b8bf-d30425d142c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:33.943385 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc14b8-b3a2-4970-b8bf-d30425d142c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:33.943951 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc14b8-b3a2-4970-b8bf-d30425d142c3 admin admin] PATH_INFO: `/v3/users/672e494a2e37401c8e61391c2d6883b7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:33.959757 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1071e7e-630b-489c-8206-a36820a75aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:33.961018 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1071e7e-630b-489c-8206-a36820a75aab admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:33.961510 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1071e7e-630b-489c-8206-a36820a75aab admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:33.962072 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1071e7e-630b-489c-8206-a36820a75aab admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:33.972665 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fc14b8-b3a2-4970-b8bf-d30425d142c3 admin admin] RBAC: Authorizing `identity:get_user(user_id=672e494a2e37401c8e61391c2d6883b7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:33.975505 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fc14b8-b3a2-4970-b8bf-d30425d142c3 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:33.978163 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 34/67] 10.222.0.43 () {56 vars in 1198 bytes} [Fri Dec 24 04:46:33 2021] GET /identity/v3/users/672e494a2e37401c8e61391c2d6883b7 => generated 275 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:33.984127 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1071e7e-630b-489c-8206-a36820a75aab admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:46:33.985327 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fc14b8-b3a2-4970-b8bf-d30425d142c3 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:33.993229 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-b1071e7e-630b-489c-8206-a36820a75aab admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 24 04:46:34.000870 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 34/68] 10.222.0.43 () {56 vars in 1117 bytes} [Fri Dec 24 04:46:33 2021] GET /identity/v3/roles/admin => generated 83 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:46:34.004882 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fc14b8-b3a2-4970-b8bf-d30425d142c3 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:34.015398 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99651da1-3b61-4059-9c40-dc0f2b02239a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:34.016467 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99651da1-3b61-4059-9c40-dc0f2b02239a admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:34.017007 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99651da1-3b61-4059-9c40-dc0f2b02239a admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:34.017506 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99651da1-3b61-4059-9c40-dc0f2b02239a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:34.022380 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1071e7e-630b-489c-8206-a36820a75aab admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:34.034706 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1071e7e-630b-489c-8206-a36820a75aab admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:34.037118 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99651da1-3b61-4059-9c40-dc0f2b02239a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:34.040768 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99651da1-3b61-4059-9c40-dc0f2b02239a admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:34.049784 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5012a00a-3f25-4f1a-93ce-37833c0e4762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:34.050848 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5012a00a-3f25-4f1a-93ce-37833c0e4762 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:34.051333 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5012a00a-3f25-4f1a-93ce-37833c0e4762 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:34.051813 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5012a00a-3f25-4f1a-93ce-37833c0e4762 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:34.052881 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5012a00a-3f25-4f1a-93ce-37833c0e4762 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:46:34.053624 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5012a00a-3f25-4f1a-93ce-37833c0e4762 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:34.055721 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5012a00a-3f25-4f1a-93ce-37833c0e4762 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:34.067130 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 35/69] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:46:33 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 24 04:46:34.071694 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 35/70] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:46:34 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:46:34.073559 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99651da1-3b61-4059-9c40-dc0f2b02239a admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:34.081514 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5012a00a-3f25-4f1a-93ce-37833c0e4762 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:34.086335 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99651da1-3b61-4059-9c40-dc0f2b02239a admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:34.098695 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5012a00a-3f25-4f1a-93ce-37833c0e4762 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:34.102202 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd80c0a-d38c-4407-93ae-b50e1bb86848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:34.103321 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd80c0a-d38c-4407-93ae-b50e1bb86848 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:34.103815 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd80c0a-d38c-4407-93ae-b50e1bb86848 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:34.104383 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd80c0a-d38c-4407-93ae-b50e1bb86848 admin admin] PATH_INFO: `/v3/projects/036a37ec848b4c9bb369e71b5c2453c7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:34.106767 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd80c0a-d38c-4407-93ae-b50e1bb86848 admin admin] RBAC: Authorizing `identity:get_project(project_id=036a37ec848b4c9bb369e71b5c2453c7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:34.109622 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd80c0a-d38c-4407-93ae-b50e1bb86848 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:34.113867 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 36/71] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:46:34 2021] GET /identity/v3/projects/036a37ec848b4c9bb369e71b5c2453c7 => generated 298 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:34.115744 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4279ab-2dbd-4d3e-9f09-95972ed6b79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:34.117006 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4279ab-2dbd-4d3e-9f09-95972ed6b79b admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:34.117493 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4279ab-2dbd-4d3e-9f09-95972ed6b79b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:34.117964 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4279ab-2dbd-4d3e-9f09-95972ed6b79b admin admin] PATH_INFO: `/v3/users/d2031cc40bf6488b8dc6976b8c829c5e` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:34.119404 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd80c0a-d38c-4407-93ae-b50e1bb86848 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:34.121608 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4279ab-2dbd-4d3e-9f09-95972ed6b79b admin admin] RBAC: Authorizing `identity:get_user(user_id=d2031cc40bf6488b8dc6976b8c829c5e)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:34.129021 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4279ab-2dbd-4d3e-9f09-95972ed6b79b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:34.131251 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 36/72] 10.222.0.43 () {56 vars in 1198 bytes} [Fri Dec 24 04:46:34 2021] GET /identity/v3/users/d2031cc40bf6488b8dc6976b8c829c5e => generated 247 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:46:34.137696 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd80c0a-d38c-4407-93ae-b50e1bb86848 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:34.139789 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4279ab-2dbd-4d3e-9f09-95972ed6b79b admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:34.152296 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4279ab-2dbd-4d3e-9f09-95972ed6b79b admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:34.155204 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c218d742-1b4e-4739-82b4-c6d47d537940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:34.156299 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218d742-1b4e-4739-82b4-c6d47d537940 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:34.157067 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218d742-1b4e-4739-82b4-c6d47d537940 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:34.157784 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218d742-1b4e-4739-82b4-c6d47d537940 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:34.158855 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c218d742-1b4e-4739-82b4-c6d47d537940 admin admin] RBAC: Adding query filter params (role.id=19e41972301c400193cf0c53e0462e49, scope.project.id=036a37ec848b4c9bb369e71b5c2453c7, user.id=672e494a2e37401c8e61391c2d6883b7) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:46:34.159790 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c218d742-1b4e-4739-82b4-c6d47d537940 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:34.163806 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c218d742-1b4e-4739-82b4-c6d47d537940 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:34.168869 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee87868f-04f8-41f8-a781-b076699a887b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:34.169927 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87868f-04f8-41f8-a781-b076699a887b admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:34.170439 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87868f-04f8-41f8-a781-b076699a887b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:34.170995 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87868f-04f8-41f8-a781-b076699a887b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:34.180518 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 37/73] 10.222.0.43 () {56 vars in 1395 bytes} [Fri Dec 24 04:46:34 2021] GET /identity/v3/role_assignments?user.id=672e494a2e37401c8e61391c2d6883b7&scope.project.id=036a37ec848b4c9bb369e71b5c2453c7&role.id=19e41972301c400193cf0c53e0462e49 => generated 259 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:34.183276 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee87868f-04f8-41f8-a781-b076699a887b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:34.186299 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee87868f-04f8-41f8-a781-b076699a887b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:34.197355 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 37/74] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:46:34 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 24 04:46:34.205715 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c218d742-1b4e-4739-82b4-c6d47d537940 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:34.222777 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c218d742-1b4e-4739-82b4-c6d47d537940 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:34.227462 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e49e7d-a036-4c66-8884-39f1f318806e None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:34.228084 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e49e7d-a036-4c66-8884-39f1f318806e None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:34.228630 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e49e7d-a036-4c66-8884-39f1f318806e None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:34.234121 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 38/75] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:46:34 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:46:34.242005 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b1ca8-2b0f-4d38-9e1e-638c5e445cc8 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:34.242587 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b1ca8-2b0f-4d38-9e1e-638c5e445cc8 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:34.243100 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b1ca8-2b0f-4d38-9e1e-638c5e445cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:34.244471 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bdb3ec-0020-499b-a7ef-cf2abec77b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:34.245718 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdb3ec-0020-499b-a7ef-cf2abec77b0f admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:34.246346 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdb3ec-0020-499b-a7ef-cf2abec77b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:34.246840 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdb3ec-0020-499b-a7ef-cf2abec77b0f admin admin] PATH_INFO: `/v3/projects/036a37ec848b4c9bb369e71b5c2453c7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:34.248344 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bdb3ec-0020-499b-a7ef-cf2abec77b0f admin admin] RBAC: Authorizing `identity:get_project(project_id=036a37ec848b4c9bb369e71b5c2453c7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:34.253729 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bdb3ec-0020-499b-a7ef-cf2abec77b0f admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:34.256554 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 38/76] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:46:34 2021] GET /identity/v3/projects/036a37ec848b4c9bb369e71b5c2453c7 => generated 298 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:34.266687 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bdb3ec-0020-499b-a7ef-cf2abec77b0f admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:34.276374 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-d49b1ca8-2b0f-4d38-9e1e-638c5e445cc8 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:46:34.277969 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-d49b1ca8-2b0f-4d38-9e1e-638c5e445cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:46:34.286803 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 39/77] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:46:34 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:46:34.291430 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bdb3ec-0020-499b-a7ef-cf2abec77b0f admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:34.306933 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec657f3a-4309-4dcf-9f9b-9d7112efee86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:34.307889 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec657f3a-4309-4dcf-9f9b-9d7112efee86 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:34.308343 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec657f3a-4309-4dcf-9f9b-9d7112efee86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:34.308795 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec657f3a-4309-4dcf-9f9b-9d7112efee86 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:34.309824 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec657f3a-4309-4dcf-9f9b-9d7112efee86 admin admin] RBAC: Adding query filter params (role.id=d5e6fc257d8541d5a5ed1988eacd5be7, scope.project.id=036a37ec848b4c9bb369e71b5c2453c7, user.id=d2031cc40bf6488b8dc6976b8c829c5e) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:46:34.310285 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec657f3a-4309-4dcf-9f9b-9d7112efee86 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:34.312839 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec657f3a-4309-4dcf-9f9b-9d7112efee86 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:34.321235 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b1ca8-2b0f-4d38-9e1e-638c5e445cc8 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:34.325207 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b1ca8-2b0f-4d38-9e1e-638c5e445cc8 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:34.326034 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 39/78] 10.222.0.43 () {56 vars in 1395 bytes} [Fri Dec 24 04:46:34 2021] GET /identity/v3/role_assignments?user.id=d2031cc40bf6488b8dc6976b8c829c5e&scope.project.id=036a37ec848b4c9bb369e71b5c2453c7&role.id=d5e6fc257d8541d5a5ed1988eacd5be7 => generated 259 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:34.330382 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf547c-6428-4317-a87b-0e39727c1541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:34.331449 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf547c-6428-4317-a87b-0e39727c1541 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:34.331877 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf547c-6428-4317-a87b-0e39727c1541 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:34.332292 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf547c-6428-4317-a87b-0e39727c1541 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:34.345567 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cf547c-6428-4317-a87b-0e39727c1541 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:46:34.353371 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-a5cf547c-6428-4317-a87b-0e39727c1541 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 24 04:46:34.355271 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 40/79] 10.222.0.43 () {56 vars in 1135 bytes} [Fri Dec 24 04:46:34 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:46:34.362099 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec657f3a-4309-4dcf-9f9b-9d7112efee86 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:34.381884 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec657f3a-4309-4dcf-9f9b-9d7112efee86 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:34.393086 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c6b6fc-b060-4b57-b43d-8676fff43328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:34.393793 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6b6fc-b060-4b57-b43d-8676fff43328 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:34.394078 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6b6fc-b060-4b57-b43d-8676fff43328 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:34.394357 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6b6fc-b060-4b57-b43d-8676fff43328 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:34.395145 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c6b6fc-b060-4b57-b43d-8676fff43328 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:46:34.395453 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c6b6fc-b060-4b57-b43d-8676fff43328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:34.397158 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c6b6fc-b060-4b57-b43d-8676fff43328 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:34.419305 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 40/80] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Dec 24 04:46:34 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:34.426189 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf547c-6428-4317-a87b-0e39727c1541 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:34.443557 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf547c-6428-4317-a87b-0e39727c1541 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:34.448701 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cac346-cdb5-48fa-b84f-093dd834b00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:34.449903 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cac346-cdb5-48fa-b84f-093dd834b00b admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:34.450360 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cac346-cdb5-48fa-b84f-093dd834b00b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:34.450786 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cac346-cdb5-48fa-b84f-093dd834b00b admin admin] PATH_INFO: `/v3/users/672e494a2e37401c8e61391c2d6883b7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:34.452737 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cac346-cdb5-48fa-b84f-093dd834b00b admin admin] RBAC: Authorizing `identity:get_user(user_id=672e494a2e37401c8e61391c2d6883b7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:34.460569 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cac346-cdb5-48fa-b84f-093dd834b00b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:34.464287 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 41/81] 10.222.0.43 () {56 vars in 1198 bytes} [Fri Dec 24 04:46:34 2021] GET /identity/v3/users/672e494a2e37401c8e61391c2d6883b7 => generated 275 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:34.472728 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c6b6fc-b060-4b57-b43d-8676fff43328 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:34.491368 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c6b6fc-b060-4b57-b43d-8676fff43328 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:34.501095 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3a8b7-b1d1-4414-ba57-91d3b2ab211c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:34.501773 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3a8b7-b1d1-4414-ba57-91d3b2ab211c admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:34.502054 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3a8b7-b1d1-4414-ba57-91d3b2ab211c admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:34.502330 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3a8b7-b1d1-4414-ba57-91d3b2ab211c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:34.519281 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc3a8b7-b1d1-4414-ba57-91d3b2ab211c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:34.520673 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a8628d-bf0b-43b6-ab78-3bc9e5632046 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:34.521167 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a8628d-bf0b-43b6-ab78-3bc9e5632046 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:34.521293 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc3a8b7-b1d1-4414-ba57-91d3b2ab211c admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:34.521759 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a8628d-bf0b-43b6-ab78-3bc9e5632046 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:34.523760 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 42/82] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:46:34 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 24 04:46:34.530496 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0be38-b3d5-4f96-b258-aad521953e6e None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:34.530834 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0be38-b3d5-4f96-b258-aad521953e6e None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:34.531074 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0be38-b3d5-4f96-b258-aad521953e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:34.532877 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 41/83] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:46:34 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 24 04:46:34.534247 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234222c6-3d33-4665-9544-4459ccebd51e None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:34.534538 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234222c6-3d33-4665-9544-4459ccebd51e None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:34.534814 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234222c6-3d33-4665-9544-4459ccebd51e None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:34.536807 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 42/84] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:46:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:46:34.539723 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234222c6-3d33-4665-9544-4459ccebd51e None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:34.560556 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234222c6-3d33-4665-9544-4459ccebd51e None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:34.562042 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-7cb0be38-b3d5-4f96-b258-aad521953e6e None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:46:34.562539 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf1af0e-eda5-4e95-904d-4447d658060f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:34.563336 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-7cb0be38-b3d5-4f96-b258-aad521953e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:46:34.563445 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf1af0e-eda5-4e95-904d-4447d658060f admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:34.563697 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf1af0e-eda5-4e95-904d-4447d658060f admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:34.563974 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf1af0e-eda5-4e95-904d-4447d658060f admin admin] PATH_INFO: `/v3/projects/036a37ec848b4c9bb369e71b5c2453c7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:34.565519 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf1af0e-eda5-4e95-904d-4447d658060f admin admin] RBAC: Authorizing `identity:get_project(project_id=036a37ec848b4c9bb369e71b5c2453c7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:34.568859 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf1af0e-eda5-4e95-904d-4447d658060f admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:34.570775 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 43/85] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:46:34 2021] GET /identity/v3/projects/036a37ec848b4c9bb369e71b5c2453c7 => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:34.572090 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00b570-78cd-49c8-b727-4e14becd73f9 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:34.572370 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00b570-78cd-49c8-b727-4e14becd73f9 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:34.576802 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00b570-78cd-49c8-b727-4e14becd73f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:34.588586 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 43/86] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:46:34 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 24 04:46:34.588586 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb0be38-b3d5-4f96-b258-aad521953e6e None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:34.596851 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb0be38-b3d5-4f96-b258-aad521953e6e None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:34.601636 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a0159-148a-42f7-ad77-bc3c7d4e4710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:34.603056 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a0159-148a-42f7-ad77-bc3c7d4e4710 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:34.603391 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a0159-148a-42f7-ad77-bc3c7d4e4710 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:34.603669 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a0159-148a-42f7-ad77-bc3c7d4e4710 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:34.604805 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11a0159-148a-42f7-ad77-bc3c7d4e4710 admin admin] RBAC: Adding query filter params (role.id=62790996bc274dda9199846ea736d771, scope.project.id=036a37ec848b4c9bb369e71b5c2453c7, user.id=672e494a2e37401c8e61391c2d6883b7) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:46:34.605125 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11a0159-148a-42f7-ad77-bc3c7d4e4710 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:34.607299 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11a0159-148a-42f7-ad77-bc3c7d4e4710 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:34.612835 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-6e00b570-78cd-49c8-b727-4e14becd73f9 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:46:34.614055 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-6e00b570-78cd-49c8-b727-4e14becd73f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:46:34.614167 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 44/87] 10.222.0.43 () {56 vars in 1395 bytes} [Fri Dec 24 04:46:34 2021] GET /identity/v3/role_assignments?user.id=672e494a2e37401c8e61391c2d6883b7&scope.project.id=036a37ec848b4c9bb369e71b5c2453c7&role.id=62790996bc274dda9199846ea736d771 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:34.630386 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 44/88] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:46:34 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:46:34.638363 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a0159-148a-42f7-ad77-bc3c7d4e4710 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:34.650422 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a0159-148a-42f7-ad77-bc3c7d4e4710 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:34.655695 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885aacbe-2467-4cb9-91b8-a7e20cbefa57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:34.656549 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885aacbe-2467-4cb9-91b8-a7e20cbefa57 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:34.656842 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885aacbe-2467-4cb9-91b8-a7e20cbefa57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:34.657165 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885aacbe-2467-4cb9-91b8-a7e20cbefa57 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:34.658465 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885aacbe-2467-4cb9-91b8-a7e20cbefa57 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:34.660309 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885aacbe-2467-4cb9-91b8-a7e20cbefa57 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:34.662353 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 45/89] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:46:34 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:34.665425 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00b570-78cd-49c8-b727-4e14becd73f9 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:34.667942 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885aacbe-2467-4cb9-91b8-a7e20cbefa57 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:34.680514 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00b570-78cd-49c8-b727-4e14becd73f9 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:34.683576 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885aacbe-2467-4cb9-91b8-a7e20cbefa57 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:34.691698 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4eefce-7add-457a-bb98-a994ade52f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:34.692829 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b42a626-848c-43d7-8a59-b20eb8e6afff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:34.694055 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42a626-848c-43d7-8a59-b20eb8e6afff admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:34.694775 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4eefce-7add-457a-bb98-a994ade52f84 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:34.695198 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4eefce-7add-457a-bb98-a994ade52f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:34.695630 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42a626-848c-43d7-8a59-b20eb8e6afff admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:34.696054 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4eefce-7add-457a-bb98-a994ade52f84 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:34.696464 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42a626-848c-43d7-8a59-b20eb8e6afff admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:34.698365 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b42a626-848c-43d7-8a59-b20eb8e6afff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:34.700501 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING py.warnings [None req-4b42a626-848c-43d7-8a59-b20eb8e6afff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:46:34.700501 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: warnings.warn(msg) Dec 24 04:46:34.700501 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: Dec 24 04:46:34.703299 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b42a626-848c-43d7-8a59-b20eb8e6afff admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:34.722861 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4eefce-7add-457a-bb98-a994ade52f84 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:46:34.730103 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-0f4eefce-7add-457a-bb98-a994ade52f84 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 24 04:46:34.731629 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 45/90] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:46:34 2021] GET /identity/v3/roles/member => generated 84 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:46:34.740940 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4eefce-7add-457a-bb98-a994ade52f84 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:34.755538 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 46/91] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Dec 24 04:46:34 2021] POST /identity/v3/users => generated 289 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 04:46:34.767405 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4eefce-7add-457a-bb98-a994ade52f84 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:34.779026 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47da212-85dc-4446-b94e-864e95ed629f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:34.779810 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47da212-85dc-4446-b94e-864e95ed629f admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:34.780088 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47da212-85dc-4446-b94e-864e95ed629f admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:34.780373 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47da212-85dc-4446-b94e-864e95ed629f admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:34.781228 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47da212-85dc-4446-b94e-864e95ed629f admin admin] RBAC: Adding query filter params (name=member) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:46:34.781543 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47da212-85dc-4446-b94e-864e95ed629f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:34.783301 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47da212-85dc-4446-b94e-864e95ed629f admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:34.797405 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 46/92] 10.222.0.43 () {56 vars in 1122 bytes} [Fri Dec 24 04:46:34 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:34.804078 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b42a626-848c-43d7-8a59-b20eb8e6afff admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:34.818078 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b42a626-848c-43d7-8a59-b20eb8e6afff admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:34.827045 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b9af4b-6ad2-406d-a68a-d610970b59c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:34.827961 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9af4b-6ad2-406d-a68a-d610970b59c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:34.828248 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9af4b-6ad2-406d-a68a-d610970b59c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:34.828548 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9af4b-6ad2-406d-a68a-d610970b59c2 admin admin] PATH_INFO: `/v3/users/672e494a2e37401c8e61391c2d6883b7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:34.829981 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b9af4b-6ad2-406d-a68a-d610970b59c2 admin admin] RBAC: Authorizing `identity:get_user(user_id=672e494a2e37401c8e61391c2d6883b7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:34.832269 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b9af4b-6ad2-406d-a68a-d610970b59c2 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:34.834418 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 47/93] 10.222.0.43 () {56 vars in 1198 bytes} [Fri Dec 24 04:46:34 2021] GET /identity/v3/users/672e494a2e37401c8e61391c2d6883b7 => generated 275 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:34.840851 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47da212-85dc-4446-b94e-864e95ed629f admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:34.851450 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47da212-85dc-4446-b94e-864e95ed629f admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:34.856692 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8f4c09-4891-473f-b333-ede2de8d863f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:34.857370 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f4c09-4891-473f-b333-ede2de8d863f admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:34.857739 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f4c09-4891-473f-b333-ede2de8d863f admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:34.858085 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f4c09-4891-473f-b333-ede2de8d863f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:34.868245 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8f4c09-4891-473f-b333-ede2de8d863f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:34.870202 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8f4c09-4891-473f-b333-ede2de8d863f admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:34.880777 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 47/94] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:46:34 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 24 04:46:34.886597 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b9af4b-6ad2-406d-a68a-d610970b59c2 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:34.898163 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b9af4b-6ad2-406d-a68a-d610970b59c2 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:34.903015 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a711d-ddc4-4407-bc78-1bdcb58bda12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:34.903893 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a711d-ddc4-4407-bc78-1bdcb58bda12 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:34.904221 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a711d-ddc4-4407-bc78-1bdcb58bda12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:34.904695 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a711d-ddc4-4407-bc78-1bdcb58bda12 admin admin] PATH_INFO: `/v3/projects/e70525b628b747118f75fc8cb281118a` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:34.905951 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a711d-ddc4-4407-bc78-1bdcb58bda12 admin admin] RBAC: Authorizing `identity:get_project(project_id=e70525b628b747118f75fc8cb281118a)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:34.908049 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a711d-ddc4-4407-bc78-1bdcb58bda12 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:34.909970 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 48/95] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:46:34 2021] GET /identity/v3/projects/e70525b628b747118f75fc8cb281118a => generated 312 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:46:34.916951 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8f4c09-4891-473f-b333-ede2de8d863f admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:34.926554 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8f4c09-4891-473f-b333-ede2de8d863f admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:34.931739 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a9d84-5019-4f39-8bea-56473e143669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:34.932578 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a9d84-5019-4f39-8bea-56473e143669 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:34.932874 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a9d84-5019-4f39-8bea-56473e143669 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:34.933155 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a9d84-5019-4f39-8bea-56473e143669 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:34.934030 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5a9d84-5019-4f39-8bea-56473e143669 admin admin] RBAC: Adding query filter params (role.id=19e41972301c400193cf0c53e0462e49, scope.project.id=e70525b628b747118f75fc8cb281118a, user.id=672e494a2e37401c8e61391c2d6883b7) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:46:34.934344 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5a9d84-5019-4f39-8bea-56473e143669 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:34.936606 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5a9d84-5019-4f39-8bea-56473e143669 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:34.943841 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 48/96] 10.222.0.43 () {56 vars in 1395 bytes} [Fri Dec 24 04:46:34 2021] GET /identity/v3/role_assignments?user.id=672e494a2e37401c8e61391c2d6883b7&scope.project.id=e70525b628b747118f75fc8cb281118a&role.id=19e41972301c400193cf0c53e0462e49 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:37.351201 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8fa17b-354d-471a-90ae-8b639c00fab4 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:37.352174 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8fa17b-354d-471a-90ae-8b639c00fab4 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:37.352725 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8fa17b-354d-471a-90ae-8b639c00fab4 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:37.354776 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 49/97] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:46:37 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:46:37.361505 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd69c2-9d04-4ef8-8f93-942fd72ebb68 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:37.362390 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd69c2-9d04-4ef8-8f93-942fd72ebb68 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:37.362863 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd69c2-9d04-4ef8-8f93-942fd72ebb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:37.390005 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-7efd69c2-9d04-4ef8-8f93-942fd72ebb68 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:46:37.391548 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-7efd69c2-9d04-4ef8-8f93-942fd72ebb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:46:37.403746 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 49/98] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:46:37 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 24 04:46:37.410574 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2207403-a079-4bc8-8353-b7f594f03cf5 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:37.411124 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2207403-a079-4bc8-8353-b7f594f03cf5 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:37.411616 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2207403-a079-4bc8-8353-b7f594f03cf5 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:37.413673 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 50/99] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:46:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:46:37.419441 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4997d-03be-4931-8337-783c30dc49f3 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:37.420026 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4997d-03be-4931-8337-783c30dc49f3 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:37.420506 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4997d-03be-4931-8337-783c30dc49f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:37.440738 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2207403-a079-4bc8-8353-b7f594f03cf5 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:37.453560 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-56e4997d-03be-4931-8337-783c30dc49f3 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:46:37.455057 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-56e4997d-03be-4931-8337-783c30dc49f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:46:37.458204 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2207403-a079-4bc8-8353-b7f594f03cf5 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:37.466775 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 50/100] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:46:37 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:46:37.474597 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bfa6b6-0ab6-4c20-b07a-df99e0de2ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:37.475402 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bfa6b6-0ab6-4c20-b07a-df99e0de2ace admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:37.475683 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bfa6b6-0ab6-4c20-b07a-df99e0de2ace admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:37.475956 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bfa6b6-0ab6-4c20-b07a-df99e0de2ace admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:37.497704 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bfa6b6-0ab6-4c20-b07a-df99e0de2ace admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:46:37.501154 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4997d-03be-4931-8337-783c30dc49f3 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:37.504918 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-e0bfa6b6-0ab6-4c20-b07a-df99e0de2ace admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 24 04:46:37.511261 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 51/101] 10.222.0.43 () {56 vars in 1117 bytes} [Fri Dec 24 04:46:37 2021] GET /identity/v3/roles/admin => generated 83 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:46:37.512311 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bfa6b6-0ab6-4c20-b07a-df99e0de2ace admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:37.517040 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4997d-03be-4931-8337-783c30dc49f3 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:37.524771 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bfa6b6-0ab6-4c20-b07a-df99e0de2ace admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:37.533902 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83abc2fc-4bbc-444b-ab1c-9e80df592d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:37.534886 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83abc2fc-4bbc-444b-ab1c-9e80df592d36 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:37.535278 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83abc2fc-4bbc-444b-ab1c-9e80df592d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:37.535657 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83abc2fc-4bbc-444b-ab1c-9e80df592d36 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:37.541775 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb227a5e-02fc-4ec4-a6c5-d8fc62b05cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:37.542890 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb227a5e-02fc-4ec4-a6c5-d8fc62b05cff admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:37.543670 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb227a5e-02fc-4ec4-a6c5-d8fc62b05cff admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:37.544085 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb227a5e-02fc-4ec4-a6c5-d8fc62b05cff admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:37.545099 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb227a5e-02fc-4ec4-a6c5-d8fc62b05cff admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:46:37.545566 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb227a5e-02fc-4ec4-a6c5-d8fc62b05cff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:37.547497 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb227a5e-02fc-4ec4-a6c5-d8fc62b05cff admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:37.563375 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 52/102] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:46:37 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:37.566736 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83abc2fc-4bbc-444b-ab1c-9e80df592d36 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:46:37.570022 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb227a5e-02fc-4ec4-a6c5-d8fc62b05cff admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:37.574265 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-83abc2fc-4bbc-444b-ab1c-9e80df592d36 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 24 04:46:37.580312 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb227a5e-02fc-4ec4-a6c5-d8fc62b05cff admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:37.580980 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 51/103] 10.222.0.43 () {56 vars in 1135 bytes} [Fri Dec 24 04:46:37 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:46:37.587158 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83abc2fc-4bbc-444b-ab1c-9e80df592d36 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:37.591662 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe0a97-54cf-4bbb-993a-b4286779a2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:37.593331 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe0a97-54cf-4bbb-993a-b4286779a2b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:37.593805 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe0a97-54cf-4bbb-993a-b4286779a2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:37.594266 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe0a97-54cf-4bbb-993a-b4286779a2b7 admin admin] PATH_INFO: `/v3/users/d2031cc40bf6488b8dc6976b8c829c5e` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:37.597887 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe0a97-54cf-4bbb-993a-b4286779a2b7 admin admin] RBAC: Authorizing `identity:get_user(user_id=d2031cc40bf6488b8dc6976b8c829c5e)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:37.599947 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe0a97-54cf-4bbb-993a-b4286779a2b7 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:37.602811 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 53/104] 10.222.0.43 () {56 vars in 1198 bytes} [Fri Dec 24 04:46:37 2021] GET /identity/v3/users/d2031cc40bf6488b8dc6976b8c829c5e => generated 247 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:46:37.609636 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe0a97-54cf-4bbb-993a-b4286779a2b7 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:37.610378 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83abc2fc-4bbc-444b-ab1c-9e80df592d36 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:37.620286 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe0a97-54cf-4bbb-993a-b4286779a2b7 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:37.629502 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa7688-1fcd-48be-8fc9-d2ffa3ba945b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:37.630504 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa7688-1fcd-48be-8fc9-d2ffa3ba945b admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:37.630854 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa7688-1fcd-48be-8fc9-d2ffa3ba945b admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:37.631144 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa7688-1fcd-48be-8fc9-d2ffa3ba945b admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:37.631947 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa7688-1fcd-48be-8fc9-d2ffa3ba945b admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:46:37.632261 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa7688-1fcd-48be-8fc9-d2ffa3ba945b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:37.633968 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa7688-1fcd-48be-8fc9-d2ffa3ba945b admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:37.635946 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dda817-26ee-43e0-94db-6a8174677840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:37.637064 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dda817-26ee-43e0-94db-6a8174677840 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:37.637555 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dda817-26ee-43e0-94db-6a8174677840 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:37.638031 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dda817-26ee-43e0-94db-6a8174677840 admin admin] PATH_INFO: `/v3/projects/036a37ec848b4c9bb369e71b5c2453c7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:37.642515 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dda817-26ee-43e0-94db-6a8174677840 admin admin] RBAC: Authorizing `identity:get_project(project_id=036a37ec848b4c9bb369e71b5c2453c7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:37.644861 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dda817-26ee-43e0-94db-6a8174677840 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:37.647259 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 54/105] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:46:37 2021] GET /identity/v3/projects/036a37ec848b4c9bb369e71b5c2453c7 => generated 298 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:37.653323 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dda817-26ee-43e0-94db-6a8174677840 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:37.654857 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 52/106] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Dec 24 04:46:37 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:46:37.661494 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa7688-1fcd-48be-8fc9-d2ffa3ba945b admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:37.664102 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dda817-26ee-43e0-94db-6a8174677840 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:37.674233 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa7688-1fcd-48be-8fc9-d2ffa3ba945b admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:37.682098 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1518bd-6f7f-4daf-a8c7-05bd2c8809c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:37.683251 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1518bd-6f7f-4daf-a8c7-05bd2c8809c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:37.683745 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1518bd-6f7f-4daf-a8c7-05bd2c8809c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:37.684209 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1518bd-6f7f-4daf-a8c7-05bd2c8809c8 admin admin] PATH_INFO: `/v3/projects/036a37ec848b4c9bb369e71b5c2453c7/users/d2031cc40bf6488b8dc6976b8c829c5e/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:37.689342 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1518bd-6f7f-4daf-a8c7-05bd2c8809c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=036a37ec848b4c9bb369e71b5c2453c7, user_id=d2031cc40bf6488b8dc6976b8c829c5e, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:37.690624 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9095f3f-1382-4243-806d-dade6267467f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:37.691552 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9095f3f-1382-4243-806d-dade6267467f admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:37.691901 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9095f3f-1382-4243-806d-dade6267467f admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:37.692225 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9095f3f-1382-4243-806d-dade6267467f admin admin] PATH_INFO: `/v3/users/672e494a2e37401c8e61391c2d6883b7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:37.693169 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1518bd-6f7f-4daf-a8c7-05bd2c8809c8 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:37.697320 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9095f3f-1382-4243-806d-dade6267467f admin admin] RBAC: Authorizing `identity:get_user(user_id=672e494a2e37401c8e61391c2d6883b7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:37.700582 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9095f3f-1382-4243-806d-dade6267467f admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:37.701743 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 53/107] 10.222.0.43 () {56 vars in 1198 bytes} [Fri Dec 24 04:46:37 2021] GET /identity/v3/users/672e494a2e37401c8e61391c2d6883b7 => generated 275 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:46:37.707991 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9095f3f-1382-4243-806d-dade6267467f admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:37.717685 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 55/108] 10.222.0.43 () {58 vars in 1460 bytes} [Fri Dec 24 04:46:37 2021] PUT /identity/v3/projects/036a37ec848b4c9bb369e71b5c2453c7/users/d2031cc40bf6488b8dc6976b8c829c5e/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 04:46:37.720280 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9095f3f-1382-4243-806d-dade6267467f admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:37.769676 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459db619-ad1b-4fbe-81b2-414d55aa0a56 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:37.769979 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459db619-ad1b-4fbe-81b2-414d55aa0a56 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:37.770235 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459db619-ad1b-4fbe-81b2-414d55aa0a56 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:37.772444 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 56/109] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:46:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 24 04:46:37.778300 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311d075-d64c-4b89-8c4a-78deee6e9e9d None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:37.778582 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311d075-d64c-4b89-8c4a-78deee6e9e9d None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:37.778862 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311d075-d64c-4b89-8c4a-78deee6e9e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:37.812730 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec217f7-10f0-4da8-8e56-855d79b41dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:37.813682 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec217f7-10f0-4da8-8e56-855d79b41dda admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:37.813974 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec217f7-10f0-4da8-8e56-855d79b41dda admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:37.814256 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec217f7-10f0-4da8-8e56-855d79b41dda admin admin] PATH_INFO: `/v3/projects/036a37ec848b4c9bb369e71b5c2453c7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:37.817144 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec217f7-10f0-4da8-8e56-855d79b41dda admin admin] RBAC: Authorizing `identity:get_project(project_id=036a37ec848b4c9bb369e71b5c2453c7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:37.817624 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-8311d075-d64c-4b89-8c4a-78deee6e9e9d None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:46:37.818848 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-8311d075-d64c-4b89-8c4a-78deee6e9e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:46:37.819326 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec217f7-10f0-4da8-8e56-855d79b41dda admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:37.821258 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 54/110] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:46:37 2021] GET /identity/v3/projects/036a37ec848b4c9bb369e71b5c2453c7 => generated 298 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:46:37.827646 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec217f7-10f0-4da8-8e56-855d79b41dda admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:37.838523 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec217f7-10f0-4da8-8e56-855d79b41dda admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:37.846088 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 57/111] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:46:37 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:46:37.849147 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9e52f-d024-4fcf-a4e4-bfa4f2db50f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:37.850116 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9e52f-d024-4fcf-a4e4-bfa4f2db50f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:37.850408 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9e52f-d024-4fcf-a4e4-bfa4f2db50f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:37.850737 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9e52f-d024-4fcf-a4e4-bfa4f2db50f9 admin admin] PATH_INFO: `/v3/projects/036a37ec848b4c9bb369e71b5c2453c7/users/672e494a2e37401c8e61391c2d6883b7/roles/62790996bc274dda9199846ea736d771` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:37.854831 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e9e52f-d024-4fcf-a4e4-bfa4f2db50f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=036a37ec848b4c9bb369e71b5c2453c7, user_id=672e494a2e37401c8e61391c2d6883b7, role_id=62790996bc274dda9199846ea736d771)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:37.856017 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING py.warnings [None req-36e9e52f-d024-4fcf-a4e4-bfa4f2db50f9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:46:37.856017 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: warnings.warn(msg) Dec 24 04:46:37.856017 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: Dec 24 04:46:37.858645 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e9e52f-d024-4fcf-a4e4-bfa4f2db50f9 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:37.881818 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8311d075-d64c-4b89-8c4a-78deee6e9e9d None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:37.886664 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 55/112] 10.222.0.43 () {58 vars in 1460 bytes} [Fri Dec 24 04:46:37 2021] PUT /identity/v3/projects/036a37ec848b4c9bb369e71b5c2453c7/users/672e494a2e37401c8e61391c2d6883b7/roles/62790996bc274dda9199846ea736d771 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 04:46:37.888721 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7fdc4-4462-4e56-8377-ffddd6ca7400 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:37.889475 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7fdc4-4462-4e56-8377-ffddd6ca7400 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:37.890099 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7fdc4-4462-4e56-8377-ffddd6ca7400 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:37.893113 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 56/113] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:46:37 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:46:37.896621 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8311d075-d64c-4b89-8c4a-78deee6e9e9d None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:37.900721 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed1974-1e0d-4099-8ed1-8a0a2bb0ec3d None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:37.901327 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed1974-1e0d-4099-8ed1-8a0a2bb0ec3d None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:37.901800 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed1974-1e0d-4099-8ed1-8a0a2bb0ec3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:37.938745 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-50ed1974-1e0d-4099-8ed1-8a0a2bb0ec3d None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:46:37.940353 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-50ed1974-1e0d-4099-8ed1-8a0a2bb0ec3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:46:38.021677 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75f00c-1850-4ae9-98a9-d5a0b2d20473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:38.022505 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75f00c-1850-4ae9-98a9-d5a0b2d20473 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:38.022793 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75f00c-1850-4ae9-98a9-d5a0b2d20473 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:38.023067 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75f00c-1850-4ae9-98a9-d5a0b2d20473 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:38.043949 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc75f00c-1850-4ae9-98a9-d5a0b2d20473 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:46:38.051202 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-dc75f00c-1850-4ae9-98a9-d5a0b2d20473 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 24 04:46:38.052476 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 58/114] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:46:37 2021] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:46:38.062868 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 57/115] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:46:37 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 24 04:46:38.063706 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75f00c-1850-4ae9-98a9-d5a0b2d20473 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:38.078711 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75f00c-1850-4ae9-98a9-d5a0b2d20473 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:38.087519 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a76349a-2b2b-4b8d-a6ac-a685d6a73891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:38.088206 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76349a-2b2b-4b8d-a6ac-a685d6a73891 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:38.088489 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76349a-2b2b-4b8d-a6ac-a685d6a73891 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:38.088800 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76349a-2b2b-4b8d-a6ac-a685d6a73891 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:38.089576 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a76349a-2b2b-4b8d-a6ac-a685d6a73891 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:46:38.089884 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a76349a-2b2b-4b8d-a6ac-a685d6a73891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:38.091548 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a76349a-2b2b-4b8d-a6ac-a685d6a73891 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:38.106883 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 59/116] 10.222.0.43 () {56 vars in 1122 bytes} [Fri Dec 24 04:46:38 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:38.110925 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed1974-1e0d-4099-8ed1-8a0a2bb0ec3d None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:38.112941 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a76349a-2b2b-4b8d-a6ac-a685d6a73891 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:38.125792 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a76349a-2b2b-4b8d-a6ac-a685d6a73891 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:38.129055 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed1974-1e0d-4099-8ed1-8a0a2bb0ec3d None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:38.134554 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9c256-2561-4e3a-92b0-fabc3c86e349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:38.135450 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9c256-2561-4e3a-92b0-fabc3c86e349 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:38.135736 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9c256-2561-4e3a-92b0-fabc3c86e349 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:38.136010 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9c256-2561-4e3a-92b0-fabc3c86e349 admin admin] PATH_INFO: `/v3/users/672e494a2e37401c8e61391c2d6883b7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:38.137752 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e9c256-2561-4e3a-92b0-fabc3c86e349 admin admin] RBAC: Authorizing `identity:get_user(user_id=672e494a2e37401c8e61391c2d6883b7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:38.140021 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e9c256-2561-4e3a-92b0-fabc3c86e349 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:38.141907 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 60/117] 10.222.0.43 () {56 vars in 1198 bytes} [Fri Dec 24 04:46:38 2021] GET /identity/v3/users/672e494a2e37401c8e61391c2d6883b7 => generated 275 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:46:38.145099 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125adf1e-274c-499c-a8db-6775428d2195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:38.145919 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125adf1e-274c-499c-a8db-6775428d2195 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:38.146203 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125adf1e-274c-499c-a8db-6775428d2195 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:38.146479 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125adf1e-274c-499c-a8db-6775428d2195 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:38.153515 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9c256-2561-4e3a-92b0-fabc3c86e349 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:38.165302 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9c256-2561-4e3a-92b0-fabc3c86e349 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:38.167535 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125adf1e-274c-499c-a8db-6775428d2195 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:46:38.175061 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-125adf1e-274c-499c-a8db-6775428d2195 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 24 04:46:38.176499 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 58/118] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:46:38 2021] GET /identity/v3/roles/member => generated 84 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:46:38.178420 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25816bf-f7a8-4d53-b3ba-536e5e6325f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:38.179348 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25816bf-f7a8-4d53-b3ba-536e5e6325f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:38.179627 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25816bf-f7a8-4d53-b3ba-536e5e6325f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:38.179897 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25816bf-f7a8-4d53-b3ba-536e5e6325f2 admin admin] PATH_INFO: `/v3/projects/036a37ec848b4c9bb369e71b5c2453c7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:38.183278 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25816bf-f7a8-4d53-b3ba-536e5e6325f2 admin admin] RBAC: Authorizing `identity:get_project(project_id=036a37ec848b4c9bb369e71b5c2453c7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:38.183653 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125adf1e-274c-499c-a8db-6775428d2195 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:38.185557 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25816bf-f7a8-4d53-b3ba-536e5e6325f2 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:38.187413 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 61/119] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:46:38 2021] GET /identity/v3/projects/036a37ec848b4c9bb369e71b5c2453c7 => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:38.194375 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125adf1e-274c-499c-a8db-6775428d2195 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:38.195164 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25816bf-f7a8-4d53-b3ba-536e5e6325f2 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:38.199106 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c5ee8e-24ed-4381-ba2b-97cab8142704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:38.199826 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5ee8e-24ed-4381-ba2b-97cab8142704 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:38.200113 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5ee8e-24ed-4381-ba2b-97cab8142704 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:38.200436 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5ee8e-24ed-4381-ba2b-97cab8142704 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:38.201481 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c5ee8e-24ed-4381-ba2b-97cab8142704 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:46:38.201795 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c5ee8e-24ed-4381-ba2b-97cab8142704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:38.203609 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c5ee8e-24ed-4381-ba2b-97cab8142704 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:38.213851 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 59/120] 10.222.0.43 () {56 vars in 1122 bytes} [Fri Dec 24 04:46:38 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:38.214844 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25816bf-f7a8-4d53-b3ba-536e5e6325f2 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:38.220660 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c5ee8e-24ed-4381-ba2b-97cab8142704 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:38.230144 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b2d347-2ec6-41c3-9bc5-d19cd584e6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:38.231046 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b2d347-2ec6-41c3-9bc5-d19cd584e6e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:38.231237 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c5ee8e-24ed-4381-ba2b-97cab8142704 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:38.231341 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b2d347-2ec6-41c3-9bc5-d19cd584e6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:38.231584 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b2d347-2ec6-41c3-9bc5-d19cd584e6e0 admin admin] PATH_INFO: `/v3/projects/036a37ec848b4c9bb369e71b5c2453c7/users/672e494a2e37401c8e61391c2d6883b7/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:38.235941 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac42531-a5fd-4c97-9565-9d3e3f50589c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:38.236924 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac42531-a5fd-4c97-9565-9d3e3f50589c admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:38.237352 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac42531-a5fd-4c97-9565-9d3e3f50589c admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:38.237671 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac42531-a5fd-4c97-9565-9d3e3f50589c admin admin] PATH_INFO: `/v3/users/672e494a2e37401c8e61391c2d6883b7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:38.237863 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b2d347-2ec6-41c3-9bc5-d19cd584e6e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=036a37ec848b4c9bb369e71b5c2453c7, user_id=672e494a2e37401c8e61391c2d6883b7, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:38.238984 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac42531-a5fd-4c97-9565-9d3e3f50589c admin admin] RBAC: Authorizing `identity:get_user(user_id=672e494a2e37401c8e61391c2d6883b7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:38.240569 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b2d347-2ec6-41c3-9bc5-d19cd584e6e0 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:38.241271 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac42531-a5fd-4c97-9565-9d3e3f50589c admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:38.243300 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 60/121] 10.222.0.43 () {56 vars in 1198 bytes} [Fri Dec 24 04:46:38 2021] GET /identity/v3/users/672e494a2e37401c8e61391c2d6883b7 => generated 275 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:38.250289 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac42531-a5fd-4c97-9565-9d3e3f50589c admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:38.263187 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 62/122] 10.222.0.43 () {58 vars in 1460 bytes} [Fri Dec 24 04:46:38 2021] PUT /identity/v3/projects/036a37ec848b4c9bb369e71b5c2453c7/users/672e494a2e37401c8e61391c2d6883b7/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:46:38.268197 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac42531-a5fd-4c97-9565-9d3e3f50589c admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:38.351687 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977aa10-c3aa-43fa-a6d1-947f21bb107d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:38.352568 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977aa10-c3aa-43fa-a6d1-947f21bb107d admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:38.352865 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977aa10-c3aa-43fa-a6d1-947f21bb107d admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:38.353146 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977aa10-c3aa-43fa-a6d1-947f21bb107d admin admin] PATH_INFO: `/v3/projects/e70525b628b747118f75fc8cb281118a` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:38.354400 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9977aa10-c3aa-43fa-a6d1-947f21bb107d admin admin] RBAC: Authorizing `identity:get_project(project_id=e70525b628b747118f75fc8cb281118a)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:38.356622 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9977aa10-c3aa-43fa-a6d1-947f21bb107d admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:38.358579 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 61/123] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:46:38 2021] GET /identity/v3/projects/e70525b628b747118f75fc8cb281118a => generated 312 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:38.365056 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b2d347-2ec6-41c3-9bc5-d19cd584e6e0 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:38.376176 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b2d347-2ec6-41c3-9bc5-d19cd584e6e0 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:38.380948 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ab6b9-6af5-4ea7-9f6f-b11be78fefb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:38.381912 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ab6b9-6af5-4ea7-9f6f-b11be78fefb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:38.382198 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ab6b9-6af5-4ea7-9f6f-b11be78fefb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:38.382524 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ab6b9-6af5-4ea7-9f6f-b11be78fefb7 admin admin] PATH_INFO: `/v3/projects/e70525b628b747118f75fc8cb281118a/users/672e494a2e37401c8e61391c2d6883b7/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:38.384682 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45ab6b9-6af5-4ea7-9f6f-b11be78fefb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e70525b628b747118f75fc8cb281118a, user_id=672e494a2e37401c8e61391c2d6883b7, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:38.387546 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45ab6b9-6af5-4ea7-9f6f-b11be78fefb7 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:38.409447 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 63/124] 10.222.0.43 () {58 vars in 1460 bytes} [Fri Dec 24 04:46:38 2021] PUT /identity/v3/projects/e70525b628b747118f75fc8cb281118a/users/672e494a2e37401c8e61391c2d6883b7/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:46:39.057989 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6eec1-b403-46cb-bc0c-f700726594b4 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:39.058539 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6eec1-b403-46cb-bc0c-f700726594b4 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:39.058539 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6eec1-b403-46cb-bc0c-f700726594b4 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:39.060708 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 62/125] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:46:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:46:39.069579 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da456073-38ca-4a20-8b24-a7156697772c None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:39.069872 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da456073-38ca-4a20-8b24-a7156697772c None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:39.070161 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da456073-38ca-4a20-8b24-a7156697772c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:39.088401 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-da456073-38ca-4a20-8b24-a7156697772c None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:46:39.089655 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-da456073-38ca-4a20-8b24-a7156697772c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:46:39.166051 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 64/126] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:46:39 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 24 04:46:39.197371 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6eec1-b403-46cb-bc0c-f700726594b4 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:39.214959 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6eec1-b403-46cb-bc0c-f700726594b4 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:39.220087 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3434b0cd-7a8e-4ea6-a08a-a11347c2ec61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:39.220929 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434b0cd-7a8e-4ea6-a08a-a11347c2ec61 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:39.221213 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434b0cd-7a8e-4ea6-a08a-a11347c2ec61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:39.221488 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434b0cd-7a8e-4ea6-a08a-a11347c2ec61 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:39.222746 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3434b0cd-7a8e-4ea6-a08a-a11347c2ec61 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:39.224537 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3434b0cd-7a8e-4ea6-a08a-a11347c2ec61 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:39.226451 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 63/127] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:46:39 2021] GET /identity/v3/domains/default => generated 199 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:39.232394 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da456073-38ca-4a20-8b24-a7156697772c None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:39.242212 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da456073-38ca-4a20-8b24-a7156697772c None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:39.247591 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be55f06-0c71-45cd-8e1e-33974c7ed491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:39.248321 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be55f06-0c71-45cd-8e1e-33974c7ed491 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:39.248686 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be55f06-0c71-45cd-8e1e-33974c7ed491 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:39.248967 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be55f06-0c71-45cd-8e1e-33974c7ed491 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:39.249777 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be55f06-0c71-45cd-8e1e-33974c7ed491 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:39.250808 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING py.warnings [None req-5be55f06-0c71-45cd-8e1e-33974c7ed491 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:46:39.250808 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: warnings.warn(msg) Dec 24 04:46:39.250808 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: Dec 24 04:46:39.252084 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be55f06-0c71-45cd-8e1e-33974c7ed491 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:39.264563 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a57593-8da0-4976-8ad4-9c35adfd914b None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:39.264908 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a57593-8da0-4976-8ad4-9c35adfd914b None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:39.265241 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a57593-8da0-4976-8ad4-9c35adfd914b None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:39.267297 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 64/128] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:46:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:46:39.272869 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e247e70-165c-4695-bb6d-4582b1447ad9 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:39.273184 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e247e70-165c-4695-bb6d-4582b1447ad9 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:39.273431 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e247e70-165c-4695-bb6d-4582b1447ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:39.297783 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-8e247e70-165c-4695-bb6d-4582b1447ad9 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:46:39.299064 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-8e247e70-165c-4695-bb6d-4582b1447ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:46:39.316920 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 65/129] 10.222.0.43 () {60 vars in 1162 bytes} [Fri Dec 24 04:46:39 2021] POST /identity/v3/projects => generated 302 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 04:46:39.317255 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 65/130] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:46:39 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 24 04:46:39.373286 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be55f06-0c71-45cd-8e1e-33974c7ed491 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:39.444256 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be55f06-0c71-45cd-8e1e-33974c7ed491 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:39.448827 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58eb396-f1b6-42cc-a12a-eeb11be16039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:39.449650 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58eb396-f1b6-42cc-a12a-eeb11be16039 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:39.449935 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58eb396-f1b6-42cc-a12a-eeb11be16039 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:39.450214 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58eb396-f1b6-42cc-a12a-eeb11be16039 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:39.462279 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58eb396-f1b6-42cc-a12a-eeb11be16039 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:46:39.469549 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-e58eb396-f1b6-42cc-a12a-eeb11be16039 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 24 04:46:39.471141 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 66/131] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:46:39 2021] GET /identity/v3/roles/reader => generated 84 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:46:39.477266 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e247e70-165c-4695-bb6d-4582b1447ad9 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:39.491298 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e247e70-165c-4695-bb6d-4582b1447ad9 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:39.496103 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b629183-8efd-4f2f-8bc0-1dd8eee45305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:39.496942 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b629183-8efd-4f2f-8bc0-1dd8eee45305 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:39.497234 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b629183-8efd-4f2f-8bc0-1dd8eee45305 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:39.497518 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b629183-8efd-4f2f-8bc0-1dd8eee45305 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:39.498371 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b629183-8efd-4f2f-8bc0-1dd8eee45305 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:46:39.498682 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b629183-8efd-4f2f-8bc0-1dd8eee45305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:39.500387 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b629183-8efd-4f2f-8bc0-1dd8eee45305 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:39.512506 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 66/132] 10.222.0.43 () {56 vars in 1122 bytes} [Fri Dec 24 04:46:39 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:46:39.519361 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58eb396-f1b6-42cc-a12a-eeb11be16039 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:39.532086 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58eb396-f1b6-42cc-a12a-eeb11be16039 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:39.539874 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8d4435-68b5-4eb8-be6a-f542dc2bc19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:39.540878 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d4435-68b5-4eb8-be6a-f542dc2bc19c admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:39.541172 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d4435-68b5-4eb8-be6a-f542dc2bc19c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:39.541442 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d4435-68b5-4eb8-be6a-f542dc2bc19c admin admin] PATH_INFO: `/v3/users/90929fc2096d48ce97fe87abfffafffa` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:39.558491 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8d4435-68b5-4eb8-be6a-f542dc2bc19c admin admin] RBAC: Authorizing `identity:get_user(user_id=90929fc2096d48ce97fe87abfffafffa)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:39.560846 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8d4435-68b5-4eb8-be6a-f542dc2bc19c admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:39.563115 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 67/133] 10.222.0.43 () {56 vars in 1198 bytes} [Fri Dec 24 04:46:39 2021] GET /identity/v3/users/90929fc2096d48ce97fe87abfffafffa => generated 289 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:39.568958 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b629183-8efd-4f2f-8bc0-1dd8eee45305 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:39.579538 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b629183-8efd-4f2f-8bc0-1dd8eee45305 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:39.584401 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aba69d-140a-4587-bc47-f6671694c8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:39.585090 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aba69d-140a-4587-bc47-f6671694c8a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:39.585421 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aba69d-140a-4587-bc47-f6671694c8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:39.585748 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aba69d-140a-4587-bc47-f6671694c8a0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:39.599130 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aba69d-140a-4587-bc47-f6671694c8a0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:39.601152 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aba69d-140a-4587-bc47-f6671694c8a0 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:39.615127 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 67/134] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:46:39 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 24 04:46:39.621415 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8d4435-68b5-4eb8-be6a-f542dc2bc19c admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:39.632807 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8d4435-68b5-4eb8-be6a-f542dc2bc19c admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:39.639150 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec286da7-a5d5-43a8-bae3-e7dee98de473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:39.640091 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec286da7-a5d5-43a8-bae3-e7dee98de473 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:39.640382 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec286da7-a5d5-43a8-bae3-e7dee98de473 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:39.640760 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec286da7-a5d5-43a8-bae3-e7dee98de473 admin admin] PATH_INFO: `/v3/projects/036a37ec848b4c9bb369e71b5c2453c7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:39.642080 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec286da7-a5d5-43a8-bae3-e7dee98de473 admin admin] RBAC: Authorizing `identity:get_project(project_id=036a37ec848b4c9bb369e71b5c2453c7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:39.644258 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec286da7-a5d5-43a8-bae3-e7dee98de473 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:39.646538 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 68/135] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:46:39 2021] GET /identity/v3/projects/036a37ec848b4c9bb369e71b5c2453c7 => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:39.653267 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aba69d-140a-4587-bc47-f6671694c8a0 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:39.662838 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aba69d-140a-4587-bc47-f6671694c8a0 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:39.667483 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d6850-a142-4f68-b83c-d8e4a23ded4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:39.668139 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d6850-a142-4f68-b83c-d8e4a23ded4c admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:39.668478 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d6850-a142-4f68-b83c-d8e4a23ded4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:39.668789 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d6850-a142-4f68-b83c-d8e4a23ded4c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:39.669746 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404d6850-a142-4f68-b83c-d8e4a23ded4c admin admin] RBAC: Adding query filter params (role.id=96d2300cdfbe46debbcc0eaab781246d, scope.project.id=036a37ec848b4c9bb369e71b5c2453c7, user.id=90929fc2096d48ce97fe87abfffafffa) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:46:39.670345 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404d6850-a142-4f68-b83c-d8e4a23ded4c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:39.672494 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404d6850-a142-4f68-b83c-d8e4a23ded4c admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:39.678474 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 68/136] 10.222.0.43 () {56 vars in 1395 bytes} [Fri Dec 24 04:46:39 2021] GET /identity/v3/role_assignments?user.id=90929fc2096d48ce97fe87abfffafffa&scope.project.id=036a37ec848b4c9bb369e71b5c2453c7&role.id=96d2300cdfbe46debbcc0eaab781246d => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:41.092611 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b65ba8-a170-4500-ae18-9d7b72ee474b None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:41.093636 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b65ba8-a170-4500-ae18-9d7b72ee474b None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:41.094124 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b65ba8-a170-4500-ae18-9d7b72ee474b None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:41.096612 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 69/137] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:46:41 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:46:41.103303 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2ef5b-82ec-4c8d-b6d3-5d18eb98df44 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:41.104284 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2ef5b-82ec-4c8d-b6d3-5d18eb98df44 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:41.104795 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2ef5b-82ec-4c8d-b6d3-5d18eb98df44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:41.129458 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-c1a2ef5b-82ec-4c8d-b6d3-5d18eb98df44 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:46:41.131141 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-c1a2ef5b-82ec-4c8d-b6d3-5d18eb98df44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:46:41.143775 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 69/138] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:46:41 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:46:41.177640 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b65ba8-a170-4500-ae18-9d7b72ee474b None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:41.194455 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b65ba8-a170-4500-ae18-9d7b72ee474b None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:41.199211 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f07b879-568f-4b08-97f8-96c749903527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:41.200276 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07b879-568f-4b08-97f8-96c749903527 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:41.200781 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07b879-568f-4b08-97f8-96c749903527 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:41.201405 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07b879-568f-4b08-97f8-96c749903527 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:41.215651 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f07b879-568f-4b08-97f8-96c749903527 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:46:41.227279 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-5f07b879-568f-4b08-97f8-96c749903527 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 24 04:46:41.228722 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 70/139] 10.222.0.43 () {56 vars in 1117 bytes} [Fri Dec 24 04:46:41 2021] GET /identity/v3/roles/admin => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:46:41.235033 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2ef5b-82ec-4c8d-b6d3-5d18eb98df44 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:41.249546 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2ef5b-82ec-4c8d-b6d3-5d18eb98df44 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:41.260102 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b704b-8276-4d9b-b740-b02f23d06e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:41.261052 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b704b-8276-4d9b-b740-b02f23d06e8b admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:41.261568 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b704b-8276-4d9b-b740-b02f23d06e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:41.262052 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b704b-8276-4d9b-b740-b02f23d06e8b admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:41.263033 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b704b-8276-4d9b-b740-b02f23d06e8b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:46:41.263563 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b704b-8276-4d9b-b740-b02f23d06e8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:41.265576 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b704b-8276-4d9b-b740-b02f23d06e8b admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:41.274935 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 70/140] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:46:41 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:41.282954 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f07b879-568f-4b08-97f8-96c749903527 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:41.298023 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f07b879-568f-4b08-97f8-96c749903527 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:41.308606 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ee79e-8fae-496b-a59b-1626f8417567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:41.309497 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ee79e-8fae-496b-a59b-1626f8417567 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:41.309784 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ee79e-8fae-496b-a59b-1626f8417567 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:41.310063 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ee79e-8fae-496b-a59b-1626f8417567 admin admin] PATH_INFO: `/v3/users/d2031cc40bf6488b8dc6976b8c829c5e` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:41.317363 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3ee79e-8fae-496b-a59b-1626f8417567 admin admin] RBAC: Authorizing `identity:get_user(user_id=d2031cc40bf6488b8dc6976b8c829c5e)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:41.319251 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3ee79e-8fae-496b-a59b-1626f8417567 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:41.321140 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 71/141] 10.222.0.43 () {56 vars in 1198 bytes} [Fri Dec 24 04:46:41 2021] GET /identity/v3/users/d2031cc40bf6488b8dc6976b8c829c5e => generated 247 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:46:41.327167 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b704b-8276-4d9b-b740-b02f23d06e8b admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:41.339652 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b704b-8276-4d9b-b740-b02f23d06e8b admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:41.348280 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc787b82-6717-48c1-a9ae-7d8e9f14f691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:41.349248 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc787b82-6717-48c1-a9ae-7d8e9f14f691 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:41.349733 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc787b82-6717-48c1-a9ae-7d8e9f14f691 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:41.350205 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc787b82-6717-48c1-a9ae-7d8e9f14f691 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:41.359063 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc787b82-6717-48c1-a9ae-7d8e9f14f691 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:41.361151 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc787b82-6717-48c1-a9ae-7d8e9f14f691 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:41.374243 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 71/142] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:46:41 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 24 04:46:41.380255 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ee79e-8fae-496b-a59b-1626f8417567 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:41.394120 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ee79e-8fae-496b-a59b-1626f8417567 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:41.401029 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a4cd9-39f3-4e29-bee3-20a8d5379d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:41.401896 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a4cd9-39f3-4e29-bee3-20a8d5379d4a admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:41.402184 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a4cd9-39f3-4e29-bee3-20a8d5379d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:41.402458 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a4cd9-39f3-4e29-bee3-20a8d5379d4a admin admin] PATH_INFO: `/v3/projects/036a37ec848b4c9bb369e71b5c2453c7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:41.409335 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6a4cd9-39f3-4e29-bee3-20a8d5379d4a admin admin] RBAC: Authorizing `identity:get_project(project_id=036a37ec848b4c9bb369e71b5c2453c7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:41.411464 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6a4cd9-39f3-4e29-bee3-20a8d5379d4a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:41.413227 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 72/143] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:46:41 2021] GET /identity/v3/projects/036a37ec848b4c9bb369e71b5c2453c7 => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:41.419680 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc787b82-6717-48c1-a9ae-7d8e9f14f691 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:41.433197 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc787b82-6717-48c1-a9ae-7d8e9f14f691 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:41.439046 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f332b-880d-4303-b3a6-fa5ec6d2e777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:41.440000 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f332b-880d-4303-b3a6-fa5ec6d2e777 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:41.440547 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f332b-880d-4303-b3a6-fa5ec6d2e777 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:41.441023 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f332b-880d-4303-b3a6-fa5ec6d2e777 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:41.442134 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f332b-880d-4303-b3a6-fa5ec6d2e777 admin admin] RBAC: Adding query filter params (role.id=d5e6fc257d8541d5a5ed1988eacd5be7, scope.project.id=036a37ec848b4c9bb369e71b5c2453c7, user.id=d2031cc40bf6488b8dc6976b8c829c5e) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:46:41.442660 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f332b-880d-4303-b3a6-fa5ec6d2e777 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:41.444918 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f332b-880d-4303-b3a6-fa5ec6d2e777 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:41.455630 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 72/144] 10.222.0.43 () {56 vars in 1395 bytes} [Fri Dec 24 04:46:41 2021] GET /identity/v3/role_assignments?user.id=d2031cc40bf6488b8dc6976b8c829c5e&scope.project.id=036a37ec848b4c9bb369e71b5c2453c7&role.id=d5e6fc257d8541d5a5ed1988eacd5be7 => generated 608 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:41.688799 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21319876-b7b0-482a-b9d8-b3ae9175f7e3 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:41.689457 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21319876-b7b0-482a-b9d8-b3ae9175f7e3 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:41.689943 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21319876-b7b0-482a-b9d8-b3ae9175f7e3 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:41.692263 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 73/145] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:46:41 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:46:41.707250 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23116a26-a1ca-4ee7-b4d4-7472968d890d None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:41.707547 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23116a26-a1ca-4ee7-b4d4-7472968d890d None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:41.707819 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23116a26-a1ca-4ee7-b4d4-7472968d890d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:41.729733 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-23116a26-a1ca-4ee7-b4d4-7472968d890d None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:46:41.731519 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-23116a26-a1ca-4ee7-b4d4-7472968d890d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:46:41.744420 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 73/146] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:46:41 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 24 04:46:41.783836 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21319876-b7b0-482a-b9d8-b3ae9175f7e3 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:41.798990 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21319876-b7b0-482a-b9d8-b3ae9175f7e3 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:41.808909 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939d5dc-d6ed-452b-839c-bb22b9b75509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:41.810131 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939d5dc-d6ed-452b-839c-bb22b9b75509 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:41.810718 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939d5dc-d6ed-452b-839c-bb22b9b75509 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:41.811420 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939d5dc-d6ed-452b-839c-bb22b9b75509 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:41.831781 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e939d5dc-d6ed-452b-839c-bb22b9b75509 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:46:41.839806 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-e939d5dc-d6ed-452b-839c-bb22b9b75509 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 24 04:46:41.841306 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 74/147] 10.222.0.43 () {56 vars in 1135 bytes} [Fri Dec 24 04:46:41 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:46:41.847910 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23116a26-a1ca-4ee7-b4d4-7472968d890d None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:41.861784 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23116a26-a1ca-4ee7-b4d4-7472968d890d None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:41.868494 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00449dc6-1263-451c-8b6c-3a63c5c9821d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:41.869214 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00449dc6-1263-451c-8b6c-3a63c5c9821d admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:41.869506 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00449dc6-1263-451c-8b6c-3a63c5c9821d admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:41.869784 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00449dc6-1263-451c-8b6c-3a63c5c9821d admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:41.870581 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00449dc6-1263-451c-8b6c-3a63c5c9821d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:46:41.870893 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00449dc6-1263-451c-8b6c-3a63c5c9821d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:41.872710 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00449dc6-1263-451c-8b6c-3a63c5c9821d admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:41.889546 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 74/148] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Dec 24 04:46:41 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:41.895625 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939d5dc-d6ed-452b-839c-bb22b9b75509 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:41.910540 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939d5dc-d6ed-452b-839c-bb22b9b75509 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:41.916648 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2febb53-5369-49fe-9cde-95530f9be22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:41.917802 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2febb53-5369-49fe-9cde-95530f9be22d admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:41.918306 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2febb53-5369-49fe-9cde-95530f9be22d admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:41.918779 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2febb53-5369-49fe-9cde-95530f9be22d admin admin] PATH_INFO: `/v3/users/672e494a2e37401c8e61391c2d6883b7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:41.925294 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2febb53-5369-49fe-9cde-95530f9be22d admin admin] RBAC: Authorizing `identity:get_user(user_id=672e494a2e37401c8e61391c2d6883b7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:41.927737 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2febb53-5369-49fe-9cde-95530f9be22d admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:41.929647 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 75/149] 10.222.0.43 () {56 vars in 1198 bytes} [Fri Dec 24 04:46:41 2021] GET /identity/v3/users/672e494a2e37401c8e61391c2d6883b7 => generated 275 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:41.936554 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00449dc6-1263-451c-8b6c-3a63c5c9821d admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:41.949690 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00449dc6-1263-451c-8b6c-3a63c5c9821d admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:41.954635 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16968b2b-404c-4964-807b-ff0f0da123e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:41.955295 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16968b2b-404c-4964-807b-ff0f0da123e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:41.955580 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16968b2b-404c-4964-807b-ff0f0da123e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:41.955859 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16968b2b-404c-4964-807b-ff0f0da123e5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:41.968335 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16968b2b-404c-4964-807b-ff0f0da123e5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:41.970270 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16968b2b-404c-4964-807b-ff0f0da123e5 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:41.982529 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 75/150] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:46:41 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 24 04:46:41.988626 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2febb53-5369-49fe-9cde-95530f9be22d admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:42.001672 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2febb53-5369-49fe-9cde-95530f9be22d admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:42.011744 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e4f16-57e9-4b1f-9771-852094dcd955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:42.012896 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e4f16-57e9-4b1f-9771-852094dcd955 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:42.013380 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e4f16-57e9-4b1f-9771-852094dcd955 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:42.014237 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e4f16-57e9-4b1f-9771-852094dcd955 admin admin] PATH_INFO: `/v3/projects/036a37ec848b4c9bb369e71b5c2453c7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:42.021322 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7e4f16-57e9-4b1f-9771-852094dcd955 admin admin] RBAC: Authorizing `identity:get_project(project_id=036a37ec848b4c9bb369e71b5c2453c7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:42.023647 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7e4f16-57e9-4b1f-9771-852094dcd955 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:42.025617 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 76/151] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:46:41 2021] GET /identity/v3/projects/036a37ec848b4c9bb369e71b5c2453c7 => generated 298 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:42.032465 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16968b2b-404c-4964-807b-ff0f0da123e5 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:42.044702 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16968b2b-404c-4964-807b-ff0f0da123e5 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:42.046295 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd8b96-e940-4276-91d9-8440f453817b None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:42.046808 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd8b96-e940-4276-91d9-8440f453817b None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:42.047279 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd8b96-e940-4276-91d9-8440f453817b None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:42.049450 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 77/152] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:46:42 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 24 04:46:42.050490 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda1d8f-e662-40b5-a4e5-a7775e3d22ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:42.050684 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda1d8f-e662-40b5-a4e5-a7775e3d22ae admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:42.050883 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda1d8f-e662-40b5-a4e5-a7775e3d22ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:42.051202 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda1d8f-e662-40b5-a4e5-a7775e3d22ae admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:42.052072 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eda1d8f-e662-40b5-a4e5-a7775e3d22ae admin admin] RBAC: Adding query filter params (role.id=62790996bc274dda9199846ea736d771, scope.project.id=036a37ec848b4c9bb369e71b5c2453c7, user.id=672e494a2e37401c8e61391c2d6883b7) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:46:42.052428 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eda1d8f-e662-40b5-a4e5-a7775e3d22ae admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:42.054663 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eda1d8f-e662-40b5-a4e5-a7775e3d22ae admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:42.055463 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4accb-5531-4da2-9bd0-d4f941fa413e None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:42.055898 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4accb-5531-4da2-9bd0-d4f941fa413e None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:42.056316 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4accb-5531-4da2-9bd0-d4f941fa413e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:42.066508 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 76/153] 10.222.0.43 () {56 vars in 1395 bytes} [Fri Dec 24 04:46:42 2021] GET /identity/v3/role_assignments?user.id=672e494a2e37401c8e61391c2d6883b7&scope.project.id=036a37ec848b4c9bb369e71b5c2453c7&role.id=62790996bc274dda9199846ea736d771 => generated 608 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:42.087696 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-efa4accb-5531-4da2-9bd0-d4f941fa413e None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:46:42.089189 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-efa4accb-5531-4da2-9bd0-d4f941fa413e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:46:42.106988 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 78/154] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:46:42 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 24 04:46:42.144053 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda1d8f-e662-40b5-a4e5-a7775e3d22ae admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:42.154618 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda1d8f-e662-40b5-a4e5-a7775e3d22ae admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:42.164183 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f570ae-3e77-47bd-b133-6660de60a381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:42.165085 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f570ae-3e77-47bd-b133-6660de60a381 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:42.165390 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f570ae-3e77-47bd-b133-6660de60a381 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:42.165669 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f570ae-3e77-47bd-b133-6660de60a381 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:42.186701 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f570ae-3e77-47bd-b133-6660de60a381 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:46:42.193861 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-e3f570ae-3e77-47bd-b133-6660de60a381 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 24 04:46:42.200616 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 77/155] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:46:42 2021] GET /identity/v3/roles/member => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:46:42.202298 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa4accb-5531-4da2-9bd0-d4f941fa413e None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:42.218379 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa4accb-5531-4da2-9bd0-d4f941fa413e None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:42.231295 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229c1826-0dba-471c-af34-ea6fa10df675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:42.232459 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c1826-0dba-471c-af34-ea6fa10df675 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:42.233158 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c1826-0dba-471c-af34-ea6fa10df675 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:42.233767 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c1826-0dba-471c-af34-ea6fa10df675 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:42.234757 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229c1826-0dba-471c-af34-ea6fa10df675 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:46:42.235346 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229c1826-0dba-471c-af34-ea6fa10df675 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:42.237322 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229c1826-0dba-471c-af34-ea6fa10df675 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:42.255881 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 79/156] 10.222.0.43 () {56 vars in 1122 bytes} [Fri Dec 24 04:46:42 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:46:42.261895 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f570ae-3e77-47bd-b133-6660de60a381 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:42.273306 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f570ae-3e77-47bd-b133-6660de60a381 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:42.284995 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f0310-9329-4b96-b9e4-eb58dacb1681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:42.285892 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f0310-9329-4b96-b9e4-eb58dacb1681 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:42.286174 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f0310-9329-4b96-b9e4-eb58dacb1681 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:42.286447 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f0310-9329-4b96-b9e4-eb58dacb1681 admin admin] PATH_INFO: `/v3/users/672e494a2e37401c8e61391c2d6883b7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:42.293495 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f0310-9329-4b96-b9e4-eb58dacb1681 admin admin] RBAC: Authorizing `identity:get_user(user_id=672e494a2e37401c8e61391c2d6883b7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:42.295798 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f0310-9329-4b96-b9e4-eb58dacb1681 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:42.297598 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 78/157] 10.222.0.43 () {56 vars in 1198 bytes} [Fri Dec 24 04:46:42 2021] GET /identity/v3/users/672e494a2e37401c8e61391c2d6883b7 => generated 275 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:42.303903 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229c1826-0dba-471c-af34-ea6fa10df675 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:42.318802 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229c1826-0dba-471c-af34-ea6fa10df675 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:42.335593 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9729de-a7fe-41ae-8b39-f3957bb1ea01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:42.336658 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9729de-a7fe-41ae-8b39-f3957bb1ea01 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:42.337136 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9729de-a7fe-41ae-8b39-f3957bb1ea01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:42.337602 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9729de-a7fe-41ae-8b39-f3957bb1ea01 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:42.343222 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bec31d-88d1-48c1-b442-eed4eb336f15 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:42.343828 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bec31d-88d1-48c1-b442-eed4eb336f15 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:42.344288 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bec31d-88d1-48c1-b442-eed4eb336f15 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:42.346298 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 79/158] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:46:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 24 04:46:42.351173 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9729de-a7fe-41ae-8b39-f3957bb1ea01 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:42.353075 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a82e143-d45a-4a53-82f0-269cf3f472b2 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:42.353502 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9729de-a7fe-41ae-8b39-f3957bb1ea01 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:42.353668 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a82e143-d45a-4a53-82f0-269cf3f472b2 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:42.354068 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a82e143-d45a-4a53-82f0-269cf3f472b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:42.364070 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 80/159] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:46:42 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 24 04:46:42.369635 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9729de-a7fe-41ae-8b39-f3957bb1ea01 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:42.379290 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9729de-a7fe-41ae-8b39-f3957bb1ea01 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:42.383080 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-3a82e143-d45a-4a53-82f0-269cf3f472b2 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:46:42.384269 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-3a82e143-d45a-4a53-82f0-269cf3f472b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:46:42.387749 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec19299-bdde-43cd-97b6-64fe04c5cc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:42.388954 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec19299-bdde-43cd-97b6-64fe04c5cc65 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:42.389458 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec19299-bdde-43cd-97b6-64fe04c5cc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:42.389920 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec19299-bdde-43cd-97b6-64fe04c5cc65 admin admin] PATH_INFO: `/v3/projects/e70525b628b747118f75fc8cb281118a` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:42.392262 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec19299-bdde-43cd-97b6-64fe04c5cc65 admin admin] RBAC: Authorizing `identity:get_project(project_id=e70525b628b747118f75fc8cb281118a)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:42.393863 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 80/160] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:46:42 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:46:42.395009 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec19299-bdde-43cd-97b6-64fe04c5cc65 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:42.397425 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 81/161] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:46:42 2021] GET /identity/v3/projects/e70525b628b747118f75fc8cb281118a => generated 312 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:46:42.403110 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a82e143-d45a-4a53-82f0-269cf3f472b2 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:42.415370 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a82e143-d45a-4a53-82f0-269cf3f472b2 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:42.420714 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e9141-4464-4cb0-a756-2b7da3cafe80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:42.421867 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e9141-4464-4cb0-a756-2b7da3cafe80 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:42.422366 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e9141-4464-4cb0-a756-2b7da3cafe80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:42.422534 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec19299-bdde-43cd-97b6-64fe04c5cc65 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:42.423045 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e9141-4464-4cb0-a756-2b7da3cafe80 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:42.424221 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e9141-4464-4cb0-a756-2b7da3cafe80 admin admin] RBAC: Adding query filter params (role.id=19e41972301c400193cf0c53e0462e49, scope.project.id=e70525b628b747118f75fc8cb281118a, user.id=672e494a2e37401c8e61391c2d6883b7) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:46:42.424790 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e9141-4464-4cb0-a756-2b7da3cafe80 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:42.426959 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e9141-4464-4cb0-a756-2b7da3cafe80 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:42.432369 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec19299-bdde-43cd-97b6-64fe04c5cc65 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:42.435272 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 81/162] 10.222.0.43 () {56 vars in 1395 bytes} [Fri Dec 24 04:46:42 2021] GET /identity/v3/role_assignments?user.id=672e494a2e37401c8e61391c2d6883b7&scope.project.id=e70525b628b747118f75fc8cb281118a&role.id=19e41972301c400193cf0c53e0462e49 => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:46:42.442676 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48db8f8-ef3c-4c21-995b-e9879d5aa125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:42.443592 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48db8f8-ef3c-4c21-995b-e9879d5aa125 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:42.443874 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48db8f8-ef3c-4c21-995b-e9879d5aa125 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:42.444146 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48db8f8-ef3c-4c21-995b-e9879d5aa125 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:42.457291 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48db8f8-ef3c-4c21-995b-e9879d5aa125 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:46:42.465076 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-c48db8f8-ef3c-4c21-995b-e9879d5aa125 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 24 04:46:42.466399 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 82/163] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:46:42 2021] GET /identity/v3/roles/member => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:46:42.472952 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e9141-4464-4cb0-a756-2b7da3cafe80 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:42.483395 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e9141-4464-4cb0-a756-2b7da3cafe80 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:42.488194 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f13b8-0df1-4a3b-be89-e913fddd1790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:42.488977 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f13b8-0df1-4a3b-be89-e913fddd1790 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:42.489256 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f13b8-0df1-4a3b-be89-e913fddd1790 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:42.489529 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f13b8-0df1-4a3b-be89-e913fddd1790 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:42.490360 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f13b8-0df1-4a3b-be89-e913fddd1790 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:46:42.490759 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f13b8-0df1-4a3b-be89-e913fddd1790 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:42.492561 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f13b8-0df1-4a3b-be89-e913fddd1790 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:42.503886 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 82/164] 10.222.0.43 () {56 vars in 1122 bytes} [Fri Dec 24 04:46:42 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:42.510200 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48db8f8-ef3c-4c21-995b-e9879d5aa125 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:42.522374 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48db8f8-ef3c-4c21-995b-e9879d5aa125 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:42.527095 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ea813-cc4f-4090-a0f1-292a8b91c2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:42.528035 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ea813-cc4f-4090-a0f1-292a8b91c2cc admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:42.528349 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ea813-cc4f-4090-a0f1-292a8b91c2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:42.528661 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ea813-cc4f-4090-a0f1-292a8b91c2cc admin admin] PATH_INFO: `/v3/users/672e494a2e37401c8e61391c2d6883b7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:42.530043 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074ea813-cc4f-4090-a0f1-292a8b91c2cc admin admin] RBAC: Authorizing `identity:get_user(user_id=672e494a2e37401c8e61391c2d6883b7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:42.532517 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074ea813-cc4f-4090-a0f1-292a8b91c2cc admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:42.534638 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 83/165] 10.222.0.43 () {56 vars in 1198 bytes} [Fri Dec 24 04:46:42 2021] GET /identity/v3/users/672e494a2e37401c8e61391c2d6883b7 => generated 275 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:42.540907 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f13b8-0df1-4a3b-be89-e913fddd1790 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:42.551377 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f13b8-0df1-4a3b-be89-e913fddd1790 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:42.556070 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdfd929-d5ce-42b3-ba9a-ec4662b6ba90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:42.556756 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdfd929-d5ce-42b3-ba9a-ec4662b6ba90 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:42.557080 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdfd929-d5ce-42b3-ba9a-ec4662b6ba90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:42.557350 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdfd929-d5ce-42b3-ba9a-ec4662b6ba90 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:42.566898 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdfd929-d5ce-42b3-ba9a-ec4662b6ba90 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:42.572590 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdfd929-d5ce-42b3-ba9a-ec4662b6ba90 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:42.579435 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 83/166] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:46:42 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 24 04:46:42.586208 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ea813-cc4f-4090-a0f1-292a8b91c2cc admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:42.598743 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ea813-cc4f-4090-a0f1-292a8b91c2cc admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:42.603903 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79949974-38e9-4705-973e-6c630d259bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:42.605203 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79949974-38e9-4705-973e-6c630d259bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:42.605686 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79949974-38e9-4705-973e-6c630d259bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:42.606152 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79949974-38e9-4705-973e-6c630d259bb4 admin admin] PATH_INFO: `/v3/projects/036a37ec848b4c9bb369e71b5c2453c7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:42.609611 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79949974-38e9-4705-973e-6c630d259bb4 admin admin] RBAC: Authorizing `identity:get_project(project_id=036a37ec848b4c9bb369e71b5c2453c7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:42.614735 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79949974-38e9-4705-973e-6c630d259bb4 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:42.617822 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 84/167] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:46:42 2021] GET /identity/v3/projects/036a37ec848b4c9bb369e71b5c2453c7 => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:42.624304 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdfd929-d5ce-42b3-ba9a-ec4662b6ba90 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:42.634671 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdfd929-d5ce-42b3-ba9a-ec4662b6ba90 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:42.640127 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93582317-3eb6-4665-8c87-e04b62aa4e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:42.641134 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93582317-3eb6-4665-8c87-e04b62aa4e8c admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:42.641654 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93582317-3eb6-4665-8c87-e04b62aa4e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:42.642114 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93582317-3eb6-4665-8c87-e04b62aa4e8c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:42.643249 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93582317-3eb6-4665-8c87-e04b62aa4e8c admin admin] RBAC: Adding query filter params (role.id=19e41972301c400193cf0c53e0462e49, scope.project.id=036a37ec848b4c9bb369e71b5c2453c7, user.id=672e494a2e37401c8e61391c2d6883b7) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:46:42.643771 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93582317-3eb6-4665-8c87-e04b62aa4e8c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:42.645942 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93582317-3eb6-4665-8c87-e04b62aa4e8c admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:42.653267 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 84/168] 10.222.0.43 () {56 vars in 1395 bytes} [Fri Dec 24 04:46:42 2021] GET /identity/v3/role_assignments?user.id=672e494a2e37401c8e61391c2d6883b7&scope.project.id=036a37ec848b4c9bb369e71b5c2453c7&role.id=19e41972301c400193cf0c53e0462e49 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:46:43.011705 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25721760-833f-4c79-a70b-aaf1645c6468 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:43.011991 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25721760-833f-4c79-a70b-aaf1645c6468 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:43.012263 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25721760-833f-4c79-a70b-aaf1645c6468 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:43.014256 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 85/169] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:46:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:46:43.020084 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65cdc9c-9fd9-40d3-81c3-111389a35141 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:43.020369 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65cdc9c-9fd9-40d3-81c3-111389a35141 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:43.020674 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65cdc9c-9fd9-40d3-81c3-111389a35141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:43.038744 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-f65cdc9c-9fd9-40d3-81c3-111389a35141 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:46:43.039932 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-f65cdc9c-9fd9-40d3-81c3-111389a35141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:46:43.048288 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 85/170] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:46:43 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:46:43.071024 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25721760-833f-4c79-a70b-aaf1645c6468 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:43.084213 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25721760-833f-4c79-a70b-aaf1645c6468 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:43.088674 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1329257-7d6e-4e7e-a9b8-f06a233ef816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:43.089445 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1329257-7d6e-4e7e-a9b8-f06a233ef816 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:43.089723 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1329257-7d6e-4e7e-a9b8-f06a233ef816 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:43.089990 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1329257-7d6e-4e7e-a9b8-f06a233ef816 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:43.100025 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1329257-7d6e-4e7e-a9b8-f06a233ef816 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:46:43.106919 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-b1329257-7d6e-4e7e-a9b8-f06a233ef816 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 24 04:46:43.108271 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 86/171] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:46:43 2021] GET /identity/v3/roles/reader => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:46:43.114565 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65cdc9c-9fd9-40d3-81c3-111389a35141 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:43.124769 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65cdc9c-9fd9-40d3-81c3-111389a35141 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:43.130427 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8248c0a0-5612-41b5-95f9-3c7d8c845746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:43.131119 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248c0a0-5612-41b5-95f9-3c7d8c845746 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:43.131397 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248c0a0-5612-41b5-95f9-3c7d8c845746 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:43.131666 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248c0a0-5612-41b5-95f9-3c7d8c845746 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:43.132439 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8248c0a0-5612-41b5-95f9-3c7d8c845746 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:46:43.132772 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8248c0a0-5612-41b5-95f9-3c7d8c845746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:43.134432 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8248c0a0-5612-41b5-95f9-3c7d8c845746 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:43.143548 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 86/172] 10.222.0.43 () {56 vars in 1122 bytes} [Fri Dec 24 04:46:43 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:43.149664 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1329257-7d6e-4e7e-a9b8-f06a233ef816 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:43.160577 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1329257-7d6e-4e7e-a9b8-f06a233ef816 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:43.165555 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e6f83-be03-46c2-bc7d-4cc5a42b5dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:43.166422 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e6f83-be03-46c2-bc7d-4cc5a42b5dbc admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:43.166706 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e6f83-be03-46c2-bc7d-4cc5a42b5dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:43.166980 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e6f83-be03-46c2-bc7d-4cc5a42b5dbc admin admin] PATH_INFO: `/v3/users/90929fc2096d48ce97fe87abfffafffa` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:43.168294 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0e6f83-be03-46c2-bc7d-4cc5a42b5dbc admin admin] RBAC: Authorizing `identity:get_user(user_id=90929fc2096d48ce97fe87abfffafffa)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:43.170833 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0e6f83-be03-46c2-bc7d-4cc5a42b5dbc admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:43.172448 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 87/173] 10.222.0.43 () {56 vars in 1198 bytes} [Fri Dec 24 04:46:43 2021] GET /identity/v3/users/90929fc2096d48ce97fe87abfffafffa => generated 289 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:43.178649 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8248c0a0-5612-41b5-95f9-3c7d8c845746 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:43.190013 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8248c0a0-5612-41b5-95f9-3c7d8c845746 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:43.195358 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b3b10c-1018-457d-9442-dfa811ab2a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:43.196214 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b3b10c-1018-457d-9442-dfa811ab2a97 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:43.196495 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b3b10c-1018-457d-9442-dfa811ab2a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:43.196811 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b3b10c-1018-457d-9442-dfa811ab2a97 admin admin] PATH_INFO: `/v3/projects/036a37ec848b4c9bb369e71b5c2453c7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:43.198075 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b3b10c-1018-457d-9442-dfa811ab2a97 admin admin] RBAC: Authorizing `identity:get_project(project_id=036a37ec848b4c9bb369e71b5c2453c7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:43.200158 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b3b10c-1018-457d-9442-dfa811ab2a97 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:43.202004 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 87/174] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:46:43 2021] GET /identity/v3/projects/036a37ec848b4c9bb369e71b5c2453c7 => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:43.208221 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e6f83-be03-46c2-bc7d-4cc5a42b5dbc admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:43.219363 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e6f83-be03-46c2-bc7d-4cc5a42b5dbc admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:43.224199 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee776a85-021e-42df-b98c-fa7d71953f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:43.225098 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee776a85-021e-42df-b98c-fa7d71953f74 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:43.225380 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee776a85-021e-42df-b98c-fa7d71953f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:43.225654 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee776a85-021e-42df-b98c-fa7d71953f74 admin admin] PATH_INFO: `/v3/projects/036a37ec848b4c9bb369e71b5c2453c7/users/90929fc2096d48ce97fe87abfffafffa/roles/96d2300cdfbe46debbcc0eaab781246d` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:43.227672 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee776a85-021e-42df-b98c-fa7d71953f74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=036a37ec848b4c9bb369e71b5c2453c7, user_id=90929fc2096d48ce97fe87abfffafffa, role_id=96d2300cdfbe46debbcc0eaab781246d)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:43.230402 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee776a85-021e-42df-b98c-fa7d71953f74 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:43.236915 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820285f-7386-474c-913f-473f9582da2f None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:43.237233 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820285f-7386-474c-913f-473f9582da2f None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:43.237536 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820285f-7386-474c-913f-473f9582da2f None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:43.239573 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 88/175] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:46:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 24 04:46:43.244974 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ced053-1a57-4e42-835e-243f8821d573 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:43.245171 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 88/176] 10.222.0.43 () {58 vars in 1460 bytes} [Fri Dec 24 04:46:43 2021] PUT /identity/v3/projects/036a37ec848b4c9bb369e71b5c2453c7/users/90929fc2096d48ce97fe87abfffafffa/roles/96d2300cdfbe46debbcc0eaab781246d => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 04:46:43.245296 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ced053-1a57-4e42-835e-243f8821d573 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:43.245511 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ced053-1a57-4e42-835e-243f8821d573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:43.264929 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-25ced053-1a57-4e42-835e-243f8821d573 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:46:43.265648 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-25ced053-1a57-4e42-835e-243f8821d573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:46:43.331713 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 89/177] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:46:43 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 24 04:46:43.358389 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee776a85-021e-42df-b98c-fa7d71953f74 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:43.369289 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee776a85-021e-42df-b98c-fa7d71953f74 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:43.375112 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf1ebec-4a02-4be0-9afd-8229bfc9fe9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:43.375936 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1ebec-4a02-4be0-9afd-8229bfc9fe9a admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:43.376217 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1ebec-4a02-4be0-9afd-8229bfc9fe9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:43.376487 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1ebec-4a02-4be0-9afd-8229bfc9fe9a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:43.377870 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf1ebec-4a02-4be0-9afd-8229bfc9fe9a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:43.379607 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf1ebec-4a02-4be0-9afd-8229bfc9fe9a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:43.381293 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 89/178] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:46:43 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:43.387499 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ced053-1a57-4e42-835e-243f8821d573 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:43.397667 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ced053-1a57-4e42-835e-243f8821d573 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:43.402111 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6a941-ddf5-4774-bc09-330d14a77acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:43.402798 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6a941-ddf5-4774-bc09-330d14a77acc admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:43.403074 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6a941-ddf5-4774-bc09-330d14a77acc admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:43.403341 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6a941-ddf5-4774-bc09-330d14a77acc admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:43.404098 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d6a941-ddf5-4774-bc09-330d14a77acc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:43.406112 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d6a941-ddf5-4774-bc09-330d14a77acc admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:43.427593 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 90/179] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Dec 24 04:46:43 2021] POST /identity/v3/users => generated 283 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 04:46:45.602457 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010d00f-c2e5-451f-b4b0-eeb88e6c003c None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:45.602958 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010d00f-c2e5-451f-b4b0-eeb88e6c003c None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:45.602958 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010d00f-c2e5-451f-b4b0-eeb88e6c003c None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:45.604797 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 90/180] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:46:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:46:45.612254 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6672dd5-af24-4dab-b6a8-135c9d4f3ba5 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:45.613340 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6672dd5-af24-4dab-b6a8-135c9d4f3ba5 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:45.613833 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6672dd5-af24-4dab-b6a8-135c9d4f3ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:45.636577 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-c6672dd5-af24-4dab-b6a8-135c9d4f3ba5 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:46:45.636577 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-c6672dd5-af24-4dab-b6a8-135c9d4f3ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:46:45.644979 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 91/181] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:46:45 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:46:45.675165 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2010d00f-c2e5-451f-b4b0-eeb88e6c003c None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:45.689188 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2010d00f-c2e5-451f-b4b0-eeb88e6c003c None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:45.693899 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df25ad-4f05-4a46-ac93-8e05a1c65d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:45.694943 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df25ad-4f05-4a46-ac93-8e05a1c65d32 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:45.695441 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df25ad-4f05-4a46-ac93-8e05a1c65d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:45.695905 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df25ad-4f05-4a46-ac93-8e05a1c65d32 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:45.707447 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2df25ad-4f05-4a46-ac93-8e05a1c65d32 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:46:45.714959 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-e2df25ad-4f05-4a46-ac93-8e05a1c65d32 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 24 04:46:45.716689 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 91/182] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:46:45 2021] GET /identity/v3/roles/reader => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:46:45.723693 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6672dd5-af24-4dab-b6a8-135c9d4f3ba5 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:45.733194 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6672dd5-af24-4dab-b6a8-135c9d4f3ba5 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:45.737784 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f4123-a1e4-4a49-9adb-6c6ccd168952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:45.738459 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f4123-a1e4-4a49-9adb-6c6ccd168952 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:45.738740 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f4123-a1e4-4a49-9adb-6c6ccd168952 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:45.740756 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f4123-a1e4-4a49-9adb-6c6ccd168952 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:45.740756 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5f4123-a1e4-4a49-9adb-6c6ccd168952 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:46:45.740756 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5f4123-a1e4-4a49-9adb-6c6ccd168952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:45.742031 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5f4123-a1e4-4a49-9adb-6c6ccd168952 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:45.751889 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 92/183] 10.222.0.43 () {56 vars in 1122 bytes} [Fri Dec 24 04:46:45 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:45.758528 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df25ad-4f05-4a46-ac93-8e05a1c65d32 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:45.769519 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df25ad-4f05-4a46-ac93-8e05a1c65d32 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:45.773888 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63915969-d2de-4d11-8d68-08dcc2955630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:45.774754 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63915969-d2de-4d11-8d68-08dcc2955630 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:45.775033 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63915969-d2de-4d11-8d68-08dcc2955630 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:45.775305 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63915969-d2de-4d11-8d68-08dcc2955630 admin admin] PATH_INFO: `/v3/users/90929fc2096d48ce97fe87abfffafffa` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:45.776511 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63915969-d2de-4d11-8d68-08dcc2955630 admin admin] RBAC: Authorizing `identity:get_user(user_id=90929fc2096d48ce97fe87abfffafffa)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:45.778678 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63915969-d2de-4d11-8d68-08dcc2955630 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:45.780903 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 92/184] 10.222.0.43 () {56 vars in 1198 bytes} [Fri Dec 24 04:46:45 2021] GET /identity/v3/users/90929fc2096d48ce97fe87abfffafffa => generated 289 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:46:45.787042 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f4123-a1e4-4a49-9adb-6c6ccd168952 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:45.797025 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f4123-a1e4-4a49-9adb-6c6ccd168952 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:45.801592 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4258c3b7-e3b9-41f4-8cc2-e0bc1e7de560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:45.802453 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258c3b7-e3b9-41f4-8cc2-e0bc1e7de560 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:45.802923 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258c3b7-e3b9-41f4-8cc2-e0bc1e7de560 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:45.803383 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258c3b7-e3b9-41f4-8cc2-e0bc1e7de560 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:45.812085 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4258c3b7-e3b9-41f4-8cc2-e0bc1e7de560 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:45.814092 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4258c3b7-e3b9-41f4-8cc2-e0bc1e7de560 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:45.823285 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 93/185] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:46:45 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 24 04:46:45.830438 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63915969-d2de-4d11-8d68-08dcc2955630 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:45.841199 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63915969-d2de-4d11-8d68-08dcc2955630 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:45.846429 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb69cced-9ded-4d2e-84e4-e3e697d19767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:45.847287 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69cced-9ded-4d2e-84e4-e3e697d19767 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:45.847566 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69cced-9ded-4d2e-84e4-e3e697d19767 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:45.847839 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69cced-9ded-4d2e-84e4-e3e697d19767 admin admin] PATH_INFO: `/v3/projects/036a37ec848b4c9bb369e71b5c2453c7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:45.849083 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb69cced-9ded-4d2e-84e4-e3e697d19767 admin admin] RBAC: Authorizing `identity:get_project(project_id=036a37ec848b4c9bb369e71b5c2453c7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:45.851127 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb69cced-9ded-4d2e-84e4-e3e697d19767 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:45.852898 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 93/186] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:46:45 2021] GET /identity/v3/projects/036a37ec848b4c9bb369e71b5c2453c7 => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:45.859840 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4258c3b7-e3b9-41f4-8cc2-e0bc1e7de560 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:45.868862 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4258c3b7-e3b9-41f4-8cc2-e0bc1e7de560 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:45.873956 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccbd7ec-79ef-42b2-ad8d-d0f8647cd5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:45.874608 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbd7ec-79ef-42b2-ad8d-d0f8647cd5f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:45.874890 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbd7ec-79ef-42b2-ad8d-d0f8647cd5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:45.875163 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbd7ec-79ef-42b2-ad8d-d0f8647cd5f8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:45.876018 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccbd7ec-79ef-42b2-ad8d-d0f8647cd5f8 admin admin] RBAC: Adding query filter params (role.id=96d2300cdfbe46debbcc0eaab781246d, scope.project.id=036a37ec848b4c9bb369e71b5c2453c7, user.id=90929fc2096d48ce97fe87abfffafffa) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:46:45.876327 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccbd7ec-79ef-42b2-ad8d-d0f8647cd5f8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:45.878222 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccbd7ec-79ef-42b2-ad8d-d0f8647cd5f8 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:45.884185 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 94/187] 10.222.0.43 () {56 vars in 1395 bytes} [Fri Dec 24 04:46:45 2021] GET /identity/v3/role_assignments?user.id=90929fc2096d48ce97fe87abfffafffa&scope.project.id=036a37ec848b4c9bb369e71b5c2453c7&role.id=96d2300cdfbe46debbcc0eaab781246d => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:46:45.982288 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3913b9-a2c3-430c-99f8-0a17514e31bd None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:45.982644 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3913b9-a2c3-430c-99f8-0a17514e31bd None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:45.982993 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3913b9-a2c3-430c-99f8-0a17514e31bd None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:45.984878 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 94/188] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:46:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:46:45.991446 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4af30e-8542-42be-869f-f9fed797bd3b None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:45.991731 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4af30e-8542-42be-869f-f9fed797bd3b None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:45.992003 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4af30e-8542-42be-869f-f9fed797bd3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:46.011154 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-0b4af30e-8542-42be-869f-f9fed797bd3b None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:46:46.012351 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-0b4af30e-8542-42be-869f-f9fed797bd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:46:46.021495 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 95/189] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:46:45 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:46:46.036327 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f96ebe-5e0b-4728-8de7-613ba522b56c None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:46.036983 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f96ebe-5e0b-4728-8de7-613ba522b56c None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:46.037459 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f96ebe-5e0b-4728-8de7-613ba522b56c None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:46.039911 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 95/190] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:46:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:46:46.046296 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfe700-51aa-4b8f-94d7-bc75a04efcd4 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:46.046592 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfe700-51aa-4b8f-94d7-bc75a04efcd4 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:46.046858 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfe700-51aa-4b8f-94d7-bc75a04efcd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:46.047907 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f96ebe-5e0b-4728-8de7-613ba522b56c None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:46.061621 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f96ebe-5e0b-4728-8de7-613ba522b56c None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:46.066492 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-4abfe700-51aa-4b8f-94d7-bc75a04efcd4 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:46:46.066907 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8fc540-b168-4f54-89eb-08e7f74febc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:46.067700 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-4abfe700-51aa-4b8f-94d7-bc75a04efcd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:46:46.068233 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8fc540-b168-4f54-89eb-08e7f74febc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:46.068866 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8fc540-b168-4f54-89eb-08e7f74febc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:46.069340 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8fc540-b168-4f54-89eb-08e7f74febc4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:46.075725 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 96/191] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:46:46 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:46:46.077296 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ce988-7c51-4d62-9f23-582220d13dc2 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:46.077522 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ce988-7c51-4d62-9f23-582220d13dc2 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:46.077796 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ce988-7c51-4d62-9f23-582220d13dc2 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:46.079602 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 97/192] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:46:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:46:46.083655 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8fc540-b168-4f54-89eb-08e7f74febc4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:46:46.085911 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9e638-1390-4ad7-98aa-f55519b883c2 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:46.086200 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9e638-1390-4ad7-98aa-f55519b883c2 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:46.086471 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9e638-1390-4ad7-98aa-f55519b883c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:46.091530 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-ac8fc540-b168-4f54-89eb-08e7f74febc4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 24 04:46:46.092902 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 96/193] 10.222.0.43 () {56 vars in 1117 bytes} [Fri Dec 24 04:46:46 2021] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:46:46.099489 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8fc540-b168-4f54-89eb-08e7f74febc4 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:46.104728 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-dbc9e638-1390-4ad7-98aa-f55519b883c2 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:46:46.105849 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-dbc9e638-1390-4ad7-98aa-f55519b883c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:46:46.110674 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8fc540-b168-4f54-89eb-08e7f74febc4 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:46.113847 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 98/194] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:46:46 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 24 04:46:46.114443 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9e638-1390-4ad7-98aa-f55519b883c2 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:46.115761 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28cde7c-6287-4a03-bd55-27dc3f2e81a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:46.116486 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28cde7c-6287-4a03-bd55-27dc3f2e81a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:46.116795 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28cde7c-6287-4a03-bd55-27dc3f2e81a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:46.117075 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28cde7c-6287-4a03-bd55-27dc3f2e81a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:46.117855 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28cde7c-6287-4a03-bd55-27dc3f2e81a0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:46:46.118165 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28cde7c-6287-4a03-bd55-27dc3f2e81a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:46.119788 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28cde7c-6287-4a03-bd55-27dc3f2e81a0 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:46.130475 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9e638-1390-4ad7-98aa-f55519b883c2 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:46.135304 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef1d32-7567-43ff-aea2-4f67f4d38511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:46.136339 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef1d32-7567-43ff-aea2-4f67f4d38511 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:46.136831 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef1d32-7567-43ff-aea2-4f67f4d38511 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:46.137314 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef1d32-7567-43ff-aea2-4f67f4d38511 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:46.138438 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 97/195] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:46:46 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:46.139668 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fef1d32-7567-43ff-aea2-4f67f4d38511 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:46.139810 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28cde7c-6287-4a03-bd55-27dc3f2e81a0 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:46.141288 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fef1d32-7567-43ff-aea2-4f67f4d38511 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:46.143166 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 99/196] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:46:46 2021] GET /identity/v3/domains/default => generated 199 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:46.143817 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef1d32-7567-43ff-aea2-4f67f4d38511 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:46.150740 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28cde7c-6287-4a03-bd55-27dc3f2e81a0 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:46.155226 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941228e4-e291-45a5-bce4-1e0c27a6c4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:46.156036 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941228e4-e291-45a5-bce4-1e0c27a6c4e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:46.156317 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941228e4-e291-45a5-bce4-1e0c27a6c4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:46.156620 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941228e4-e291-45a5-bce4-1e0c27a6c4e4 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:46.158325 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef1d32-7567-43ff-aea2-4f67f4d38511 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:46.163184 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44dbb9-491b-4d4d-ba66-72088d363550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:46.164052 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44dbb9-491b-4d4d-ba66-72088d363550 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:46.164314 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44dbb9-491b-4d4d-ba66-72088d363550 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:46.164816 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44dbb9-491b-4d4d-ba66-72088d363550 admin admin] PATH_INFO: `/v3/users/0d174f04faa94fa1afd303e2f4d8b6e7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:46.167364 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941228e4-e291-45a5-bce4-1e0c27a6c4e4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:46:46.175273 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-941228e4-e291-45a5-bce4-1e0c27a6c4e4 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 24 04:46:46.176492 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 98/197] 10.222.0.43 () {56 vars in 1135 bytes} [Fri Dec 24 04:46:46 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:46:46.177320 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941228e4-e291-45a5-bce4-1e0c27a6c4e4 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:46.184114 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e44dbb9-491b-4d4d-ba66-72088d363550 admin admin] RBAC: Authorizing `identity:get_user(user_id=0d174f04faa94fa1afd303e2f4d8b6e7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:46.186913 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941228e4-e291-45a5-bce4-1e0c27a6c4e4 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:46.187373 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e44dbb9-491b-4d4d-ba66-72088d363550 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:46.189148 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 100/198] 10.222.0.43 () {56 vars in 1198 bytes} [Fri Dec 24 04:46:46 2021] GET /identity/v3/users/0d174f04faa94fa1afd303e2f4d8b6e7 => generated 283 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:46.189902 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44dbb9-491b-4d4d-ba66-72088d363550 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:46.191416 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a41555-e0b7-4cd9-bd22-0dd731b09930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:46.192066 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a41555-e0b7-4cd9-bd22-0dd731b09930 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:46.192342 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a41555-e0b7-4cd9-bd22-0dd731b09930 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:46.192653 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a41555-e0b7-4cd9-bd22-0dd731b09930 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:46.193380 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a41555-e0b7-4cd9-bd22-0dd731b09930 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:46.195284 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a41555-e0b7-4cd9-bd22-0dd731b09930 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:46.199222 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44dbb9-491b-4d4d-ba66-72088d363550 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:46.204400 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f7299-663b-459a-8016-ff0d5f692576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:46.205094 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f7299-663b-459a-8016-ff0d5f692576 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:46.205376 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f7299-663b-459a-8016-ff0d5f692576 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:46.205651 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f7299-663b-459a-8016-ff0d5f692576 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:46.206417 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f7299-663b-459a-8016-ff0d5f692576 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:46:46.206720 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f7299-663b-459a-8016-ff0d5f692576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:46.208441 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f7299-663b-459a-8016-ff0d5f692576 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:46.218919 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 99/199] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Dec 24 04:46:46 2021] POST /identity/v3/users => generated 297 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:46:46.220562 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 101/200] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Dec 24 04:46:46 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:46.224646 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a41555-e0b7-4cd9-bd22-0dd731b09930 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:46.225720 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f7299-663b-459a-8016-ff0d5f692576 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:46.235501 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a41555-e0b7-4cd9-bd22-0dd731b09930 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:46.237018 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f7299-663b-459a-8016-ff0d5f692576 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:46.240027 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b4f97-5648-4a91-92ab-efd1bd708156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:46.241023 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b4f97-5648-4a91-92ab-efd1bd708156 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:46.241305 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b4f97-5648-4a91-92ab-efd1bd708156 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:46.241602 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b4f97-5648-4a91-92ab-efd1bd708156 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:46.242957 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b81ee-cbb7-435d-932a-1ebfb09901b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:46.244031 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b81ee-cbb7-435d-932a-1ebfb09901b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:46.244482 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b81ee-cbb7-435d-932a-1ebfb09901b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:46.244970 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b81ee-cbb7-435d-932a-1ebfb09901b5 admin admin] PATH_INFO: `/v3/users/0d174f04faa94fa1afd303e2f4d8b6e7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:46.246450 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b81ee-cbb7-435d-932a-1ebfb09901b5 admin admin] RBAC: Authorizing `identity:get_user(user_id=0d174f04faa94fa1afd303e2f4d8b6e7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:46.249627 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b81ee-cbb7-435d-932a-1ebfb09901b5 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:46.250381 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121b4f97-5648-4a91-92ab-efd1bd708156 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:46.252164 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 102/201] 10.222.0.43 () {56 vars in 1198 bytes} [Fri Dec 24 04:46:46 2021] GET /identity/v3/users/0d174f04faa94fa1afd303e2f4d8b6e7 => generated 283 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:46.252277 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121b4f97-5648-4a91-92ab-efd1bd708156 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:46.258877 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b81ee-cbb7-435d-932a-1ebfb09901b5 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:46.262089 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 100/202] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:46:46 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 24 04:46:46.268361 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b4f97-5648-4a91-92ab-efd1bd708156 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:46.271655 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b81ee-cbb7-435d-932a-1ebfb09901b5 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:46.276494 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0219feae-72e3-46c2-b977-2107a373ba43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:46.277423 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b4f97-5648-4a91-92ab-efd1bd708156 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:46.277666 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219feae-72e3-46c2-b977-2107a373ba43 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:46.278084 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219feae-72e3-46c2-b977-2107a373ba43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:46.278495 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219feae-72e3-46c2-b977-2107a373ba43 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:46.281869 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b306bd65-e5a6-4759-b94b-403341bc8a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:46.282774 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306bd65-e5a6-4759-b94b-403341bc8a7d admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:46.283055 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306bd65-e5a6-4759-b94b-403341bc8a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:46.283337 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306bd65-e5a6-4759-b94b-403341bc8a7d admin admin] PATH_INFO: `/v3/projects/74b19d07d8a647c7af2381d4e80089ad` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:46.284589 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b306bd65-e5a6-4759-b94b-403341bc8a7d admin admin] RBAC: Authorizing `identity:get_project(project_id=74b19d07d8a647c7af2381d4e80089ad)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:46.286689 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b306bd65-e5a6-4759-b94b-403341bc8a7d admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:46.288467 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 101/203] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:46:46 2021] GET /identity/v3/projects/74b19d07d8a647c7af2381d4e80089ad => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:46:46.290011 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0219feae-72e3-46c2-b977-2107a373ba43 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:46.291974 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0219feae-72e3-46c2-b977-2107a373ba43 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:46.295546 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b306bd65-e5a6-4759-b94b-403341bc8a7d admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:46.302818 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 103/204] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:46:46 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 24 04:46:46.308822 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b306bd65-e5a6-4759-b94b-403341bc8a7d admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:46.309149 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0219feae-72e3-46c2-b977-2107a373ba43 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:46.313051 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd94ac4-fff6-4a01-b610-cbd0ed494287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:46.315154 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd94ac4-fff6-4a01-b610-cbd0ed494287 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:46.315154 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd94ac4-fff6-4a01-b610-cbd0ed494287 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:46.315154 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd94ac4-fff6-4a01-b610-cbd0ed494287 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:46.315862 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd94ac4-fff6-4a01-b610-cbd0ed494287 admin admin] RBAC: Adding query filter params (role.id=d5e6fc257d8541d5a5ed1988eacd5be7, scope.project.id=74b19d07d8a647c7af2381d4e80089ad, user.id=0d174f04faa94fa1afd303e2f4d8b6e7) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:46:46.316188 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd94ac4-fff6-4a01-b610-cbd0ed494287 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:46.318440 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd94ac4-fff6-4a01-b610-cbd0ed494287 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:46.319061 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0219feae-72e3-46c2-b977-2107a373ba43 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:46.323578 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849fee3-f858-4990-bb3d-9f7f96ab7663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:46.324448 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849fee3-f858-4990-bb3d-9f7f96ab7663 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:46.324764 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849fee3-f858-4990-bb3d-9f7f96ab7663 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:46.325192 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 102/205] 10.222.0.43 () {56 vars in 1395 bytes} [Fri Dec 24 04:46:46 2021] GET /identity/v3/role_assignments?user.id=0d174f04faa94fa1afd303e2f4d8b6e7&scope.project.id=74b19d07d8a647c7af2381d4e80089ad&role.id=d5e6fc257d8541d5a5ed1988eacd5be7 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:46:46.325306 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849fee3-f858-4990-bb3d-9f7f96ab7663 admin admin] PATH_INFO: `/v3/projects/74b19d07d8a647c7af2381d4e80089ad` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:46.326650 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7849fee3-f858-4990-bb3d-9f7f96ab7663 admin admin] RBAC: Authorizing `identity:get_project(project_id=74b19d07d8a647c7af2381d4e80089ad)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:46.329265 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7849fee3-f858-4990-bb3d-9f7f96ab7663 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:46.331250 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 104/206] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:46:46 2021] GET /identity/v3/projects/74b19d07d8a647c7af2381d4e80089ad => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:46:46.338056 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd94ac4-fff6-4a01-b610-cbd0ed494287 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:46.349240 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd94ac4-fff6-4a01-b610-cbd0ed494287 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:46.353884 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f4b7e-ffe0-43af-89c3-69267c4a2315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:46.354571 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f4b7e-ffe0-43af-89c3-69267c4a2315 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:46.354911 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f4b7e-ffe0-43af-89c3-69267c4a2315 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:46.355131 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f4b7e-ffe0-43af-89c3-69267c4a2315 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:46.356026 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9f4b7e-ffe0-43af-89c3-69267c4a2315 admin admin] RBAC: Adding query filter params (role.id=62790996bc274dda9199846ea736d771, scope.project.id=74b19d07d8a647c7af2381d4e80089ad, user.id=0d174f04faa94fa1afd303e2f4d8b6e7) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:46:46.356337 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9f4b7e-ffe0-43af-89c3-69267c4a2315 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:46.359297 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9f4b7e-ffe0-43af-89c3-69267c4a2315 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:46.365986 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 103/207] 10.222.0.43 () {56 vars in 1395 bytes} [Fri Dec 24 04:46:46 2021] GET /identity/v3/role_assignments?user.id=0d174f04faa94fa1afd303e2f4d8b6e7&scope.project.id=74b19d07d8a647c7af2381d4e80089ad&role.id=62790996bc274dda9199846ea736d771 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:48.712845 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4cf367-0005-42dd-98d9-571c210f0b1b None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:48.713768 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4cf367-0005-42dd-98d9-571c210f0b1b None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:48.714244 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4cf367-0005-42dd-98d9-571c210f0b1b None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:48.714407 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec4ec6-0458-4031-a3fe-048de57ea416 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:48.714779 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec4ec6-0458-4031-a3fe-048de57ea416 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:48.714948 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec4ec6-0458-4031-a3fe-048de57ea416 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:48.717215 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 105/209] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:46:48 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:46:48.717318 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 104/209] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:46:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:46:48.724242 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7acf6-b0d9-4093-9c2f-d4ca3415db00 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:48.724518 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7acf6-b0d9-4093-9c2f-d4ca3415db00 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:48.724831 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7acf6-b0d9-4093-9c2f-d4ca3415db00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:48.724930 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b746e-e3d6-492b-9aca-6b6a8813e552 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:48.725457 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b746e-e3d6-492b-9aca-6b6a8813e552 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:48.725915 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b746e-e3d6-492b-9aca-6b6a8813e552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:48.745481 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-cba7acf6-b0d9-4093-9c2f-d4ca3415db00 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:46:48.746766 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-cba7acf6-b0d9-4093-9c2f-d4ca3415db00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:46:48.747257 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-696b746e-e3d6-492b-9aca-6b6a8813e552 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:46:48.749242 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-696b746e-e3d6-492b-9aca-6b6a8813e552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:46:48.755631 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 105/210] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:46:48 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 24 04:46:48.758373 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 106/211] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:46:48 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:46:48.759981 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a23155-a736-4123-959a-96504d296a03 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:48.760108 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c320e0-cd70-49d4-aef0-53e3bedf6fa8 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:48.760281 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a23155-a736-4123-959a-96504d296a03 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:48.760374 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c320e0-cd70-49d4-aef0-53e3bedf6fa8 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:48.760575 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a23155-a736-4123-959a-96504d296a03 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:48.760669 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c320e0-cd70-49d4-aef0-53e3bedf6fa8 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:48.762343 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 107/212] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:46:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:46:48.762442 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 106/213] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:46:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:46:48.768564 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6fc041-c939-4a73-95f1-19ca1c407b76 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:48.769039 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6fc041-c939-4a73-95f1-19ca1c407b76 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:48.769505 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6fc041-c939-4a73-95f1-19ca1c407b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:48.771910 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290305d-2b11-491c-941e-80c842005809 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:48.772401 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290305d-2b11-491c-941e-80c842005809 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:48.772763 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290305d-2b11-491c-941e-80c842005809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:48.788640 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-9b6fc041-c939-4a73-95f1-19ca1c407b76 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:46:48.789838 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-9b6fc041-c939-4a73-95f1-19ca1c407b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:46:48.790445 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-3290305d-2b11-491c-941e-80c842005809 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:46:48.791589 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-3290305d-2b11-491c-941e-80c842005809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:46:48.797590 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 108/214] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:46:48 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:46:48.799411 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6fc041-c939-4a73-95f1-19ca1c407b76 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:48.799897 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 107/215] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:46:48 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:46:48.801663 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3290305d-2b11-491c-941e-80c842005809 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:48.809028 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6fc041-c939-4a73-95f1-19ca1c407b76 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:48.811449 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3290305d-2b11-491c-941e-80c842005809 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:48.814421 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810faee6-c57e-44e5-89df-cbcdd877b2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:48.815484 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810faee6-c57e-44e5-89df-cbcdd877b2ff admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:48.815833 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810faee6-c57e-44e5-89df-cbcdd877b2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:48.816189 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810faee6-c57e-44e5-89df-cbcdd877b2ff admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:48.816768 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db358b-f7e2-4d32-9acf-5335be0285ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:48.817762 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db358b-f7e2-4d32-9acf-5335be0285ee admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:48.818227 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db358b-f7e2-4d32-9acf-5335be0285ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:48.818681 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db358b-f7e2-4d32-9acf-5335be0285ee admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:48.827247 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810faee6-c57e-44e5-89df-cbcdd877b2ff admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:46:48.829681 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50db358b-f7e2-4d32-9acf-5335be0285ee admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:46:48.834587 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-810faee6-c57e-44e5-89df-cbcdd877b2ff admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 24 04:46:48.835790 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 109/216] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:46:48 2021] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:46:48.836635 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810faee6-c57e-44e5-89df-cbcdd877b2ff admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:48.838090 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-50db358b-f7e2-4d32-9acf-5335be0285ee admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 24 04:46:48.839265 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 108/217] 10.222.0.43 () {56 vars in 1117 bytes} [Fri Dec 24 04:46:48 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:46:48.840004 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db358b-f7e2-4d32-9acf-5335be0285ee admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:48.849564 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db358b-f7e2-4d32-9acf-5335be0285ee admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:48.852876 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810faee6-c57e-44e5-89df-cbcdd877b2ff admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:48.853734 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fbc2b5-8e9b-4876-8c3c-61dafce58c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:48.854445 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbc2b5-8e9b-4876-8c3c-61dafce58c78 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:48.854722 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbc2b5-8e9b-4876-8c3c-61dafce58c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:48.854990 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbc2b5-8e9b-4876-8c3c-61dafce58c78 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:48.856143 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fbc2b5-8e9b-4876-8c3c-61dafce58c78 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:48.857154 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b212a-1fde-494f-ae77-e7932be0eae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:48.857911 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b212a-1fde-494f-ae77-e7932be0eae4 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:48.858012 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fbc2b5-8e9b-4876-8c3c-61dafce58c78 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:48.858195 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b212a-1fde-494f-ae77-e7932be0eae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:48.858466 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b212a-1fde-494f-ae77-e7932be0eae4 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:48.859642 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 109/218] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:46:48 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:48.860222 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fbc2b5-8e9b-4876-8c3c-61dafce58c78 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:48.869328 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54b212a-1fde-494f-ae77-e7932be0eae4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:46:48.873128 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fbc2b5-8e9b-4876-8c3c-61dafce58c78 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:48.876709 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-b54b212a-1fde-494f-ae77-e7932be0eae4 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 24 04:46:48.877241 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b62505-115b-465e-addd-668f82c550cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:48.877817 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b62505-115b-465e-addd-668f82c550cc admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:48.877943 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 110/219] 10.222.0.43 () {56 vars in 1135 bytes} [Fri Dec 24 04:46:48 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:46:48.878091 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b62505-115b-465e-addd-668f82c550cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:48.878360 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b62505-115b-465e-addd-668f82c550cc admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:48.878651 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b212a-1fde-494f-ae77-e7932be0eae4 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:48.879154 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b62505-115b-465e-addd-668f82c550cc admin admin] RBAC: Adding query filter params (name=member) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:46:48.879460 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b62505-115b-465e-addd-668f82c550cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:48.881020 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b62505-115b-465e-addd-668f82c550cc admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:48.888351 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b212a-1fde-494f-ae77-e7932be0eae4 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:48.889350 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 110/220] 10.222.0.43 () {56 vars in 1122 bytes} [Fri Dec 24 04:46:48 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:48.894129 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b62505-115b-465e-addd-668f82c550cc admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:48.897370 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ca08b-3f44-456f-820f-316b44dd5f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:48.898009 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ca08b-3f44-456f-820f-316b44dd5f9d admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:48.898291 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ca08b-3f44-456f-820f-316b44dd5f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:48.898564 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ca08b-3f44-456f-820f-316b44dd5f9d admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:48.899335 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ca08b-3f44-456f-820f-316b44dd5f9d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:46:48.899473 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b62505-115b-465e-addd-668f82c550cc admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:48.899607 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ca08b-3f44-456f-820f-316b44dd5f9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:48.901284 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ca08b-3f44-456f-820f-316b44dd5f9d admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:48.903729 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b58733-102c-419d-98d4-37cc300cc4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:48.904403 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b58733-102c-419d-98d4-37cc300cc4be admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:48.904704 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b58733-102c-419d-98d4-37cc300cc4be admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:48.904973 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b58733-102c-419d-98d4-37cc300cc4be admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:48.905675 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b58733-102c-419d-98d4-37cc300cc4be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:48.907522 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b58733-102c-419d-98d4-37cc300cc4be admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:48.909715 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 111/221] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:46:48 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:48.910543 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ca08b-3f44-456f-820f-316b44dd5f9d admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:48.919817 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ca08b-3f44-456f-820f-316b44dd5f9d admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:48.925034 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74314361-7905-4d2b-85c4-717e449ef653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:48.925683 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74314361-7905-4d2b-85c4-717e449ef653 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:48.925966 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74314361-7905-4d2b-85c4-717e449ef653 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:48.926236 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74314361-7905-4d2b-85c4-717e449ef653 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:48.926994 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74314361-7905-4d2b-85c4-717e449ef653 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:46:48.927296 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74314361-7905-4d2b-85c4-717e449ef653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:48.928925 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74314361-7905-4d2b-85c4-717e449ef653 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:48.932580 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 111/222] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Dec 24 04:46:48 2021] POST /identity/v3/users => generated 297 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:46:48.933524 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b58733-102c-419d-98d4-37cc300cc4be admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:48.938241 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 112/223] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Dec 24 04:46:48 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:48.939100 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74314361-7905-4d2b-85c4-717e449ef653 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:48.944415 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b58733-102c-419d-98d4-37cc300cc4be admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:48.948770 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74314361-7905-4d2b-85c4-717e449ef653 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:48.949306 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45774ffe-5f97-4da1-9c68-7a67ea725af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:48.950439 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45774ffe-5f97-4da1-9c68-7a67ea725af3 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:48.950727 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45774ffe-5f97-4da1-9c68-7a67ea725af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:48.951134 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45774ffe-5f97-4da1-9c68-7a67ea725af3 admin admin] PATH_INFO: `/v3/users/7bdf2d78981d4e96a36f8fb67f45af4b` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:48.953980 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d903c923-7fcc-4f35-8cfd-448d26e4f26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:48.954881 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903c923-7fcc-4f35-8cfd-448d26e4f26d admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:48.955160 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903c923-7fcc-4f35-8cfd-448d26e4f26d admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:48.955430 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903c923-7fcc-4f35-8cfd-448d26e4f26d admin admin] PATH_INFO: `/v3/users/0d174f04faa94fa1afd303e2f4d8b6e7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:48.956845 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d903c923-7fcc-4f35-8cfd-448d26e4f26d admin admin] RBAC: Authorizing `identity:get_user(user_id=0d174f04faa94fa1afd303e2f4d8b6e7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:48.959363 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d903c923-7fcc-4f35-8cfd-448d26e4f26d admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:48.966713 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 113/224] 10.222.0.43 () {56 vars in 1198 bytes} [Fri Dec 24 04:46:48 2021] GET /identity/v3/users/0d174f04faa94fa1afd303e2f4d8b6e7 => generated 283 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:48.966713 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d903c923-7fcc-4f35-8cfd-448d26e4f26d admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:48.968583 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45774ffe-5f97-4da1-9c68-7a67ea725af3 admin admin] RBAC: Authorizing `identity:get_user(user_id=7bdf2d78981d4e96a36f8fb67f45af4b)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:48.970789 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45774ffe-5f97-4da1-9c68-7a67ea725af3 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:48.973320 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 112/225] 10.222.0.43 () {56 vars in 1198 bytes} [Fri Dec 24 04:46:48 2021] GET /identity/v3/users/7bdf2d78981d4e96a36f8fb67f45af4b => generated 297 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:48.973581 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45774ffe-5f97-4da1-9c68-7a67ea725af3 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:48.980320 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d903c923-7fcc-4f35-8cfd-448d26e4f26d admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:48.984137 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45774ffe-5f97-4da1-9c68-7a67ea725af3 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:48.986128 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f112f6a-0565-43bc-81ee-28b27f6a6c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:48.987019 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f112f6a-0565-43bc-81ee-28b27f6a6c14 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:48.987268 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f112f6a-0565-43bc-81ee-28b27f6a6c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:48.987554 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f112f6a-0565-43bc-81ee-28b27f6a6c14 admin admin] PATH_INFO: `/v3/users/0d174f04faa94fa1afd303e2f4d8b6e7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:48.988784 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f112f6a-0565-43bc-81ee-28b27f6a6c14 admin admin] RBAC: Authorizing `identity:get_user(user_id=0d174f04faa94fa1afd303e2f4d8b6e7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:48.990113 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606a2cb-b525-41f5-b049-fdb37d2616c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:48.990942 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f112f6a-0565-43bc-81ee-28b27f6a6c14 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:48.991036 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606a2cb-b525-41f5-b049-fdb37d2616c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:48.991258 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606a2cb-b525-41f5-b049-fdb37d2616c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:48.991535 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606a2cb-b525-41f5-b049-fdb37d2616c6 admin admin] PATH_INFO: `/v3/projects/74b19d07d8a647c7af2381d4e80089ad` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:48.992807 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 114/226] 10.222.0.43 () {56 vars in 1198 bytes} [Fri Dec 24 04:46:48 2021] GET /identity/v3/users/0d174f04faa94fa1afd303e2f4d8b6e7 => generated 283 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:48.992924 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d606a2cb-b525-41f5-b049-fdb37d2616c6 admin admin] RBAC: Authorizing `identity:get_project(project_id=74b19d07d8a647c7af2381d4e80089ad)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:48.993410 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f112f6a-0565-43bc-81ee-28b27f6a6c14 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:48.995082 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d606a2cb-b525-41f5-b049-fdb37d2616c6 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:49.000649 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 113/227] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:46:48 2021] GET /identity/v3/projects/74b19d07d8a647c7af2381d4e80089ad => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:49.000649 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606a2cb-b525-41f5-b049-fdb37d2616c6 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:49.010265 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f112f6a-0565-43bc-81ee-28b27f6a6c14 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:49.010731 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606a2cb-b525-41f5-b049-fdb37d2616c6 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:49.015253 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f67580-6cde-4823-aa03-3f3fb7406245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:49.015630 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8139c15c-27ff-4d73-bbcd-6b60df08814d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:49.015919 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f67580-6cde-4823-aa03-3f3fb7406245 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:49.016200 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f67580-6cde-4823-aa03-3f3fb7406245 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:49.016492 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139c15c-27ff-4d73-bbcd-6b60df08814d admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:49.016604 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f67580-6cde-4823-aa03-3f3fb7406245 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:49.016888 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139c15c-27ff-4d73-bbcd-6b60df08814d admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:49.017227 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139c15c-27ff-4d73-bbcd-6b60df08814d admin admin] PATH_INFO: `/v3/projects/74b19d07d8a647c7af2381d4e80089ad` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:49.018594 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8139c15c-27ff-4d73-bbcd-6b60df08814d admin admin] RBAC: Authorizing `identity:get_project(project_id=74b19d07d8a647c7af2381d4e80089ad)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:49.020772 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8139c15c-27ff-4d73-bbcd-6b60df08814d admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:49.022715 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 114/228] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:46:48 2021] GET /identity/v3/projects/74b19d07d8a647c7af2381d4e80089ad => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:46:49.023414 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8139c15c-27ff-4d73-bbcd-6b60df08814d admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:49.032293 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f67580-6cde-4823-aa03-3f3fb7406245 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:49.034139 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f67580-6cde-4823-aa03-3f3fb7406245 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:49.034874 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8139c15c-27ff-4d73-bbcd-6b60df08814d admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:49.039355 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0a583-9c4b-4744-8592-2cc573131fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:49.040263 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0a583-9c4b-4744-8592-2cc573131fbe admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:49.040581 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0a583-9c4b-4744-8592-2cc573131fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:49.040865 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0a583-9c4b-4744-8592-2cc573131fbe admin admin] PATH_INFO: `/v3/projects/74b19d07d8a647c7af2381d4e80089ad/users/0d174f04faa94fa1afd303e2f4d8b6e7/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:49.042942 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd0a583-9c4b-4744-8592-2cc573131fbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=74b19d07d8a647c7af2381d4e80089ad, user_id=0d174f04faa94fa1afd303e2f4d8b6e7, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:49.044106 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 115/229] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:46:48 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 24 04:46:49.045171 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f67580-6cde-4823-aa03-3f3fb7406245 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:49.046180 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd0a583-9c4b-4744-8592-2cc573131fbe admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:49.055205 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f67580-6cde-4823-aa03-3f3fb7406245 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:49.060853 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c815d766-186a-40db-9d3d-0de47bf32638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:49.061756 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815d766-186a-40db-9d3d-0de47bf32638 admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:49.062031 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815d766-186a-40db-9d3d-0de47bf32638 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:49.062316 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815d766-186a-40db-9d3d-0de47bf32638 admin admin] PATH_INFO: `/v3/projects/74b19d07d8a647c7af2381d4e80089ad/users/0d174f04faa94fa1afd303e2f4d8b6e7/roles/62790996bc274dda9199846ea736d771` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:49.062826 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 115/230] 10.222.0.43 () {58 vars in 1460 bytes} [Fri Dec 24 04:46:49 2021] PUT /identity/v3/projects/74b19d07d8a647c7af2381d4e80089ad/users/0d174f04faa94fa1afd303e2f4d8b6e7/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:46:49.064926 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c815d766-186a-40db-9d3d-0de47bf32638 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74b19d07d8a647c7af2381d4e80089ad, user_id=0d174f04faa94fa1afd303e2f4d8b6e7, role_id=62790996bc274dda9199846ea736d771)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:49.067820 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c815d766-186a-40db-9d3d-0de47bf32638 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:49.073675 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0a583-9c4b-4744-8592-2cc573131fbe admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:49.084696 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 116/231] 10.222.0.43 () {58 vars in 1460 bytes} [Fri Dec 24 04:46:49 2021] PUT /identity/v3/projects/74b19d07d8a647c7af2381d4e80089ad/users/0d174f04faa94fa1afd303e2f4d8b6e7/roles/62790996bc274dda9199846ea736d771 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:46:49.170672 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0a583-9c4b-4744-8592-2cc573131fbe admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:49.237467 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4cc5ba-674c-40d5-8cce-cc402953ef2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:49.238891 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4cc5ba-674c-40d5-8cce-cc402953ef2d admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:49.239965 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4cc5ba-674c-40d5-8cce-cc402953ef2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:49.240804 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4cc5ba-674c-40d5-8cce-cc402953ef2d admin admin] PATH_INFO: `/v3/projects/74b19d07d8a647c7af2381d4e80089ad` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:49.242822 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4cc5ba-674c-40d5-8cce-cc402953ef2d admin admin] RBAC: Authorizing `identity:get_project(project_id=74b19d07d8a647c7af2381d4e80089ad)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:49.244993 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4cc5ba-674c-40d5-8cce-cc402953ef2d admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:49.246988 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 116/232] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:46:49 2021] GET /identity/v3/projects/74b19d07d8a647c7af2381d4e80089ad => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:49.254331 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c815d766-186a-40db-9d3d-0de47bf32638 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:49.266124 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c815d766-186a-40db-9d3d-0de47bf32638 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:49.273118 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7804bfe-14fc-4b58-a28c-80c402c62dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:49.273811 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7804bfe-14fc-4b58-a28c-80c402c62dbb admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:49.274091 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7804bfe-14fc-4b58-a28c-80c402c62dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:49.274368 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7804bfe-14fc-4b58-a28c-80c402c62dbb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:49.275240 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7804bfe-14fc-4b58-a28c-80c402c62dbb admin admin] RBAC: Adding query filter params (role.id=19e41972301c400193cf0c53e0462e49, scope.project.id=74b19d07d8a647c7af2381d4e80089ad, user.id=7bdf2d78981d4e96a36f8fb67f45af4b) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:46:49.275543 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7804bfe-14fc-4b58-a28c-80c402c62dbb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:49.279719 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7804bfe-14fc-4b58-a28c-80c402c62dbb admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:49.285109 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 117/233] 10.222.0.43 () {56 vars in 1395 bytes} [Fri Dec 24 04:46:49 2021] GET /identity/v3/role_assignments?user.id=7bdf2d78981d4e96a36f8fb67f45af4b&scope.project.id=74b19d07d8a647c7af2381d4e80089ad&role.id=19e41972301c400193cf0c53e0462e49 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:51.619272 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915174d9-7a62-4c4d-980c-2e4fa0e03edd None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:51.619758 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915174d9-7a62-4c4d-980c-2e4fa0e03edd None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:51.619758 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915174d9-7a62-4c4d-980c-2e4fa0e03edd None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:51.621792 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 117/234] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:46:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:46:51.627601 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e7379-f9f0-4dc4-9c57-0ebae33d4523 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:51.628033 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e7379-f9f0-4dc4-9c57-0ebae33d4523 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:51.628202 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e7379-f9f0-4dc4-9c57-0ebae33d4523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:51.653708 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-008e7379-f9f0-4dc4-9c57-0ebae33d4523 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:46:51.654982 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-008e7379-f9f0-4dc4-9c57-0ebae33d4523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:46:51.662676 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 118/235] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:46:51 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:46:51.699738 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915174d9-7a62-4c4d-980c-2e4fa0e03edd None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:51.719370 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915174d9-7a62-4c4d-980c-2e4fa0e03edd None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:51.726710 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d9776-f983-453e-b7f7-f0ff5ec1e8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:51.727534 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d9776-f983-453e-b7f7-f0ff5ec1e8aa admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:51.727813 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d9776-f983-453e-b7f7-f0ff5ec1e8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:51.728085 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d9776-f983-453e-b7f7-f0ff5ec1e8aa admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:51.741809 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d9776-f983-453e-b7f7-f0ff5ec1e8aa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:46:51.753706 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-f83d9776-f983-453e-b7f7-f0ff5ec1e8aa admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 24 04:46:51.755338 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 118/236] 10.222.0.43 () {56 vars in 1135 bytes} [Fri Dec 24 04:46:51 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:46:51.761591 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e7379-f9f0-4dc4-9c57-0ebae33d4523 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:51.774169 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e7379-f9f0-4dc4-9c57-0ebae33d4523 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:51.780310 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b3955-b58e-44c6-a3c0-a0692fd35d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:51.781375 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b3955-b58e-44c6-a3c0-a0692fd35d00 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:51.781659 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b3955-b58e-44c6-a3c0-a0692fd35d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:51.781935 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b3955-b58e-44c6-a3c0-a0692fd35d00 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:51.782814 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b3955-b58e-44c6-a3c0-a0692fd35d00 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:46:51.783121 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b3955-b58e-44c6-a3c0-a0692fd35d00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:51.789134 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b3955-b58e-44c6-a3c0-a0692fd35d00 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:51.799736 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 119/237] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Dec 24 04:46:51 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:51.806018 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d9776-f983-453e-b7f7-f0ff5ec1e8aa admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:51.819251 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d9776-f983-453e-b7f7-f0ff5ec1e8aa admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:51.829786 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bfb028-faa6-4c13-8703-9d3a71cf9e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:51.830668 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bfb028-faa6-4c13-8703-9d3a71cf9e75 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:51.830944 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bfb028-faa6-4c13-8703-9d3a71cf9e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:51.831212 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bfb028-faa6-4c13-8703-9d3a71cf9e75 admin admin] PATH_INFO: `/v3/users/0d174f04faa94fa1afd303e2f4d8b6e7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:51.832826 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bfb028-faa6-4c13-8703-9d3a71cf9e75 admin admin] RBAC: Authorizing `identity:get_user(user_id=0d174f04faa94fa1afd303e2f4d8b6e7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:51.835291 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bfb028-faa6-4c13-8703-9d3a71cf9e75 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:51.842303 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 119/238] 10.222.0.43 () {56 vars in 1198 bytes} [Fri Dec 24 04:46:51 2021] GET /identity/v3/users/0d174f04faa94fa1afd303e2f4d8b6e7 => generated 283 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:46:51.848483 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b3955-b58e-44c6-a3c0-a0692fd35d00 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:51.861461 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b3955-b58e-44c6-a3c0-a0692fd35d00 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:51.869129 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb951e48-98a3-4513-a57c-6174ad0780fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:51.869840 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb951e48-98a3-4513-a57c-6174ad0780fe admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:51.870065 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb951e48-98a3-4513-a57c-6174ad0780fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:51.870340 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb951e48-98a3-4513-a57c-6174ad0780fe admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:51.878847 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb951e48-98a3-4513-a57c-6174ad0780fe admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:51.880630 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb951e48-98a3-4513-a57c-6174ad0780fe admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:51.894125 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 120/239] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:46:51 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 24 04:46:51.900311 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bfb028-faa6-4c13-8703-9d3a71cf9e75 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:51.914050 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bfb028-faa6-4c13-8703-9d3a71cf9e75 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:51.922056 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82932309-bfaf-4012-92e8-278be1ce4106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:51.922914 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82932309-bfaf-4012-92e8-278be1ce4106 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:51.923194 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82932309-bfaf-4012-92e8-278be1ce4106 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:51.923465 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82932309-bfaf-4012-92e8-278be1ce4106 admin admin] PATH_INFO: `/v3/projects/74b19d07d8a647c7af2381d4e80089ad` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:51.924685 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82932309-bfaf-4012-92e8-278be1ce4106 admin admin] RBAC: Authorizing `identity:get_project(project_id=74b19d07d8a647c7af2381d4e80089ad)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:51.926746 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82932309-bfaf-4012-92e8-278be1ce4106 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:51.928405 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 120/240] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:46:51 2021] GET /identity/v3/projects/74b19d07d8a647c7af2381d4e80089ad => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:51.934914 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb951e48-98a3-4513-a57c-6174ad0780fe admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:51.948097 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb951e48-98a3-4513-a57c-6174ad0780fe admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:51.957149 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216134cc-cbbb-4f89-aa7a-c57d42e4cafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:51.957814 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216134cc-cbbb-4f89-aa7a-c57d42e4cafe admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:51.958090 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216134cc-cbbb-4f89-aa7a-c57d42e4cafe admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:51.958364 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216134cc-cbbb-4f89-aa7a-c57d42e4cafe admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:51.959537 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216134cc-cbbb-4f89-aa7a-c57d42e4cafe admin admin] RBAC: Adding query filter params (role.id=62790996bc274dda9199846ea736d771, scope.project.id=74b19d07d8a647c7af2381d4e80089ad, user.id=0d174f04faa94fa1afd303e2f4d8b6e7) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:46:51.959845 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216134cc-cbbb-4f89-aa7a-c57d42e4cafe admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:51.961741 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216134cc-cbbb-4f89-aa7a-c57d42e4cafe admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:51.968544 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 121/241] 10.222.0.43 () {56 vars in 1395 bytes} [Fri Dec 24 04:46:51 2021] GET /identity/v3/role_assignments?user.id=0d174f04faa94fa1afd303e2f4d8b6e7&scope.project.id=74b19d07d8a647c7af2381d4e80089ad&role.id=62790996bc274dda9199846ea736d771 => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:52.127643 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3536d7-e952-48f5-9fb9-ff22e59a8591 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:52.127995 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3536d7-e952-48f5-9fb9-ff22e59a8591 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:52.128179 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3536d7-e952-48f5-9fb9-ff22e59a8591 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:52.129923 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 121/242] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:46:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:46:52.136426 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b8c43-53c1-41f6-9140-0aec2d58d671 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:52.136725 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b8c43-53c1-41f6-9140-0aec2d58d671 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:52.136993 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b8c43-53c1-41f6-9140-0aec2d58d671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:52.161620 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-7e6b8c43-53c1-41f6-9140-0aec2d58d671 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:46:52.162839 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-7e6b8c43-53c1-41f6-9140-0aec2d58d671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:46:52.170998 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 122/243] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:46:52 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:46:52.177268 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99cef0-bc3a-4369-b683-6f232e478d31 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:52.177555 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99cef0-bc3a-4369-b683-6f232e478d31 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:52.177828 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99cef0-bc3a-4369-b683-6f232e478d31 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:52.179600 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 122/244] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:46:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:46:52.185758 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58e4c9-1496-4cb3-8d42-075b9748aa20 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:52.186048 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58e4c9-1496-4cb3-8d42-075b9748aa20 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:52.186328 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58e4c9-1496-4cb3-8d42-075b9748aa20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:52.196307 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b99cef0-bc3a-4369-b683-6f232e478d31 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:52.215927 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-aa58e4c9-1496-4cb3-8d42-075b9748aa20 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:46:52.217351 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-aa58e4c9-1496-4cb3-8d42-075b9748aa20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:46:52.218335 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b99cef0-bc3a-4369-b683-6f232e478d31 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:52.226885 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7a988-a7e7-452f-879f-8e67d4950011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:52.228297 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7a988-a7e7-452f-879f-8e67d4950011 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:52.228606 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7a988-a7e7-452f-879f-8e67d4950011 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:52.230178 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 123/245] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:46:52 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 24 04:46:52.230290 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7a988-a7e7-452f-879f-8e67d4950011 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:52.242558 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f7a988-a7e7-452f-879f-8e67d4950011 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:46:52.250336 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-88f7a988-a7e7-452f-879f-8e67d4950011 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 24 04:46:52.252407 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf442b-442e-423b-8b30-4f043312f57c None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:52.252717 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf442b-442e-423b-8b30-4f043312f57c None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:52.252993 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf442b-442e-423b-8b30-4f043312f57c None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:52.253622 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 123/246] 10.222.0.43 () {56 vars in 1117 bytes} [Fri Dec 24 04:46:52 2021] GET /identity/v3/roles/admin => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:46:52.255074 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 124/247] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:46:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 24 04:46:52.263031 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf442b-442e-423b-8b30-4f043312f57c None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:52.263225 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9887450-0f9c-486e-a830-d4afb4f2316b None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:52.263225 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9887450-0f9c-486e-a830-d4afb4f2316b None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:52.263225 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9887450-0f9c-486e-a830-d4afb4f2316b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:52.274796 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf442b-442e-423b-8b30-4f043312f57c None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:52.280583 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae390b7-e690-4e7f-beeb-14762514ff81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:52.281175 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae390b7-e690-4e7f-beeb-14762514ff81 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:52.281573 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae390b7-e690-4e7f-beeb-14762514ff81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:52.281937 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae390b7-e690-4e7f-beeb-14762514ff81 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:52.285363 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae390b7-e690-4e7f-beeb-14762514ff81 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:46:52.285363 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae390b7-e690-4e7f-beeb-14762514ff81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:52.285363 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae390b7-e690-4e7f-beeb-14762514ff81 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:52.290625 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-d9887450-0f9c-486e-a830-d4afb4f2316b None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:46:52.292126 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-d9887450-0f9c-486e-a830-d4afb4f2316b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:46:52.300562 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 125/248] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:46:52 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:52.300562 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae390b7-e690-4e7f-beeb-14762514ff81 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:52.308707 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae390b7-e690-4e7f-beeb-14762514ff81 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:52.309620 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 124/249] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:46:52 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:46:52.316516 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9887450-0f9c-486e-a830-d4afb4f2316b None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:52.327117 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48be95-8056-4c9f-853c-9915054bd40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:52.327292 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9887450-0f9c-486e-a830-d4afb4f2316b None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:52.327661 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48be95-8056-4c9f-853c-9915054bd40c admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:52.327938 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48be95-8056-4c9f-853c-9915054bd40c admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:52.328199 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48be95-8056-4c9f-853c-9915054bd40c admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:52.336679 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb334b0-7e5c-43d9-a278-8cafc9937846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:52.337575 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb334b0-7e5c-43d9-a278-8cafc9937846 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:52.337851 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb334b0-7e5c-43d9-a278-8cafc9937846 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:52.338121 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb334b0-7e5c-43d9-a278-8cafc9937846 admin admin] PATH_INFO: `/v3/users/0d174f04faa94fa1afd303e2f4d8b6e7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:52.339428 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb334b0-7e5c-43d9-a278-8cafc9937846 admin admin] RBAC: Authorizing `identity:get_user(user_id=0d174f04faa94fa1afd303e2f4d8b6e7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:52.341676 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb334b0-7e5c-43d9-a278-8cafc9937846 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:52.343802 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 125/250] 10.222.0.43 () {56 vars in 1198 bytes} [Fri Dec 24 04:46:52 2021] GET /identity/v3/users/0d174f04faa94fa1afd303e2f4d8b6e7 => generated 283 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:52.344519 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230fe631-56d2-4014-8773-a9c94bf6ae7f None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:52.344835 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230fe631-56d2-4014-8773-a9c94bf6ae7f None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:52.345785 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230fe631-56d2-4014-8773-a9c94bf6ae7f None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:52.345883 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb48be95-8056-4c9f-853c-9915054bd40c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:46:52.346962 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 126/251] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:46:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:46:52.347478 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230fe631-56d2-4014-8773-a9c94bf6ae7f None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:52.354995 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-bb48be95-8056-4c9f-853c-9915054bd40c admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 24 04:46:52.356301 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 126/252] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:46:52 2021] GET /identity/v3/roles/reader => generated 84 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:46:52.358360 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48be95-8056-4c9f-853c-9915054bd40c admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:52.359757 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230fe631-56d2-4014-8773-a9c94bf6ae7f None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:52.365863 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51024f6e-48b6-486b-97da-852da6c7b332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:52.366892 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51024f6e-48b6-486b-97da-852da6c7b332 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:52.367198 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51024f6e-48b6-486b-97da-852da6c7b332 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:52.367466 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51024f6e-48b6-486b-97da-852da6c7b332 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:52.368713 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51024f6e-48b6-486b-97da-852da6c7b332 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:52.369392 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48be95-8056-4c9f-853c-9915054bd40c admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:52.370444 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51024f6e-48b6-486b-97da-852da6c7b332 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:52.372033 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 127/253] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:46:52 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:52.373209 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa703d-de71-48fb-a02b-2551c72dbc62 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:52.373498 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa703d-de71-48fb-a02b-2551c72dbc62 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:52.373767 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa703d-de71-48fb-a02b-2551c72dbc62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:52.374944 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70619b2d-d5c6-4ba4-958a-0dde8e17ecd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:52.375797 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70619b2d-d5c6-4ba4-958a-0dde8e17ecd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:52.376264 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70619b2d-d5c6-4ba4-958a-0dde8e17ecd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:52.377096 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70619b2d-d5c6-4ba4-958a-0dde8e17ecd3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:52.385770 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70619b2d-d5c6-4ba4-958a-0dde8e17ecd3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:52.387823 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70619b2d-d5c6-4ba4-958a-0dde8e17ecd3 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:52.393264 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-72aa703d-de71-48fb-a02b-2551c72dbc62 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:46:52.394465 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-72aa703d-de71-48fb-a02b-2551c72dbc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:46:52.398164 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 127/254] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:46:52 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 24 04:46:52.398164 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70619b2d-d5c6-4ba4-958a-0dde8e17ecd3 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:52.405049 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 128/255] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:46:52 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:46:52.407785 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70619b2d-d5c6-4ba4-958a-0dde8e17ecd3 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:52.409565 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa703d-de71-48fb-a02b-2551c72dbc62 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:52.412290 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4175914c-f50f-441d-ab47-4df52007321f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:52.412987 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175914c-f50f-441d-ab47-4df52007321f admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:52.413269 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175914c-f50f-441d-ab47-4df52007321f admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:52.413548 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175914c-f50f-441d-ab47-4df52007321f admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:52.414311 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4175914c-f50f-441d-ab47-4df52007321f admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:46:52.414618 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4175914c-f50f-441d-ab47-4df52007321f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:52.416218 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4175914c-f50f-441d-ab47-4df52007321f admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:52.418735 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa703d-de71-48fb-a02b-2551c72dbc62 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:52.423081 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab72c1-f35e-47b9-9c25-b6fc2a275e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:52.423731 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab72c1-f35e-47b9-9c25-b6fc2a275e9c admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:52.424009 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab72c1-f35e-47b9-9c25-b6fc2a275e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:52.424277 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab72c1-f35e-47b9-9c25-b6fc2a275e9c admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:52.424963 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 128/256] 10.222.0.43 () {56 vars in 1122 bytes} [Fri Dec 24 04:46:52 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:52.425683 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4175914c-f50f-441d-ab47-4df52007321f admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:52.430071 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cab72c1-f35e-47b9-9c25-b6fc2a275e9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:52.432092 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cab72c1-f35e-47b9-9c25-b6fc2a275e9c admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:52.439200 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4175914c-f50f-441d-ab47-4df52007321f admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:52.443626 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f607c-ff95-4e0f-aded-adba16222294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:52.444657 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f607c-ff95-4e0f-aded-adba16222294 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:52.445024 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f607c-ff95-4e0f-aded-adba16222294 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:52.445347 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f607c-ff95-4e0f-aded-adba16222294 admin admin] PATH_INFO: `/v3/projects/74b19d07d8a647c7af2381d4e80089ad` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:52.446667 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2f607c-ff95-4e0f-aded-adba16222294 admin admin] RBAC: Authorizing `identity:get_project(project_id=74b19d07d8a647c7af2381d4e80089ad)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:52.448837 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2f607c-ff95-4e0f-aded-adba16222294 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:52.450497 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 129/257] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:46:52 2021] GET /identity/v3/projects/74b19d07d8a647c7af2381d4e80089ad => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:52.451512 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f607c-ff95-4e0f-aded-adba16222294 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:52.451911 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 129/258] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Dec 24 04:46:52 2021] POST /identity/v3/users => generated 293 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:46:52.452744 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab72c1-f35e-47b9-9c25-b6fc2a275e9c admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:52.462506 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab72c1-f35e-47b9-9c25-b6fc2a275e9c admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:52.466845 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f607c-ff95-4e0f-aded-adba16222294 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:52.467168 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43010ba-6476-470b-b621-84203f458e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:52.468054 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43010ba-6476-470b-b621-84203f458e3a admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:52.468332 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43010ba-6476-470b-b621-84203f458e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:52.468636 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43010ba-6476-470b-b621-84203f458e3a admin admin] PATH_INFO: `/v3/users/7fb45aa59da9469b87ef0cb7c535759e` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:52.471374 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1243279-0f92-4a83-8b29-9292b9c5b7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:52.472197 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1243279-0f92-4a83-8b29-9292b9c5b7cb admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:52.472478 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1243279-0f92-4a83-8b29-9292b9c5b7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:52.472799 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1243279-0f92-4a83-8b29-9292b9c5b7cb admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:52.484939 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1243279-0f92-4a83-8b29-9292b9c5b7cb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:46:52.485400 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43010ba-6476-470b-b621-84203f458e3a admin admin] RBAC: Authorizing `identity:get_user(user_id=7fb45aa59da9469b87ef0cb7c535759e)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:52.487703 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43010ba-6476-470b-b621-84203f458e3a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:52.489638 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 130/259] 10.222.0.43 () {56 vars in 1198 bytes} [Fri Dec 24 04:46:52 2021] GET /identity/v3/users/7fb45aa59da9469b87ef0cb7c535759e => generated 297 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:52.490652 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43010ba-6476-470b-b621-84203f458e3a admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:52.492104 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-c1243279-0f92-4a83-8b29-9292b9c5b7cb admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 24 04:46:52.493553 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 130/260] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:46:52 2021] GET /identity/v3/roles/member => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:46:52.499831 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1243279-0f92-4a83-8b29-9292b9c5b7cb admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:52.508133 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43010ba-6476-470b-b621-84203f458e3a admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:52.510685 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1243279-0f92-4a83-8b29-9292b9c5b7cb admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:52.512863 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d711ea8a-3e64-4c4c-9047-6c9a641b38fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:52.513606 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d711ea8a-3e64-4c4c-9047-6c9a641b38fe admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:52.513933 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d711ea8a-3e64-4c4c-9047-6c9a641b38fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:52.514202 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d711ea8a-3e64-4c4c-9047-6c9a641b38fe admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:52.515168 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d711ea8a-3e64-4c4c-9047-6c9a641b38fe admin admin] RBAC: Adding query filter params (role.id=d5e6fc257d8541d5a5ed1988eacd5be7, scope.project.id=74b19d07d8a647c7af2381d4e80089ad, user.id=0d174f04faa94fa1afd303e2f4d8b6e7) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:46:52.515480 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d711ea8a-3e64-4c4c-9047-6c9a641b38fe admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:52.516054 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77960f19-0257-4d58-a821-524bb433abc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:52.516821 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77960f19-0257-4d58-a821-524bb433abc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:52.517165 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77960f19-0257-4d58-a821-524bb433abc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:52.517503 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77960f19-0257-4d58-a821-524bb433abc6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:52.517595 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d711ea8a-3e64-4c4c-9047-6c9a641b38fe admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:52.524806 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 131/261] 10.222.0.43 () {56 vars in 1395 bytes} [Fri Dec 24 04:46:52 2021] GET /identity/v3/role_assignments?user.id=0d174f04faa94fa1afd303e2f4d8b6e7&scope.project.id=74b19d07d8a647c7af2381d4e80089ad&role.id=d5e6fc257d8541d5a5ed1988eacd5be7 => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:52.525519 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d711ea8a-3e64-4c4c-9047-6c9a641b38fe admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:52.531113 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77960f19-0257-4d58-a821-524bb433abc6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:52.534362 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77960f19-0257-4d58-a821-524bb433abc6 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:52.537052 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d711ea8a-3e64-4c4c-9047-6c9a641b38fe admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:52.542183 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9855c-fcc6-4db9-ab8a-8dbabf1ecfab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:52.543157 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9855c-fcc6-4db9-ab8a-8dbabf1ecfab admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:52.543639 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9855c-fcc6-4db9-ab8a-8dbabf1ecfab admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:52.544108 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9855c-fcc6-4db9-ab8a-8dbabf1ecfab admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:52.545313 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9855c-fcc6-4db9-ab8a-8dbabf1ecfab admin admin] RBAC: Adding query filter params (name=member) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:46:52.545865 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9855c-fcc6-4db9-ab8a-8dbabf1ecfab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:52.547893 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 131/262] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:46:52 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 24 04:46:52.548410 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9855c-fcc6-4db9-ab8a-8dbabf1ecfab admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:52.554404 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77960f19-0257-4d58-a821-524bb433abc6 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:52.562395 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 132/263] 10.222.0.43 () {56 vars in 1122 bytes} [Fri Dec 24 04:46:52 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:52.563884 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77960f19-0257-4d58-a821-524bb433abc6 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:52.570962 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9855c-fcc6-4db9-ab8a-8dbabf1ecfab admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:52.572374 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f03cd-7dd5-44b7-b8ae-7fe081a0c66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:52.573358 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f03cd-7dd5-44b7-b8ae-7fe081a0c66b admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:52.573633 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f03cd-7dd5-44b7-b8ae-7fe081a0c66b admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:52.574041 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f03cd-7dd5-44b7-b8ae-7fe081a0c66b admin admin] PATH_INFO: `/v3/projects/74b19d07d8a647c7af2381d4e80089ad` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:52.575451 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29f03cd-7dd5-44b7-b8ae-7fe081a0c66b admin admin] RBAC: Authorizing `identity:get_project(project_id=74b19d07d8a647c7af2381d4e80089ad)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:52.578212 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29f03cd-7dd5-44b7-b8ae-7fe081a0c66b admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:52.583420 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9855c-fcc6-4db9-ab8a-8dbabf1ecfab admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:52.585187 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 132/264] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:46:52 2021] GET /identity/v3/projects/74b19d07d8a647c7af2381d4e80089ad => generated 302 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:52.588091 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f03cd-7dd5-44b7-b8ae-7fe081a0c66b admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:52.594983 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a14cd97-7c86-4f57-8dee-d066bf574d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:52.596472 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14cd97-7c86-4f57-8dee-d066bf574d7a admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:52.597020 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14cd97-7c86-4f57-8dee-d066bf574d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:52.597590 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14cd97-7c86-4f57-8dee-d066bf574d7a admin admin] PATH_INFO: `/v3/users/7bdf2d78981d4e96a36f8fb67f45af4b` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:52.599417 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a14cd97-7c86-4f57-8dee-d066bf574d7a admin admin] RBAC: Authorizing `identity:get_user(user_id=7bdf2d78981d4e96a36f8fb67f45af4b)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:52.599791 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f03cd-7dd5-44b7-b8ae-7fe081a0c66b admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:52.602491 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a14cd97-7c86-4f57-8dee-d066bf574d7a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:52.604643 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffdee91-2f5a-423e-87e4-02611568ca4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:52.605158 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 133/265] 10.222.0.43 () {56 vars in 1198 bytes} [Fri Dec 24 04:46:52 2021] GET /identity/v3/users/7bdf2d78981d4e96a36f8fb67f45af4b => generated 297 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:46:52.605327 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffdee91-2f5a-423e-87e4-02611568ca4d admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:52.605578 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffdee91-2f5a-423e-87e4-02611568ca4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:52.605849 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffdee91-2f5a-423e-87e4-02611568ca4d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:52.606718 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffdee91-2f5a-423e-87e4-02611568ca4d admin admin] RBAC: Adding query filter params (role.id=96d2300cdfbe46debbcc0eaab781246d, scope.project.id=74b19d07d8a647c7af2381d4e80089ad, user.id=7fb45aa59da9469b87ef0cb7c535759e) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:46:52.607026 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffdee91-2f5a-423e-87e4-02611568ca4d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:52.612625 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffdee91-2f5a-423e-87e4-02611568ca4d admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:52.615617 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a14cd97-7c86-4f57-8dee-d066bf574d7a admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:52.621045 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 133/266] 10.222.0.43 () {56 vars in 1395 bytes} [Fri Dec 24 04:46:52 2021] GET /identity/v3/role_assignments?user.id=7fb45aa59da9469b87ef0cb7c535759e&scope.project.id=74b19d07d8a647c7af2381d4e80089ad&role.id=96d2300cdfbe46debbcc0eaab781246d => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:52.635621 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a14cd97-7c86-4f57-8dee-d066bf574d7a admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:52.641637 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11069128-c048-4ad0-9373-3ef2c7e22c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:52.642930 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11069128-c048-4ad0-9373-3ef2c7e22c13 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:52.643707 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11069128-c048-4ad0-9373-3ef2c7e22c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:52.644250 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11069128-c048-4ad0-9373-3ef2c7e22c13 admin admin] PATH_INFO: `/v3/projects/74b19d07d8a647c7af2381d4e80089ad` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:52.646109 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11069128-c048-4ad0-9373-3ef2c7e22c13 admin admin] RBAC: Authorizing `identity:get_project(project_id=74b19d07d8a647c7af2381d4e80089ad)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:52.648758 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11069128-c048-4ad0-9373-3ef2c7e22c13 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:52.651486 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 134/267] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:46:52 2021] GET /identity/v3/projects/74b19d07d8a647c7af2381d4e80089ad => generated 302 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:52.658641 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffdee91-2f5a-423e-87e4-02611568ca4d admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:52.670323 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffdee91-2f5a-423e-87e4-02611568ca4d admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:52.675654 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44167f95-17b2-46f6-aaa8-e1e26dde7718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:52.677133 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44167f95-17b2-46f6-aaa8-e1e26dde7718 admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:52.677686 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44167f95-17b2-46f6-aaa8-e1e26dde7718 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:52.678181 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44167f95-17b2-46f6-aaa8-e1e26dde7718 admin admin] PATH_INFO: `/v3/projects/74b19d07d8a647c7af2381d4e80089ad/users/7bdf2d78981d4e96a36f8fb67f45af4b/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:52.680876 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44167f95-17b2-46f6-aaa8-e1e26dde7718 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74b19d07d8a647c7af2381d4e80089ad, user_id=7bdf2d78981d4e96a36f8fb67f45af4b, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:52.684152 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44167f95-17b2-46f6-aaa8-e1e26dde7718 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:52.701718 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 134/268] 10.222.0.43 () {58 vars in 1460 bytes} [Fri Dec 24 04:46:52 2021] PUT /identity/v3/projects/74b19d07d8a647c7af2381d4e80089ad/users/7bdf2d78981d4e96a36f8fb67f45af4b/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:46:55.034266 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c42d8f-8f2e-4012-875a-4c59877da22e None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:55.034794 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c42d8f-8f2e-4012-875a-4c59877da22e None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:55.034794 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c42d8f-8f2e-4012-875a-4c59877da22e None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:55.036776 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 135/269] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:46:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 24 04:46:55.042438 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03fc10-eadd-4027-bc87-3a10ae8b8c19 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:55.042864 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03fc10-eadd-4027-bc87-3a10ae8b8c19 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:55.043058 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03fc10-eadd-4027-bc87-3a10ae8b8c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:55.060325 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3acbc8c-c5b7-458f-aee1-9deec3307d76 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:55.060693 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3acbc8c-c5b7-458f-aee1-9deec3307d76 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:55.060957 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3acbc8c-c5b7-458f-aee1-9deec3307d76 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:55.062864 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 136/270] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:46:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 24 04:46:55.063781 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-3c03fc10-eadd-4027-bc87-3a10ae8b8c19 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:46:55.065273 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-3c03fc10-eadd-4027-bc87-3a10ae8b8c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:46:55.066526 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8fd52d-df72-443d-933f-be9da234ef26 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:55.066811 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8fd52d-df72-443d-933f-be9da234ef26 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:55.067066 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8fd52d-df72-443d-933f-be9da234ef26 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:55.069098 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 137/271] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:46:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:46:55.070158 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d4a6d-0d5a-401d-91de-bea9308fae47 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:55.070437 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d4a6d-0d5a-401d-91de-bea9308fae47 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:55.070704 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d4a6d-0d5a-401d-91de-bea9308fae47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:55.088576 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-7f6d4a6d-0d5a-401d-91de-bea9308fae47 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:46:55.089767 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-7f6d4a6d-0d5a-401d-91de-bea9308fae47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:46:55.122471 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 135/272] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:46:55 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:46:55.124058 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0825202-ed7e-449d-92c8-8ee410c1ebe1 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:55.124351 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0825202-ed7e-449d-92c8-8ee410c1ebe1 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:55.124662 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0825202-ed7e-449d-92c8-8ee410c1ebe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:55.141123 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-d0825202-ed7e-449d-92c8-8ee410c1ebe1 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:46:55.142307 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-d0825202-ed7e-449d-92c8-8ee410c1ebe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:46:55.144667 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 138/273] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:46:55 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:46:55.145973 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d29981b-8f5a-412b-8884-0f6083279581 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:55.146256 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d29981b-8f5a-412b-8884-0f6083279581 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:55.146529 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d29981b-8f5a-412b-8884-0f6083279581 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:55.148288 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 139/274] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:46:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:46:55.148850 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d29981b-8f5a-412b-8884-0f6083279581 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:55.156567 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 136/275] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:46:55 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:46:55.157851 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f2d0e-84ca-4aa4-9a86-6d7d538f8bf6 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:55.158133 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f2d0e-84ca-4aa4-9a86-6d7d538f8bf6 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:55.158408 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f2d0e-84ca-4aa4-9a86-6d7d538f8bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:55.165075 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d29981b-8f5a-412b-8884-0f6083279581 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:55.169552 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8caeb1-534d-4554-b421-7348fb2e7363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:55.170457 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8caeb1-534d-4554-b421-7348fb2e7363 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:55.170735 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8caeb1-534d-4554-b421-7348fb2e7363 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:55.171004 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8caeb1-534d-4554-b421-7348fb2e7363 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:55.179349 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-bc3f2d0e-84ca-4aa4-9a86-6d7d538f8bf6 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:46:55.180568 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-bc3f2d0e-84ca-4aa4-9a86-6d7d538f8bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:46:55.181847 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8caeb1-534d-4554-b421-7348fb2e7363 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:46:55.187899 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 137/276] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:46:55 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:46:55.188670 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f2d0e-84ca-4aa4-9a86-6d7d538f8bf6 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:55.189266 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-3f8caeb1-534d-4554-b421-7348fb2e7363 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 24 04:46:55.192569 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 140/277] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:46:55 2021] GET /identity/v3/roles/reader => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:46:55.192569 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8caeb1-534d-4554-b421-7348fb2e7363 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:55.200368 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8caeb1-534d-4554-b421-7348fb2e7363 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:55.205452 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc443a3-c47e-4dba-abc1-e869e929c615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:55.205597 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f2d0e-84ca-4aa4-9a86-6d7d538f8bf6 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:55.206172 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc443a3-c47e-4dba-abc1-e869e929c615 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:55.206508 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc443a3-c47e-4dba-abc1-e869e929c615 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:55.206716 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc443a3-c47e-4dba-abc1-e869e929c615 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:55.207892 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc443a3-c47e-4dba-abc1-e869e929c615 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:55.210011 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc443a3-c47e-4dba-abc1-e869e929c615 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:55.210189 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac757787-2e12-4935-bdd5-20f3ccb0e624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:55.210957 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac757787-2e12-4935-bdd5-20f3ccb0e624 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:55.211233 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac757787-2e12-4935-bdd5-20f3ccb0e624 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:55.211708 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac757787-2e12-4935-bdd5-20f3ccb0e624 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:55.211894 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 141/278] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:46:55 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:55.213318 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc443a3-c47e-4dba-abc1-e869e929c615 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:55.222036 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac757787-2e12-4935-bdd5-20f3ccb0e624 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:46:55.223096 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc443a3-c47e-4dba-abc1-e869e929c615 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:55.227456 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee26d0ff-449a-4532-9245-5d409c7728bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:55.228072 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26d0ff-449a-4532-9245-5d409c7728bd admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:55.228353 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26d0ff-449a-4532-9245-5d409c7728bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:55.228656 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26d0ff-449a-4532-9245-5d409c7728bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:55.228889 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-ac757787-2e12-4935-bdd5-20f3ccb0e624 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 24 04:46:55.229403 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee26d0ff-449a-4532-9245-5d409c7728bd admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:46:55.229704 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee26d0ff-449a-4532-9245-5d409c7728bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:55.230058 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 138/279] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:46:55 2021] GET /identity/v3/roles/member => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:46:55.230888 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac757787-2e12-4935-bdd5-20f3ccb0e624 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:55.231373 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee26d0ff-449a-4532-9245-5d409c7728bd admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:55.239787 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 142/280] 10.222.0.43 () {56 vars in 1122 bytes} [Fri Dec 24 04:46:55 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:55.240628 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee26d0ff-449a-4532-9245-5d409c7728bd admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:55.246282 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac757787-2e12-4935-bdd5-20f3ccb0e624 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:55.250376 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee26d0ff-449a-4532-9245-5d409c7728bd admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:55.250525 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e4c611-524a-4b5a-998d-c1ab3c0e4a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:55.251290 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4c611-524a-4b5a-998d-c1ab3c0e4a2e admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:55.251569 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4c611-524a-4b5a-998d-c1ab3c0e4a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:55.251838 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4c611-524a-4b5a-998d-c1ab3c0e4a2e admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:55.254622 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec10e3e-c1c0-4de9-9a92-dd1f3d73a448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:55.255244 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec10e3e-c1c0-4de9-9a92-dd1f3d73a448 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:55.255522 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec10e3e-c1c0-4de9-9a92-dd1f3d73a448 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:55.255793 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec10e3e-c1c0-4de9-9a92-dd1f3d73a448 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:55.256500 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec10e3e-c1c0-4de9-9a92-dd1f3d73a448 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:55.258557 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec10e3e-c1c0-4de9-9a92-dd1f3d73a448 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:55.262015 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e4c611-524a-4b5a-998d-c1ab3c0e4a2e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:46:55.268967 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-f5e4c611-524a-4b5a-998d-c1ab3c0e4a2e admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 24 04:46:55.270240 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 139/281] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:46:55 2021] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:46:55.270240 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e4c611-524a-4b5a-998d-c1ab3c0e4a2e admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:55.279560 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 143/282] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Dec 24 04:46:55 2021] POST /identity/v3/users => generated 293 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:46:55.280533 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec10e3e-c1c0-4de9-9a92-dd1f3d73a448 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:55.285465 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e4c611-524a-4b5a-998d-c1ab3c0e4a2e admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:55.289936 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec10e3e-c1c0-4de9-9a92-dd1f3d73a448 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:55.295905 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f2a0f-0c83-44ec-ac11-2e1759d64896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:55.296833 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f2a0f-0c83-44ec-ac11-2e1759d64896 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:55.297110 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f2a0f-0c83-44ec-ac11-2e1759d64896 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:55.297378 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f2a0f-0c83-44ec-ac11-2e1759d64896 admin admin] PATH_INFO: `/v3/users/7fb45aa59da9469b87ef0cb7c535759e` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:55.298683 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51f2a0f-0c83-44ec-ac11-2e1759d64896 admin admin] RBAC: Authorizing `identity:get_user(user_id=7fb45aa59da9469b87ef0cb7c535759e)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:55.299535 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07f8286-ace1-4d0c-b76d-54bef319d6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:55.300927 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51f2a0f-0c83-44ec-ac11-2e1759d64896 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:55.301424 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f8286-ace1-4d0c-b76d-54bef319d6aa admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:55.301997 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f8286-ace1-4d0c-b76d-54bef319d6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:55.302428 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f8286-ace1-4d0c-b76d-54bef319d6aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:55.308246 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 144/283] 10.222.0.43 () {56 vars in 1198 bytes} [Fri Dec 24 04:46:55 2021] GET /identity/v3/users/7fb45aa59da9469b87ef0cb7c535759e => generated 297 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:55.308439 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07f8286-ace1-4d0c-b76d-54bef319d6aa admin admin] RBAC: Adding query filter params (name=member) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:46:55.308561 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f2a0f-0c83-44ec-ac11-2e1759d64896 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:55.308649 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07f8286-ace1-4d0c-b76d-54bef319d6aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:55.308649 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07f8286-ace1-4d0c-b76d-54bef319d6aa admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:55.320646 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 140/284] 10.222.0.43 () {56 vars in 1122 bytes} [Fri Dec 24 04:46:55 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:55.326365 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07f8286-ace1-4d0c-b76d-54bef319d6aa admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:55.329121 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f2a0f-0c83-44ec-ac11-2e1759d64896 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:55.334832 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aca800-47e4-416b-821f-55640d02b6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:55.335577 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aca800-47e4-416b-821f-55640d02b6a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:55.335859 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aca800-47e4-416b-821f-55640d02b6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:55.336134 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aca800-47e4-416b-821f-55640d02b6a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:55.336385 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07f8286-ace1-4d0c-b76d-54bef319d6aa admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:55.336954 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aca800-47e4-416b-821f-55640d02b6a3 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:46:55.337267 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aca800-47e4-416b-821f-55640d02b6a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:55.338905 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aca800-47e4-416b-821f-55640d02b6a3 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:55.340983 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a631d-8099-4e69-9906-d6887582a54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:55.342636 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a631d-8099-4e69-9906-d6887582a54b admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:55.342926 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a631d-8099-4e69-9906-d6887582a54b admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:55.343201 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a631d-8099-4e69-9906-d6887582a54b admin admin] PATH_INFO: `/v3/projects/74b19d07d8a647c7af2381d4e80089ad` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:55.344548 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a631d-8099-4e69-9906-d6887582a54b admin admin] RBAC: Authorizing `identity:get_project(project_id=74b19d07d8a647c7af2381d4e80089ad)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:55.346712 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a631d-8099-4e69-9906-d6887582a54b admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:55.348892 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 141/285] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:46:55 2021] GET /identity/v3/projects/74b19d07d8a647c7af2381d4e80089ad => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:55.349032 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 145/286] 10.222.0.43 () {56 vars in 1122 bytes} [Fri Dec 24 04:46:55 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:55.353650 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a631d-8099-4e69-9906-d6887582a54b admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:55.354885 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aca800-47e4-416b-821f-55640d02b6a3 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:55.363977 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a631d-8099-4e69-9906-d6887582a54b admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:55.365231 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aca800-47e4-416b-821f-55640d02b6a3 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:55.368426 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a16c85-06d7-4d85-9a95-d64bd53f0d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:55.369429 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a16c85-06d7-4d85-9a95-d64bd53f0d2e admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:55.369714 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a16c85-06d7-4d85-9a95-d64bd53f0d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:55.369806 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec73d6-efa3-4e42-9c79-7eab60a6056d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:55.369983 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a16c85-06d7-4d85-9a95-d64bd53f0d2e admin admin] PATH_INFO: `/v3/users/7727efd1b0a1448486dde1fbc90803cf` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:55.370621 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec73d6-efa3-4e42-9c79-7eab60a6056d admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:55.370899 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec73d6-efa3-4e42-9c79-7eab60a6056d admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:55.371171 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec73d6-efa3-4e42-9c79-7eab60a6056d admin admin] PATH_INFO: `/v3/projects/74b19d07d8a647c7af2381d4e80089ad/users/7fb45aa59da9469b87ef0cb7c535759e/roles/96d2300cdfbe46debbcc0eaab781246d` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:55.374671 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ec73d6-efa3-4e42-9c79-7eab60a6056d admin admin] RBAC: Authorizing `identity:create_grant(project_id=74b19d07d8a647c7af2381d4e80089ad, user_id=7fb45aa59da9469b87ef0cb7c535759e, role_id=96d2300cdfbe46debbcc0eaab781246d)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:55.377729 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ec73d6-efa3-4e42-9c79-7eab60a6056d admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:55.387325 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a16c85-06d7-4d85-9a95-d64bd53f0d2e admin admin] RBAC: Authorizing `identity:get_user(user_id=7727efd1b0a1448486dde1fbc90803cf)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:55.388629 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a16c85-06d7-4d85-9a95-d64bd53f0d2e admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:55.390763 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 142/287] 10.222.0.43 () {56 vars in 1198 bytes} [Fri Dec 24 04:46:55 2021] GET /identity/v3/users/7727efd1b0a1448486dde1fbc90803cf => generated 293 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:55.391560 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a16c85-06d7-4d85-9a95-d64bd53f0d2e admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:55.401521 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 146/288] 10.222.0.43 () {58 vars in 1460 bytes} [Fri Dec 24 04:46:55 2021] PUT /identity/v3/projects/74b19d07d8a647c7af2381d4e80089ad/users/7fb45aa59da9469b87ef0cb7c535759e/roles/96d2300cdfbe46debbcc0eaab781246d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:46:55.412728 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a16c85-06d7-4d85-9a95-d64bd53f0d2e admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:55.413981 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec73d6-efa3-4e42-9c79-7eab60a6056d admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:55.467341 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7daa365-3a7a-448b-bf97-b77dcec05add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:55.468247 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7daa365-3a7a-448b-bf97-b77dcec05add admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:55.468565 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7daa365-3a7a-448b-bf97-b77dcec05add admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:55.468860 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7daa365-3a7a-448b-bf97-b77dcec05add admin admin] PATH_INFO: `/v3/users/7bdf2d78981d4e96a36f8fb67f45af4b` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:55.470377 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7daa365-3a7a-448b-bf97-b77dcec05add admin admin] RBAC: Authorizing `identity:get_user(user_id=7bdf2d78981d4e96a36f8fb67f45af4b)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:55.473384 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7daa365-3a7a-448b-bf97-b77dcec05add admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:55.475431 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 143/289] 10.222.0.43 () {56 vars in 1198 bytes} [Fri Dec 24 04:46:55 2021] GET /identity/v3/users/7bdf2d78981d4e96a36f8fb67f45af4b => generated 297 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:55.481827 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7daa365-3a7a-448b-bf97-b77dcec05add admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:55.492089 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7daa365-3a7a-448b-bf97-b77dcec05add admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:55.497115 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c183b55-0e95-4d34-a118-03feb5d516a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:55.497819 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c183b55-0e95-4d34-a118-03feb5d516a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:55.498103 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c183b55-0e95-4d34-a118-03feb5d516a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:55.498380 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c183b55-0e95-4d34-a118-03feb5d516a9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:55.505150 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec73d6-efa3-4e42-9c79-7eab60a6056d admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:55.507621 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c183b55-0e95-4d34-a118-03feb5d516a9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:55.509761 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c183b55-0e95-4d34-a118-03feb5d516a9 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:55.511694 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35082b0c-3505-4e32-bc9d-34548efb4c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:55.512997 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35082b0c-3505-4e32-bc9d-34548efb4c7d admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:55.513545 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35082b0c-3505-4e32-bc9d-34548efb4c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:55.514044 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35082b0c-3505-4e32-bc9d-34548efb4c7d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:55.514916 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35082b0c-3505-4e32-bc9d-34548efb4c7d admin admin] RBAC: Adding query filter params (role.id=19e41972301c400193cf0c53e0462e49, user.id=7727efd1b0a1448486dde1fbc90803cf, scope.system=all) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:46:55.515226 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35082b0c-3505-4e32-bc9d-34548efb4c7d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:55.517218 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35082b0c-3505-4e32-bc9d-34548efb4c7d admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:55.520452 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 144/290] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:46:55 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 24 04:46:55.526122 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 147/291] 10.222.0.43 () {56 vars in 1329 bytes} [Fri Dec 24 04:46:55 2021] GET /identity/v3/role_assignments?user.id=7727efd1b0a1448486dde1fbc90803cf&scope.system=all&role.id=19e41972301c400193cf0c53e0462e49 => generated 226 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:55.527098 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c183b55-0e95-4d34-a118-03feb5d516a9 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:55.537168 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c183b55-0e95-4d34-a118-03feb5d516a9 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:55.543426 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561da83c-9eea-4091-b0a0-8353c3800737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:55.544319 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561da83c-9eea-4091-b0a0-8353c3800737 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:55.548337 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561da83c-9eea-4091-b0a0-8353c3800737 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:55.548337 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561da83c-9eea-4091-b0a0-8353c3800737 admin admin] PATH_INFO: `/v3/projects/74b19d07d8a647c7af2381d4e80089ad` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:55.551126 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561da83c-9eea-4091-b0a0-8353c3800737 admin admin] RBAC: Authorizing `identity:get_project(project_id=74b19d07d8a647c7af2381d4e80089ad)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:55.552292 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561da83c-9eea-4091-b0a0-8353c3800737 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:55.554592 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 145/292] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:46:55 2021] GET /identity/v3/projects/74b19d07d8a647c7af2381d4e80089ad => generated 302 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:46:55.561799 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35082b0c-3505-4e32-bc9d-34548efb4c7d admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:55.572284 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35082b0c-3505-4e32-bc9d-34548efb4c7d admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:55.579541 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb9bc19-829c-46eb-b8fa-c38b90ccfbac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:55.580644 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9bc19-829c-46eb-b8fa-c38b90ccfbac admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:55.581135 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9bc19-829c-46eb-b8fa-c38b90ccfbac admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:55.581609 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9bc19-829c-46eb-b8fa-c38b90ccfbac admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:55.582698 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb9bc19-829c-46eb-b8fa-c38b90ccfbac admin admin] RBAC: Adding query filter params (role.id=19e41972301c400193cf0c53e0462e49, scope.project.id=74b19d07d8a647c7af2381d4e80089ad, user.id=7bdf2d78981d4e96a36f8fb67f45af4b) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:46:55.583264 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb9bc19-829c-46eb-b8fa-c38b90ccfbac admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:55.585835 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb9bc19-829c-46eb-b8fa-c38b90ccfbac admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:55.593938 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 148/293] 10.222.0.43 () {56 vars in 1395 bytes} [Fri Dec 24 04:46:55 2021] GET /identity/v3/role_assignments?user.id=7bdf2d78981d4e96a36f8fb67f45af4b&scope.project.id=74b19d07d8a647c7af2381d4e80089ad&role.id=19e41972301c400193cf0c53e0462e49 => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:57.867051 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3643575-f5a8-41e2-bca1-3e88bbc0ed1e None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:57.867609 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3643575-f5a8-41e2-bca1-3e88bbc0ed1e None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:57.867609 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3643575-f5a8-41e2-bca1-3e88bbc0ed1e None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:57.869671 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 146/294] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:46:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:46:57.875490 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e264ef-ccf8-4e09-8a7b-f90ed05e6701 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:57.875924 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e264ef-ccf8-4e09-8a7b-f90ed05e6701 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:57.876090 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e264ef-ccf8-4e09-8a7b-f90ed05e6701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:57.894070 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-04e264ef-ccf8-4e09-8a7b-f90ed05e6701 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:46:57.895247 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-04e264ef-ccf8-4e09-8a7b-f90ed05e6701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:46:57.902961 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 149/295] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:46:57 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 24 04:46:57.926966 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3643575-f5a8-41e2-bca1-3e88bbc0ed1e None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:57.939737 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3643575-f5a8-41e2-bca1-3e88bbc0ed1e None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:57.943982 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e419bd-c558-4b93-a668-fc0a470dde52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:57.944805 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e419bd-c558-4b93-a668-fc0a470dde52 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:57.945086 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e419bd-c558-4b93-a668-fc0a470dde52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:57.945357 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e419bd-c558-4b93-a668-fc0a470dde52 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:57.955882 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e419bd-c558-4b93-a668-fc0a470dde52 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:46:57.963102 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-b0e419bd-c558-4b93-a668-fc0a470dde52 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 24 04:46:57.964608 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 147/296] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:46:57 2021] GET /identity/v3/roles/reader => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:46:57.970532 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e264ef-ccf8-4e09-8a7b-f90ed05e6701 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:57.979470 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e264ef-ccf8-4e09-8a7b-f90ed05e6701 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:57.983938 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d81b3e-8c17-453d-8177-d3239fcf4c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:57.984626 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d81b3e-8c17-453d-8177-d3239fcf4c76 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:57.984904 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d81b3e-8c17-453d-8177-d3239fcf4c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:57.985169 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d81b3e-8c17-453d-8177-d3239fcf4c76 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:57.986110 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d81b3e-8c17-453d-8177-d3239fcf4c76 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:46:57.986415 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d81b3e-8c17-453d-8177-d3239fcf4c76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:57.988081 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d81b3e-8c17-453d-8177-d3239fcf4c76 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:57.996947 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 150/297] 10.222.0.43 () {56 vars in 1122 bytes} [Fri Dec 24 04:46:57 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:58.002936 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e419bd-c558-4b93-a668-fc0a470dde52 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:58.009152 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88a3f1-5c9d-49a8-922c-450888bbd8a7 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:58.009152 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88a3f1-5c9d-49a8-922c-450888bbd8a7 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:58.009152 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88a3f1-5c9d-49a8-922c-450888bbd8a7 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:58.009523 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 151/298] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:46:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:46:58.013842 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e419bd-c558-4b93-a668-fc0a470dde52 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:58.015232 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e339677-b614-4474-b18d-e119a0f58556 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:58.015684 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e339677-b614-4474-b18d-e119a0f58556 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:58.016111 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e339677-b614-4474-b18d-e119a0f58556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:58.018968 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5e0238-81b4-4a8a-a89c-e638cd07787c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:58.020038 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e0238-81b4-4a8a-a89c-e638cd07787c admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:58.020542 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e0238-81b4-4a8a-a89c-e638cd07787c admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:58.021004 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e0238-81b4-4a8a-a89c-e638cd07787c admin admin] PATH_INFO: `/v3/users/7fb45aa59da9469b87ef0cb7c535759e` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:58.022402 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5e0238-81b4-4a8a-a89c-e638cd07787c admin admin] RBAC: Authorizing `identity:get_user(user_id=7fb45aa59da9469b87ef0cb7c535759e)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:58.024804 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5e0238-81b4-4a8a-a89c-e638cd07787c admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:58.026670 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 148/299] 10.222.0.43 () {56 vars in 1198 bytes} [Fri Dec 24 04:46:58 2021] GET /identity/v3/users/7fb45aa59da9469b87ef0cb7c535759e => generated 297 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:58.033384 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5e0238-81b4-4a8a-a89c-e638cd07787c admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:58.034981 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-8e339677-b614-4474-b18d-e119a0f58556 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:46:58.036173 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-8e339677-b614-4474-b18d-e119a0f58556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:46:58.043585 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5e0238-81b4-4a8a-a89c-e638cd07787c admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:58.048377 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45751ef1-36ac-4504-b140-9658df342c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:58.049273 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45751ef1-36ac-4504-b140-9658df342c1e admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:58.049742 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45751ef1-36ac-4504-b140-9658df342c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:58.050226 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45751ef1-36ac-4504-b140-9658df342c1e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:58.052628 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 152/300] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:46:58 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:46:58.058703 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45751ef1-36ac-4504-b140-9658df342c1e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:58.060820 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45751ef1-36ac-4504-b140-9658df342c1e admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:58.069835 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e339677-b614-4474-b18d-e119a0f58556 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:58.070678 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 149/301] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:46:58 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 24 04:46:58.076987 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45751ef1-36ac-4504-b140-9658df342c1e admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:58.079716 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e339677-b614-4474-b18d-e119a0f58556 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:58.084509 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90a6a5-72d4-4487-a96e-47137f31e4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:58.085333 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90a6a5-72d4-4487-a96e-47137f31e4fb admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:58.085611 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90a6a5-72d4-4487-a96e-47137f31e4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:58.085887 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90a6a5-72d4-4487-a96e-47137f31e4fb admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:58.087239 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45751ef1-36ac-4504-b140-9658df342c1e admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:58.091453 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e497b-ecbd-497f-b3c4-d044927e212e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:58.092288 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e497b-ecbd-497f-b3c4-d044927e212e admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:58.092593 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e497b-ecbd-497f-b3c4-d044927e212e admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:58.092864 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e497b-ecbd-497f-b3c4-d044927e212e admin admin] PATH_INFO: `/v3/projects/74b19d07d8a647c7af2381d4e80089ad` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:58.094167 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e497b-ecbd-497f-b3c4-d044927e212e admin admin] RBAC: Authorizing `identity:get_project(project_id=74b19d07d8a647c7af2381d4e80089ad)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:58.096514 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e497b-ecbd-497f-b3c4-d044927e212e admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:58.097107 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f90a6a5-72d4-4487-a96e-47137f31e4fb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:46:58.098678 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 150/302] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:46:58 2021] GET /identity/v3/projects/74b19d07d8a647c7af2381d4e80089ad => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:46:58.099816 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c16b18-0c00-48a9-ae64-b4c012a7a95c None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:58.100097 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c16b18-0c00-48a9-ae64-b4c012a7a95c None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:58.100365 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c16b18-0c00-48a9-ae64-b4c012a7a95c None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:58.102206 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 151/303] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:46:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:46:58.104844 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c16b18-0c00-48a9-ae64-b4c012a7a95c None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:58.105589 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-9f90a6a5-72d4-4487-a96e-47137f31e4fb admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 24 04:46:58.112096 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 153/304] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:46:58 2021] GET /identity/v3/roles/reader => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:46:58.112096 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067af199-d2ff-448f-a5af-2b3f60e3fd0e None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:58.112096 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067af199-d2ff-448f-a5af-2b3f60e3fd0e None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:58.112096 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067af199-d2ff-448f-a5af-2b3f60e3fd0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:58.118019 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c16b18-0c00-48a9-ae64-b4c012a7a95c None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:58.122056 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b641c6d-16d5-401d-b918-93c8b8aa320a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:58.122926 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b641c6d-16d5-401d-b918-93c8b8aa320a admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:58.123172 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b641c6d-16d5-401d-b918-93c8b8aa320a admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:58.123445 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b641c6d-16d5-401d-b918-93c8b8aa320a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:58.124487 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b641c6d-16d5-401d-b918-93c8b8aa320a admin admin] RBAC: Adding query filter params (role.id=96d2300cdfbe46debbcc0eaab781246d, scope.project.id=74b19d07d8a647c7af2381d4e80089ad, user.id=7fb45aa59da9469b87ef0cb7c535759e) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:46:58.124616 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b641c6d-16d5-401d-b918-93c8b8aa320a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:58.126572 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b641c6d-16d5-401d-b918-93c8b8aa320a admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:58.129398 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-067af199-d2ff-448f-a5af-2b3f60e3fd0e None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:46:58.130571 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-067af199-d2ff-448f-a5af-2b3f60e3fd0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:46:58.132875 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 152/305] 10.222.0.43 () {56 vars in 1395 bytes} [Fri Dec 24 04:46:58 2021] GET /identity/v3/role_assignments?user.id=7fb45aa59da9469b87ef0cb7c535759e&scope.project.id=74b19d07d8a647c7af2381d4e80089ad&role.id=96d2300cdfbe46debbcc0eaab781246d => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:46:58.133788 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b641c6d-16d5-401d-b918-93c8b8aa320a admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:58.143749 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b641c6d-16d5-401d-b918-93c8b8aa320a admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:58.148648 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e7137-44ff-42f3-bd25-4e888dfecd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:58.149189 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 154/306] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:46:58 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:46:58.150024 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e7137-44ff-42f3-bd25-4e888dfecd4b admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:58.150318 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e7137-44ff-42f3-bd25-4e888dfecd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:58.150595 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e7137-44ff-42f3-bd25-4e888dfecd4b admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:58.151375 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103e7137-44ff-42f3-bd25-4e888dfecd4b admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:46:58.151683 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103e7137-44ff-42f3-bd25-4e888dfecd4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:58.156580 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103e7137-44ff-42f3-bd25-4e888dfecd4b admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:58.161629 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fccc934-4435-4f7f-8fbe-39ebaf7a5fb0 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:58.161940 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fccc934-4435-4f7f-8fbe-39ebaf7a5fb0 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:58.162181 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fccc934-4435-4f7f-8fbe-39ebaf7a5fb0 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:58.163981 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 153/307] 10.222.0.43 () {56 vars in 1122 bytes} [Fri Dec 24 04:46:58 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:58.164911 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 155/308] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:46:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:46:58.171581 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e7137-44ff-42f3-bd25-4e888dfecd4b admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:58.173562 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fccc934-4435-4f7f-8fbe-39ebaf7a5fb0 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:58.181683 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e7137-44ff-42f3-bd25-4e888dfecd4b admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:58.186480 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fccc934-4435-4f7f-8fbe-39ebaf7a5fb0 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:58.186795 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef6dd0-7886-4093-ab6d-be645ad57510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:58.187680 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef6dd0-7886-4093-ab6d-be645ad57510 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:58.187958 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef6dd0-7886-4093-ab6d-be645ad57510 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:58.188228 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef6dd0-7886-4093-ab6d-be645ad57510 admin admin] PATH_INFO: `/v3/users/eaf6a2ea08d14a05ad65a01b59fc9510` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:58.191942 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d879d098-5a3a-4259-9742-e83b94b48b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:58.193050 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879d098-5a3a-4259-9742-e83b94b48b8a admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:58.193541 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879d098-5a3a-4259-9742-e83b94b48b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:58.194001 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879d098-5a3a-4259-9742-e83b94b48b8a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:58.195448 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d879d098-5a3a-4259-9742-e83b94b48b8a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:58.197446 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d879d098-5a3a-4259-9742-e83b94b48b8a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:58.204418 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 156/309] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:46:58 2021] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:58.204418 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20fb5f-1fbc-4d10-a718-e40efdbded36 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:58.204418 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20fb5f-1fbc-4d10-a718-e40efdbded36 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:58.204418 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20fb5f-1fbc-4d10-a718-e40efdbded36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:58.204833 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef6dd0-7886-4093-ab6d-be645ad57510 admin admin] RBAC: Authorizing `identity:get_user(user_id=eaf6a2ea08d14a05ad65a01b59fc9510)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:58.206447 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef6dd0-7886-4093-ab6d-be645ad57510 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:58.208386 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 154/310] 10.222.0.43 () {56 vars in 1198 bytes} [Fri Dec 24 04:46:58 2021] GET /identity/v3/users/eaf6a2ea08d14a05ad65a01b59fc9510 => generated 293 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:58.213527 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef6dd0-7886-4093-ab6d-be645ad57510 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:58.221902 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-7b20fb5f-1fbc-4d10-a718-e40efdbded36 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:46:58.223129 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-7b20fb5f-1fbc-4d10-a718-e40efdbded36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:46:58.223844 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef6dd0-7886-4093-ab6d-be645ad57510 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:58.228095 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a322ce-0533-4543-b6a4-83dce9cac1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:58.228818 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a322ce-0533-4543-b6a4-83dce9cac1c6 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:58.229097 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a322ce-0533-4543-b6a4-83dce9cac1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:58.229366 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a322ce-0533-4543-b6a4-83dce9cac1c6 admin admin] PATH_INFO: `/v3/groups` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:58.230075 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a322ce-0533-4543-b6a4-83dce9cac1c6 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:58.230837 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 157/311] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:46:58 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:46:58.231206 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING py.warnings [None req-16a322ce-0533-4543-b6a4-83dce9cac1c6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:46:58.231206 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: warnings.warn(msg) Dec 24 04:46:58.231206 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: Dec 24 04:46:58.232620 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a322ce-0533-4543-b6a4-83dce9cac1c6 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:58.237946 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20fb5f-1fbc-4d10-a718-e40efdbded36 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:58.248978 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20fb5f-1fbc-4d10-a718-e40efdbded36 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:58.249962 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 155/312] 10.222.0.43 () {60 vars in 1155 bytes} [Fri Dec 24 04:46:58 2021] POST /identity/v3/groups => generated 229 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:46:58.255084 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f0360-33ff-4d93-adb1-a426904fe75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:58.255810 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f0360-33ff-4d93-adb1-a426904fe75c admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:58.256094 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f0360-33ff-4d93-adb1-a426904fe75c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:58.256368 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f0360-33ff-4d93-adb1-a426904fe75c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:58.257270 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67f0360-33ff-4d93-adb1-a426904fe75c admin admin] RBAC: Adding query filter params (role.id=96d2300cdfbe46debbcc0eaab781246d, user.id=eaf6a2ea08d14a05ad65a01b59fc9510, scope.system=all) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:46:58.257579 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67f0360-33ff-4d93-adb1-a426904fe75c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:58.257670 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a322ce-0533-4543-b6a4-83dce9cac1c6 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:58.259493 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67f0360-33ff-4d93-adb1-a426904fe75c admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:58.266169 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 158/313] 10.222.0.43 () {56 vars in 1329 bytes} [Fri Dec 24 04:46:58 2021] GET /identity/v3/role_assignments?user.id=eaf6a2ea08d14a05ad65a01b59fc9510&scope.system=all&role.id=96d2300cdfbe46debbcc0eaab781246d => generated 226 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:58.271438 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a322ce-0533-4543-b6a4-83dce9cac1c6 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:58.275829 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da46d1-0e68-4503-9d49-6f89caf6957f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:58.276741 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da46d1-0e68-4503-9d49-6f89caf6957f admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:58.277023 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da46d1-0e68-4503-9d49-6f89caf6957f admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:58.277348 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da46d1-0e68-4503-9d49-6f89caf6957f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:58.291051 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da46d1-0e68-4503-9d49-6f89caf6957f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:46:58.298540 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-c8da46d1-0e68-4503-9d49-6f89caf6957f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 24 04:46:58.300224 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 156/314] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:46:58 2021] GET /identity/v3/roles/member => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:46:58.306856 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f0360-33ff-4d93-adb1-a426904fe75c admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:58.326740 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f0360-33ff-4d93-adb1-a426904fe75c admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:58.332887 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b004d2ab-127e-4391-bd97-7b2cf7c39c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:58.333701 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004d2ab-127e-4391-bd97-7b2cf7c39c99 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:58.334355 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004d2ab-127e-4391-bd97-7b2cf7c39c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:58.334698 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004d2ab-127e-4391-bd97-7b2cf7c39c99 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:58.335582 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b004d2ab-127e-4391-bd97-7b2cf7c39c99 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:46:58.335965 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b004d2ab-127e-4391-bd97-7b2cf7c39c99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:58.337836 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b004d2ab-127e-4391-bd97-7b2cf7c39c99 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:58.349268 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 159/315] 10.222.0.43 () {56 vars in 1122 bytes} [Fri Dec 24 04:46:58 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:46:58.355931 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da46d1-0e68-4503-9d49-6f89caf6957f admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:58.369160 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da46d1-0e68-4503-9d49-6f89caf6957f admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:58.374448 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbf0796-6619-4b53-9900-ef9d7a226f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:58.375401 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf0796-6619-4b53-9900-ef9d7a226f51 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:58.375710 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf0796-6619-4b53-9900-ef9d7a226f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:58.375957 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf0796-6619-4b53-9900-ef9d7a226f51 admin admin] PATH_INFO: `/v3/users/7727efd1b0a1448486dde1fbc90803cf` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:58.377424 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbf0796-6619-4b53-9900-ef9d7a226f51 admin admin] RBAC: Authorizing `identity:get_user(user_id=7727efd1b0a1448486dde1fbc90803cf)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:58.379766 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbf0796-6619-4b53-9900-ef9d7a226f51 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:58.381576 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 157/316] 10.222.0.43 () {56 vars in 1198 bytes} [Fri Dec 24 04:46:58 2021] GET /identity/v3/users/7727efd1b0a1448486dde1fbc90803cf => generated 293 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:46:58.388400 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b004d2ab-127e-4391-bd97-7b2cf7c39c99 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:46:58.399022 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b004d2ab-127e-4391-bd97-7b2cf7c39c99 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:46:58.403824 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c0218b-883d-4990-8477-b7ff8362a73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:46:58.405175 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0218b-883d-4990-8477-b7ff8362a73c admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:46:58.405454 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0218b-883d-4990-8477-b7ff8362a73c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:46:58.405730 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0218b-883d-4990-8477-b7ff8362a73c admin admin] PATH_INFO: `/v3/system/users/7727efd1b0a1448486dde1fbc90803cf/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:46:58.407424 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c0218b-883d-4990-8477-b7ff8362a73c admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7727efd1b0a1448486dde1fbc90803cf, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:46:58.408483 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING py.warnings [None req-68c0218b-883d-4990-8477-b7ff8362a73c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:46:58.408483 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: warnings.warn(msg) Dec 24 04:46:58.408483 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: Dec 24 04:46:58.409428 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c0218b-883d-4990-8477-b7ff8362a73c admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:46:58.421553 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 160/317] 10.222.0.43 () {58 vars in 1355 bytes} [Fri Dec 24 04:46:58 2021] PUT /identity/v3/system/users/7727efd1b0a1448486dde1fbc90803cf/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:47:00.616315 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b4f58-4c81-4e3b-b740-3f4eebd5a3ae None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:00.616855 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b4f58-4c81-4e3b-b740-3f4eebd5a3ae None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:00.616855 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b4f58-4c81-4e3b-b740-3f4eebd5a3ae None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:00.618728 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 158/318] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:00.624436 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9233eeb-5e5a-45ac-a655-8e6575dfc23d None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:00.624907 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9233eeb-5e5a-45ac-a655-8e6575dfc23d None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:00.624979 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9233eeb-5e5a-45ac-a655-8e6575dfc23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:00.643106 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-c9233eeb-5e5a-45ac-a655-8e6575dfc23d None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:00.644280 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-c9233eeb-5e5a-45ac-a655-8e6575dfc23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:00.652416 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 161/319] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:00 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:47:00.674955 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b4f58-4c81-4e3b-b740-3f4eebd5a3ae None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:00.676880 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea61ed-5eff-4e44-b69e-f355e3e4ffc0 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:00.677185 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea61ed-5eff-4e44-b69e-f355e3e4ffc0 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:00.677434 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea61ed-5eff-4e44-b69e-f355e3e4ffc0 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:00.679371 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 162/320] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:00.687272 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41b761-bc46-4f11-b350-3fb88907afd1 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:00.687520 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41b761-bc46-4f11-b350-3fb88907afd1 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:00.687819 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41b761-bc46-4f11-b350-3fb88907afd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:00.688685 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b4f58-4c81-4e3b-b740-3f4eebd5a3ae None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:00.692801 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc666efa-71e3-44f9-969e-f1b4ed035154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:00.693588 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc666efa-71e3-44f9-969e-f1b4ed035154 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:00.693857 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc666efa-71e3-44f9-969e-f1b4ed035154 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:00.694130 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc666efa-71e3-44f9-969e-f1b4ed035154 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:00.704389 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc666efa-71e3-44f9-969e-f1b4ed035154 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:47:00.707140 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-ac41b761-bc46-4f11-b350-3fb88907afd1 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:00.708360 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-ac41b761-bc46-4f11-b350-3fb88907afd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:00.711643 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-fc666efa-71e3-44f9-969e-f1b4ed035154 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 24 04:47:00.713023 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 159/321] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:47:00 2021] GET /identity/v3/roles/reader => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:00.716817 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 163/322] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:00 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 24 04:47:00.720634 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc666efa-71e3-44f9-969e-f1b4ed035154 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:00.729536 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc666efa-71e3-44f9-969e-f1b4ed035154 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:00.738311 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9747f8-4ca9-48e1-9757-4314ce3d1293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:00.738759 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b803b25-5386-4ca5-9da3-0e921e17d353 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:00.739081 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9747f8-4ca9-48e1-9757-4314ce3d1293 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:00.739189 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b803b25-5386-4ca5-9da3-0e921e17d353 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:00.739321 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9747f8-4ca9-48e1-9757-4314ce3d1293 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:00.739407 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b803b25-5386-4ca5-9da3-0e921e17d353 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:00.739596 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9747f8-4ca9-48e1-9757-4314ce3d1293 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:00.740424 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9747f8-4ca9-48e1-9757-4314ce3d1293 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:00.740762 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9747f8-4ca9-48e1-9757-4314ce3d1293 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:00.741287 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 164/323] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 24 04:47:00.741801 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b803b25-5386-4ca5-9da3-0e921e17d353 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:00.742421 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9747f8-4ca9-48e1-9757-4314ce3d1293 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:00.751958 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 160/324] 10.222.0.43 () {56 vars in 1122 bytes} [Fri Dec 24 04:47:00 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:00.753251 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e73c1-0a05-4038-ac42-5422aee4dac4 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:00.753542 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e73c1-0a05-4038-ac42-5422aee4dac4 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:00.753633 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b803b25-5386-4ca5-9da3-0e921e17d353 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:00.753822 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e73c1-0a05-4038-ac42-5422aee4dac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:00.757983 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ce019-5f22-4a37-a07e-1b02625731a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:00.758736 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ce019-5f22-4a37-a07e-1b02625731a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:00.759009 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ce019-5f22-4a37-a07e-1b02625731a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:00.759273 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ce019-5f22-4a37-a07e-1b02625731a5 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:00.760418 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71ce019-5f22-4a37-a07e-1b02625731a5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:00.762172 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71ce019-5f22-4a37-a07e-1b02625731a5 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:00.763782 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 165/325] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:00 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:00.764504 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ce019-5f22-4a37-a07e-1b02625731a5 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:00.771021 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-f48e73c1-0a05-4038-ac42-5422aee4dac4 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:00.772194 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-f48e73c1-0a05-4038-ac42-5422aee4dac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:00.777245 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ce019-5f22-4a37-a07e-1b02625731a5 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:00.780154 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 161/326] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:00 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:47:00.780936 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e73c1-0a05-4038-ac42-5422aee4dac4 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:00.783447 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16003f89-681c-4212-b721-3c1f809a1d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:00.784507 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16003f89-681c-4212-b721-3c1f809a1d0c admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:00.784974 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16003f89-681c-4212-b721-3c1f809a1d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:00.785578 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16003f89-681c-4212-b721-3c1f809a1d0c admin admin] PATH_INFO: `/v3/users/eaf6a2ea08d14a05ad65a01b59fc9510` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:00.787599 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16003f89-681c-4212-b721-3c1f809a1d0c admin admin] RBAC: Authorizing `identity:get_user(user_id=eaf6a2ea08d14a05ad65a01b59fc9510)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:00.789980 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e73c1-0a05-4038-ac42-5422aee4dac4 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:00.790355 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16003f89-681c-4212-b721-3c1f809a1d0c admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:00.792260 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 166/327] 10.222.0.43 () {56 vars in 1198 bytes} [Fri Dec 24 04:47:00 2021] GET /identity/v3/users/eaf6a2ea08d14a05ad65a01b59fc9510 => generated 293 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:00.794434 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7b1a5-191c-4266-8a06-884940a60254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:00.795096 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7b1a5-191c-4266-8a06-884940a60254 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:00.795350 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7b1a5-191c-4266-8a06-884940a60254 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:00.795628 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7b1a5-191c-4266-8a06-884940a60254 admin admin] PATH_INFO: `/v3/groups` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:00.796318 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e7b1a5-191c-4266-8a06-884940a60254 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:00.798162 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16003f89-681c-4212-b721-3c1f809a1d0c admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:00.798275 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e7b1a5-191c-4266-8a06-884940a60254 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:00.810383 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16003f89-681c-4212-b721-3c1f809a1d0c admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:00.812433 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 162/328] 10.222.0.43 () {60 vars in 1155 bytes} [Fri Dec 24 04:47:00 2021] POST /identity/v3/groups => generated 226 bytes in 32 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:47:00.813240 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7b1a5-191c-4266-8a06-884940a60254 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:00.815192 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec16d49-f22a-44ac-a899-cc37fdf6bba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:00.816050 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec16d49-f22a-44ac-a899-cc37fdf6bba3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:00.816327 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec16d49-f22a-44ac-a899-cc37fdf6bba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:00.816629 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec16d49-f22a-44ac-a899-cc37fdf6bba3 admin admin] PATH_INFO: `/v3/system/users/eaf6a2ea08d14a05ad65a01b59fc9510/roles/96d2300cdfbe46debbcc0eaab781246d` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:00.818192 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec16d49-f22a-44ac-a899-cc37fdf6bba3 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=eaf6a2ea08d14a05ad65a01b59fc9510, role_id=96d2300cdfbe46debbcc0eaab781246d)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:00.819837 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec16d49-f22a-44ac-a899-cc37fdf6bba3 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:00.822633 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7b1a5-191c-4266-8a06-884940a60254 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:00.827909 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a1511c-e576-44bb-a91a-0f84c545dfe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:00.828147 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 167/329] 10.222.0.43 () {58 vars in 1355 bytes} [Fri Dec 24 04:47:00 2021] PUT /identity/v3/system/users/eaf6a2ea08d14a05ad65a01b59fc9510/roles/96d2300cdfbe46debbcc0eaab781246d => generated 0 bytes in 30 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 04:47:00.828859 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1511c-e576-44bb-a91a-0f84c545dfe2 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:00.829281 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1511c-e576-44bb-a91a-0f84c545dfe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:00.829623 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1511c-e576-44bb-a91a-0f84c545dfe2 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:00.843637 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a1511c-e576-44bb-a91a-0f84c545dfe2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:47:00.850865 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-96a1511c-e576-44bb-a91a-0f84c545dfe2 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 24 04:47:00.852357 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 163/330] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:47:00 2021] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:00.859209 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec16d49-f22a-44ac-a899-cc37fdf6bba3 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:00.869466 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec16d49-f22a-44ac-a899-cc37fdf6bba3 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:00.874417 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e76c85-59ae-44be-bcb3-56c99ac925fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:00.875101 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e76c85-59ae-44be-bcb3-56c99ac925fe admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:00.875377 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e76c85-59ae-44be-bcb3-56c99ac925fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:00.875645 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e76c85-59ae-44be-bcb3-56c99ac925fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:00.876428 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e76c85-59ae-44be-bcb3-56c99ac925fe admin admin] RBAC: Adding query filter params (name=member) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:00.876764 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e76c85-59ae-44be-bcb3-56c99ac925fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:00.878425 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e76c85-59ae-44be-bcb3-56c99ac925fe admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:00.888732 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 168/331] 10.222.0.43 () {56 vars in 1122 bytes} [Fri Dec 24 04:47:00 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:00.895061 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a1511c-e576-44bb-a91a-0f84c545dfe2 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:00.906566 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a1511c-e576-44bb-a91a-0f84c545dfe2 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:00.911717 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a5375-d0a9-428b-ad8c-0699d7124fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:00.912646 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a5375-d0a9-428b-ad8c-0699d7124fde admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:00.912918 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a5375-d0a9-428b-ad8c-0699d7124fde admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:00.913171 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a5375-d0a9-428b-ad8c-0699d7124fde admin admin] PATH_INFO: `/v3/users/7727efd1b0a1448486dde1fbc90803cf` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:00.914561 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4a5375-d0a9-428b-ad8c-0699d7124fde admin admin] RBAC: Authorizing `identity:get_user(user_id=7727efd1b0a1448486dde1fbc90803cf)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:00.916849 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4a5375-d0a9-428b-ad8c-0699d7124fde admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:00.918871 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 164/332] 10.222.0.43 () {56 vars in 1198 bytes} [Fri Dec 24 04:47:00 2021] GET /identity/v3/users/7727efd1b0a1448486dde1fbc90803cf => generated 293 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:00.925589 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e76c85-59ae-44be-bcb3-56c99ac925fe admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:00.936494 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e76c85-59ae-44be-bcb3-56c99ac925fe admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:00.941547 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa28315a-034c-43d1-bea2-d6e76eddea33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:00.942236 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28315a-034c-43d1-bea2-d6e76eddea33 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:00.942519 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28315a-034c-43d1-bea2-d6e76eddea33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:00.942794 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28315a-034c-43d1-bea2-d6e76eddea33 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:00.943655 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa28315a-034c-43d1-bea2-d6e76eddea33 admin admin] RBAC: Adding query filter params (role.id=19e41972301c400193cf0c53e0462e49, user.id=7727efd1b0a1448486dde1fbc90803cf, scope.system=all) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:00.943970 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa28315a-034c-43d1-bea2-d6e76eddea33 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:00.945942 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa28315a-034c-43d1-bea2-d6e76eddea33 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:00.968086 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 169/333] 10.222.0.43 () {56 vars in 1329 bytes} [Fri Dec 24 04:47:00 2021] GET /identity/v3/role_assignments?user.id=7727efd1b0a1448486dde1fbc90803cf&scope.system=all&role.id=19e41972301c400193cf0c53e0462e49 => generated 510 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:03.590697 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea39422a-58fa-4ce3-946d-3ddf2ebdf55f None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:03.591555 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea39422a-58fa-4ce3-946d-3ddf2ebdf55f None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:03.591555 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea39422a-58fa-4ce3-946d-3ddf2ebdf55f None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:03.593159 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 165/334] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:03.599429 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb0e69-ea67-4fda-b1b5-e2f8a8fd2c37 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:03.600291 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb0e69-ea67-4fda-b1b5-e2f8a8fd2c37 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:03.600791 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb0e69-ea67-4fda-b1b5-e2f8a8fd2c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:03.624383 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-0fdb0e69-ea67-4fda-b1b5-e2f8a8fd2c37 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:03.626145 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-0fdb0e69-ea67-4fda-b1b5-e2f8a8fd2c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:03.639398 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 170/335] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:03 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:47:03.686620 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea39422a-58fa-4ce3-946d-3ddf2ebdf55f None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:03.702155 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea39422a-58fa-4ce3-946d-3ddf2ebdf55f None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:03.712869 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fcb42a-9232-40ce-9d77-4aacbd38d78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:03.713668 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fcb42a-9232-40ce-9d77-4aacbd38d78a admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:03.713952 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fcb42a-9232-40ce-9d77-4aacbd38d78a admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:03.714221 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fcb42a-9232-40ce-9d77-4aacbd38d78a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:03.730724 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fcb42a-9232-40ce-9d77-4aacbd38d78a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:47:03.739281 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-c6fcb42a-9232-40ce-9d77-4aacbd38d78a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 24 04:47:03.744757 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 166/336] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:47:03 2021] GET /identity/v3/roles/member => generated 84 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:03.747604 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb0e69-ea67-4fda-b1b5-e2f8a8fd2c37 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:03.762861 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb0e69-ea67-4fda-b1b5-e2f8a8fd2c37 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:03.772731 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a3988-78b3-49ea-b321-f9d9cadfdc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:03.773814 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a3988-78b3-49ea-b321-f9d9cadfdc1b admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:03.774364 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a3988-78b3-49ea-b321-f9d9cadfdc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:03.774828 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a3988-78b3-49ea-b321-f9d9cadfdc1b admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:03.775801 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a3988-78b3-49ea-b321-f9d9cadfdc1b admin admin] RBAC: Adding query filter params (name=member) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:03.776339 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a3988-78b3-49ea-b321-f9d9cadfdc1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:03.778172 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a3988-78b3-49ea-b321-f9d9cadfdc1b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:03.795977 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 171/337] 10.222.0.43 () {56 vars in 1122 bytes} [Fri Dec 24 04:47:03 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:03.802293 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fcb42a-9232-40ce-9d77-4aacbd38d78a admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:03.811678 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eddbec-4806-45bf-acd9-bde70e9899a0 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:03.812605 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eddbec-4806-45bf-acd9-bde70e9899a0 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:03.813084 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eddbec-4806-45bf-acd9-bde70e9899a0 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:03.814558 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fcb42a-9232-40ce-9d77-4aacbd38d78a admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:03.815639 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 172/338] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:03 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:03.820853 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077be86-44d7-41b7-8b73-7c9e29ea0a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:03.821501 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077be86-44d7-41b7-8b73-7c9e29ea0a45 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:03.821785 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077be86-44d7-41b7-8b73-7c9e29ea0a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:03.822060 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077be86-44d7-41b7-8b73-7c9e29ea0a45 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:03.822819 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f77bb-fe2c-45cc-97fc-8788502cd38a None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:03.823293 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f77bb-fe2c-45cc-97fc-8788502cd38a None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:03.823766 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f77bb-fe2c-45cc-97fc-8788502cd38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:03.839015 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1077be86-44d7-41b7-8b73-7c9e29ea0a45 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:03.840977 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1077be86-44d7-41b7-8b73-7c9e29ea0a45 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:03.844031 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-3e7f77bb-fe2c-45cc-97fc-8788502cd38a None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:03.845656 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-3e7f77bb-fe2c-45cc-97fc-8788502cd38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:03.854341 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 167/339] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:47:03 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 24 04:47:03.854873 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 173/340] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:03 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 24 04:47:03.861027 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077be86-44d7-41b7-8b73-7c9e29ea0a45 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:03.874068 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077be86-44d7-41b7-8b73-7c9e29ea0a45 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:03.881354 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f77bb-fe2c-45cc-97fc-8788502cd38a None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:03.890792 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f41d01-84ae-414c-b08a-31e620816da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:03.890792 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f41d01-84ae-414c-b08a-31e620816da6 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:03.890792 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f41d01-84ae-414c-b08a-31e620816da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:03.890792 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f41d01-84ae-414c-b08a-31e620816da6 admin admin] PATH_INFO: `/v3/projects/036a37ec848b4c9bb369e71b5c2453c7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:03.893049 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f41d01-84ae-414c-b08a-31e620816da6 admin admin] RBAC: Authorizing `identity:get_project(project_id=036a37ec848b4c9bb369e71b5c2453c7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:03.895275 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f41d01-84ae-414c-b08a-31e620816da6 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:03.898724 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f77bb-fe2c-45cc-97fc-8788502cd38a None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:03.905171 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 168/341] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:47:03 2021] GET /identity/v3/projects/036a37ec848b4c9bb369e71b5c2453c7 => generated 298 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:03.908546 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e15dbe-585a-41f3-9262-a7e946af1fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:03.909520 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e15dbe-585a-41f3-9262-a7e946af1fff admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:03.909965 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e15dbe-585a-41f3-9262-a7e946af1fff admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:03.910374 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e15dbe-585a-41f3-9262-a7e946af1fff admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:03.921034 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b18ee4-4f49-4cf3-a0a9-60a479488a54 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:03.921529 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b18ee4-4f49-4cf3-a0a9-60a479488a54 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:03.921945 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b18ee4-4f49-4cf3-a0a9-60a479488a54 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:03.924244 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 169/342] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 24 04:47:03.925182 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b18ee4-4f49-4cf3-a0a9-60a479488a54 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:03.925579 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e15dbe-585a-41f3-9262-a7e946af1fff admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:47:03.932842 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-00e15dbe-585a-41f3-9262-a7e946af1fff admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 24 04:47:03.934185 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 174/343] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:47:03 2021] GET /identity/v3/roles/member => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:47:03.935600 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70e469-61ba-4cc7-ae34-71c26d0f73b9 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:03.936061 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70e469-61ba-4cc7-ae34-71c26d0f73b9 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:03.936456 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70e469-61ba-4cc7-ae34-71c26d0f73b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:03.954161 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b18ee4-4f49-4cf3-a0a9-60a479488a54 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:03.963590 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c7636-1a7b-4395-b947-c59e31920186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:03.964761 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c7636-1a7b-4395-b947-c59e31920186 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:03.965184 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c7636-1a7b-4395-b947-c59e31920186 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:03.965598 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c7636-1a7b-4395-b947-c59e31920186 admin admin] PATH_INFO: `/v3/groups/32939ca35fa249848108ba3789f4aaa1` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:03.973678 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-2e70e469-61ba-4cc7-ae34-71c26d0f73b9 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:03.974277 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288c7636-1a7b-4395-b947-c59e31920186 admin admin] RBAC: Authorizing `identity:get_group(group_id=32939ca35fa249848108ba3789f4aaa1)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:03.974901 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-2e70e469-61ba-4cc7-ae34-71c26d0f73b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:03.975665 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING py.warnings [None req-288c7636-1a7b-4395-b947-c59e31920186 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:47:03.975665 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: warnings.warn(msg) Dec 24 04:47:03.975665 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: Dec 24 04:47:03.977293 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288c7636-1a7b-4395-b947-c59e31920186 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:03.979241 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 170/344] 10.222.0.43 () {56 vars in 1201 bytes} [Fri Dec 24 04:47:03 2021] GET /identity/v3/groups/32939ca35fa249848108ba3789f4aaa1 => generated 226 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:03.980956 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c7636-1a7b-4395-b947-c59e31920186 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:03.996627 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 175/345] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:03 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 24 04:47:03.998114 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70e469-61ba-4cc7-ae34-71c26d0f73b9 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:04.006450 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c7636-1a7b-4395-b947-c59e31920186 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:04.018796 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70e469-61ba-4cc7-ae34-71c26d0f73b9 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:04.020132 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29338a60-8438-4d2f-80ff-eea29f102989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:04.021066 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29338a60-8438-4d2f-80ff-eea29f102989 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:04.021522 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29338a60-8438-4d2f-80ff-eea29f102989 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:04.021964 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29338a60-8438-4d2f-80ff-eea29f102989 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:04.022905 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29338a60-8438-4d2f-80ff-eea29f102989 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:04.024098 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29338a60-8438-4d2f-80ff-eea29f102989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:04.026271 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29338a60-8438-4d2f-80ff-eea29f102989 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:04.035501 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6a7f6f-37cc-4e38-8bcc-bf62ae7a5421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:04.036414 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a7f6f-37cc-4e38-8bcc-bf62ae7a5421 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:04.036889 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a7f6f-37cc-4e38-8bcc-bf62ae7a5421 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:04.037355 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a7f6f-37cc-4e38-8bcc-bf62ae7a5421 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:04.038383 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6a7f6f-37cc-4e38-8bcc-bf62ae7a5421 admin admin] RBAC: Adding query filter params (group.id=32939ca35fa249848108ba3789f4aaa1, role.id=19e41972301c400193cf0c53e0462e49, scope.project.id=036a37ec848b4c9bb369e71b5c2453c7) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:04.038865 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6a7f6f-37cc-4e38-8bcc-bf62ae7a5421 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:04.040926 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6a7f6f-37cc-4e38-8bcc-bf62ae7a5421 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:04.052720 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 176/346] 10.222.0.43 () {56 vars in 1397 bytes} [Fri Dec 24 04:47:03 2021] GET /identity/v3/role_assignments?group.id=32939ca35fa249848108ba3789f4aaa1&scope.project.id=036a37ec848b4c9bb369e71b5c2453c7&role.id=19e41972301c400193cf0c53e0462e49 => generated 260 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:04.054056 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 171/347] 10.222.0.43 () {56 vars in 1122 bytes} [Fri Dec 24 04:47:03 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:04.060378 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6a7f6f-37cc-4e38-8bcc-bf62ae7a5421 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:04.073880 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6a7f6f-37cc-4e38-8bcc-bf62ae7a5421 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:04.080827 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29338a60-8438-4d2f-80ff-eea29f102989 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:04.082608 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea1ccf7-d9dc-4481-abe4-d576fcec92fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:04.083482 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1ccf7-d9dc-4481-abe4-d576fcec92fe admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:04.084233 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1ccf7-d9dc-4481-abe4-d576fcec92fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:04.084690 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1ccf7-d9dc-4481-abe4-d576fcec92fe admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:04.097162 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29338a60-8438-4d2f-80ff-eea29f102989 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:04.098777 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea1ccf7-d9dc-4481-abe4-d576fcec92fe admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:04.100725 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea1ccf7-d9dc-4481-abe4-d576fcec92fe admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:04.109441 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856494d7-a5c0-4dfa-b071-9261d2b68cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:04.110404 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856494d7-a5c0-4dfa-b071-9261d2b68cde admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:04.110777 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856494d7-a5c0-4dfa-b071-9261d2b68cde admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:04.111145 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856494d7-a5c0-4dfa-b071-9261d2b68cde admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:04.115607 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 177/348] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:47:04 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 24 04:47:04.123884 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea1ccf7-d9dc-4481-abe4-d576fcec92fe admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:04.133656 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856494d7-a5c0-4dfa-b071-9261d2b68cde admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:47:04.138235 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea1ccf7-d9dc-4481-abe4-d576fcec92fe admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:04.141078 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-856494d7-a5c0-4dfa-b071-9261d2b68cde admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 24 04:47:04.142748 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 172/349] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:47:04 2021] GET /identity/v3/roles/reader => generated 84 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:04.144104 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878856af-5452-472b-8085-1c2b39c90e0a None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:04.144481 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878856af-5452-472b-8085-1c2b39c90e0a None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:04.144887 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878856af-5452-472b-8085-1c2b39c90e0a None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:04.146922 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 173/350] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:04.147755 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2059b7-bd47-4ac7-98c2-65d9a3ceaa3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:04.148948 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2059b7-bd47-4ac7-98c2-65d9a3ceaa3e admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:04.149360 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2059b7-bd47-4ac7-98c2-65d9a3ceaa3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:04.149775 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2059b7-bd47-4ac7-98c2-65d9a3ceaa3e admin admin] PATH_INFO: `/v3/projects/74b19d07d8a647c7af2381d4e80089ad` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:04.151492 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2059b7-bd47-4ac7-98c2-65d9a3ceaa3e admin admin] RBAC: Authorizing `identity:get_project(project_id=74b19d07d8a647c7af2381d4e80089ad)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:04.153484 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878856af-5452-472b-8085-1c2b39c90e0a None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:04.154129 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2059b7-bd47-4ac7-98c2-65d9a3ceaa3e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:04.157354 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 178/351] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:47:04 2021] GET /identity/v3/projects/74b19d07d8a647c7af2381d4e80089ad => generated 302 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:04.158985 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093595e5-0bb9-4ac6-b336-3e57661a6309 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:04.159539 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093595e5-0bb9-4ac6-b336-3e57661a6309 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:04.160012 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093595e5-0bb9-4ac6-b336-3e57661a6309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:04.177207 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878856af-5452-472b-8085-1c2b39c90e0a None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:04.189983 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-093595e5-0bb9-4ac6-b336-3e57661a6309 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:04.191831 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-093595e5-0bb9-4ac6-b336-3e57661a6309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:04.193278 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f527638d-6e3b-437d-bb22-f64484d1f1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:04.194217 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527638d-6e3b-437d-bb22-f64484d1f1df admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:04.194689 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527638d-6e3b-437d-bb22-f64484d1f1df admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:04.195131 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527638d-6e3b-437d-bb22-f64484d1f1df admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:04.196100 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f527638d-6e3b-437d-bb22-f64484d1f1df admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:04.196622 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f527638d-6e3b-437d-bb22-f64484d1f1df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:04.199536 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f527638d-6e3b-437d-bb22-f64484d1f1df admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:04.216619 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 179/352] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:04 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:47:04.218090 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093595e5-0bb9-4ac6-b336-3e57661a6309 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:04.225066 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 174/353] 10.222.0.43 () {56 vars in 1122 bytes} [Fri Dec 24 04:47:04 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:04.233542 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093595e5-0bb9-4ac6-b336-3e57661a6309 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:04.234889 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f527638d-6e3b-437d-bb22-f64484d1f1df admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:04.239676 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815df95-3944-4ba1-ab4a-ea064343a873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:04.240572 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815df95-3944-4ba1-ab4a-ea064343a873 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:04.240857 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815df95-3944-4ba1-ab4a-ea064343a873 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:04.241126 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815df95-3944-4ba1-ab4a-ea064343a873 admin admin] PATH_INFO: `/v3/groups/32939ca35fa249848108ba3789f4aaa1` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:04.246565 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815df95-3944-4ba1-ab4a-ea064343a873 admin admin] RBAC: Authorizing `identity:get_group(group_id=32939ca35fa249848108ba3789f4aaa1)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:04.246565 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING py.warnings [None req-a815df95-3944-4ba1-ab4a-ea064343a873 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:47:04.246565 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: warnings.warn(msg) Dec 24 04:47:04.246565 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: Dec 24 04:47:04.246565 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815df95-3944-4ba1-ab4a-ea064343a873 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:04.247091 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 180/354] 10.222.0.43 () {56 vars in 1201 bytes} [Fri Dec 24 04:47:04 2021] GET /identity/v3/groups/32939ca35fa249848108ba3789f4aaa1 => generated 226 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:04.253315 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815df95-3944-4ba1-ab4a-ea064343a873 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:04.262141 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f527638d-6e3b-437d-bb22-f64484d1f1df admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:04.274031 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815df95-3944-4ba1-ab4a-ea064343a873 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:04.274825 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab9eada-8af6-44c3-aaa0-3254d16acdf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:04.275716 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9eada-8af6-44c3-aaa0-3254d16acdf9 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:04.275996 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9eada-8af6-44c3-aaa0-3254d16acdf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:04.276267 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9eada-8af6-44c3-aaa0-3254d16acdf9 admin admin] PATH_INFO: `/v3/users/eaf6a2ea08d14a05ad65a01b59fc9510` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:04.277609 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab9eada-8af6-44c3-aaa0-3254d16acdf9 admin admin] RBAC: Authorizing `identity:get_user(user_id=eaf6a2ea08d14a05ad65a01b59fc9510)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:04.280020 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab9eada-8af6-44c3-aaa0-3254d16acdf9 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:04.282261 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 175/355] 10.222.0.43 () {56 vars in 1198 bytes} [Fri Dec 24 04:47:04 2021] GET /identity/v3/users/eaf6a2ea08d14a05ad65a01b59fc9510 => generated 293 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:04.283712 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c80e63-3a7c-4b95-a067-24b6620ee331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:04.284964 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c80e63-3a7c-4b95-a067-24b6620ee331 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:04.285446 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c80e63-3a7c-4b95-a067-24b6620ee331 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:04.285958 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c80e63-3a7c-4b95-a067-24b6620ee331 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:04.292569 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab9eada-8af6-44c3-aaa0-3254d16acdf9 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:04.300163 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab9eada-8af6-44c3-aaa0-3254d16acdf9 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:04.310501 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c80e63-3a7c-4b95-a067-24b6620ee331 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:47:04.319912 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-78c80e63-3a7c-4b95-a067-24b6620ee331 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 24 04:47:04.321331 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb45b6-ccb7-447f-81aa-53b4c66de19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:04.321836 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 181/356] 10.222.0.43 () {56 vars in 1135 bytes} [Fri Dec 24 04:47:04 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:04.324098 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb45b6-ccb7-447f-81aa-53b4c66de19e admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:04.324098 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb45b6-ccb7-447f-81aa-53b4c66de19e admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:04.324098 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb45b6-ccb7-447f-81aa-53b4c66de19e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:04.324098 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abb45b6-ccb7-447f-81aa-53b4c66de19e admin admin] RBAC: Adding query filter params (group.id=32939ca35fa249848108ba3789f4aaa1, role.id=19e41972301c400193cf0c53e0462e49, scope.project.id=74b19d07d8a647c7af2381d4e80089ad) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:04.324098 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abb45b6-ccb7-447f-81aa-53b4c66de19e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:04.325632 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c80e63-3a7c-4b95-a067-24b6620ee331 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:04.330791 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abb45b6-ccb7-447f-81aa-53b4c66de19e admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:04.343270 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c80e63-3a7c-4b95-a067-24b6620ee331 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:04.345699 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 176/357] 10.222.0.43 () {56 vars in 1397 bytes} [Fri Dec 24 04:47:04 2021] GET /identity/v3/role_assignments?group.id=32939ca35fa249848108ba3789f4aaa1&scope.project.id=74b19d07d8a647c7af2381d4e80089ad&role.id=19e41972301c400193cf0c53e0462e49 => generated 260 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:04.346959 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb45b6-ccb7-447f-81aa-53b4c66de19e admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:04.360713 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674b158-8adc-410c-94c0-b0ea95532ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:04.362668 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674b158-8adc-410c-94c0-b0ea95532ddb admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:04.363843 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674b158-8adc-410c-94c0-b0ea95532ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:04.364324 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674b158-8adc-410c-94c0-b0ea95532ddb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:04.366696 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a674b158-8adc-410c-94c0-b0ea95532ddb admin admin] RBAC: Adding query filter params (role.id=96d2300cdfbe46debbcc0eaab781246d, user.id=eaf6a2ea08d14a05ad65a01b59fc9510, scope.system=all) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:04.367629 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a674b158-8adc-410c-94c0-b0ea95532ddb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:04.370096 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a674b158-8adc-410c-94c0-b0ea95532ddb admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:04.370418 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb45b6-ccb7-447f-81aa-53b4c66de19e admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:04.379931 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8467dd-b610-4161-a028-6f8c9836be5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:04.381050 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8467dd-b610-4161-a028-6f8c9836be5b admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:04.381546 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8467dd-b610-4161-a028-6f8c9836be5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:04.382023 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8467dd-b610-4161-a028-6f8c9836be5b admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:04.383010 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8467dd-b610-4161-a028-6f8c9836be5b admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:04.383506 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8467dd-b610-4161-a028-6f8c9836be5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:04.385375 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8467dd-b610-4161-a028-6f8c9836be5b admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:04.392560 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 182/358] 10.222.0.43 () {56 vars in 1329 bytes} [Fri Dec 24 04:47:04 2021] GET /identity/v3/role_assignments?user.id=eaf6a2ea08d14a05ad65a01b59fc9510&scope.system=all&role.id=96d2300cdfbe46debbcc0eaab781246d => generated 510 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:04.401465 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 177/359] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Dec 24 04:47:04 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:04.407538 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674b158-8adc-410c-94c0-b0ea95532ddb admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:04.418647 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674b158-8adc-410c-94c0-b0ea95532ddb admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:04.423470 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe69ca6-2431-4337-8ef3-5f101c4b84e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:04.424141 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe69ca6-2431-4337-8ef3-5f101c4b84e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:04.424414 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe69ca6-2431-4337-8ef3-5f101c4b84e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:04.424731 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe69ca6-2431-4337-8ef3-5f101c4b84e2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:04.433615 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe69ca6-2431-4337-8ef3-5f101c4b84e2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:04.435536 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe69ca6-2431-4337-8ef3-5f101c4b84e2 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:04.445995 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 183/360] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:47:04 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 24 04:47:04.452963 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8467dd-b610-4161-a028-6f8c9836be5b admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:04.464888 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8467dd-b610-4161-a028-6f8c9836be5b admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:04.469943 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b92d5ec-5aed-4775-9c5b-ab5f3ff9d96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:04.470818 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92d5ec-5aed-4775-9c5b-ab5f3ff9d96e admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:04.471097 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92d5ec-5aed-4775-9c5b-ab5f3ff9d96e admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:04.471369 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92d5ec-5aed-4775-9c5b-ab5f3ff9d96e admin admin] PATH_INFO: `/v3/projects/036a37ec848b4c9bb369e71b5c2453c7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:04.472726 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b92d5ec-5aed-4775-9c5b-ab5f3ff9d96e admin admin] RBAC: Authorizing `identity:get_project(project_id=036a37ec848b4c9bb369e71b5c2453c7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:04.474917 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b92d5ec-5aed-4775-9c5b-ab5f3ff9d96e admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:04.476775 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 178/361] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:47:04 2021] GET /identity/v3/projects/036a37ec848b4c9bb369e71b5c2453c7 => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:04.483603 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe69ca6-2431-4337-8ef3-5f101c4b84e2 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:04.493166 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe69ca6-2431-4337-8ef3-5f101c4b84e2 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:04.497867 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d87a983-4ced-4139-b862-4629bfa6d119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:04.498794 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87a983-4ced-4139-b862-4629bfa6d119 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:04.499069 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87a983-4ced-4139-b862-4629bfa6d119 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:04.499339 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87a983-4ced-4139-b862-4629bfa6d119 admin admin] PATH_INFO: `/v3/groups/32939ca35fa249848108ba3789f4aaa1` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:04.500781 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d87a983-4ced-4139-b862-4629bfa6d119 admin admin] RBAC: Authorizing `identity:get_group(group_id=32939ca35fa249848108ba3789f4aaa1)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:04.502751 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d87a983-4ced-4139-b862-4629bfa6d119 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:04.504760 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 184/362] 10.222.0.43 () {56 vars in 1201 bytes} [Fri Dec 24 04:47:04 2021] GET /identity/v3/groups/32939ca35fa249848108ba3789f4aaa1 => generated 226 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:04.511085 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b92d5ec-5aed-4775-9c5b-ab5f3ff9d96e admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:04.521523 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b92d5ec-5aed-4775-9c5b-ab5f3ff9d96e admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:04.526198 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd00a8b-e69a-41ed-bd9a-3f3804981cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:04.526858 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd00a8b-e69a-41ed-bd9a-3f3804981cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:04.527185 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd00a8b-e69a-41ed-bd9a-3f3804981cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:04.527459 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd00a8b-e69a-41ed-bd9a-3f3804981cd5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:04.528316 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd00a8b-e69a-41ed-bd9a-3f3804981cd5 admin admin] RBAC: Adding query filter params (group.id=32939ca35fa249848108ba3789f4aaa1, role.id=62790996bc274dda9199846ea736d771, scope.project.id=036a37ec848b4c9bb369e71b5c2453c7) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:04.528695 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd00a8b-e69a-41ed-bd9a-3f3804981cd5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:04.530725 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd00a8b-e69a-41ed-bd9a-3f3804981cd5 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:04.537429 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 179/363] 10.222.0.43 () {56 vars in 1397 bytes} [Fri Dec 24 04:47:04 2021] GET /identity/v3/role_assignments?group.id=32939ca35fa249848108ba3789f4aaa1&scope.project.id=036a37ec848b4c9bb369e71b5c2453c7&role.id=62790996bc274dda9199846ea736d771 => generated 260 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:05.714271 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9fe56d-5f98-4653-8f09-4f57297f0568 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:05.714954 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9fe56d-5f98-4653-8f09-4f57297f0568 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:05.714954 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9fe56d-5f98-4653-8f09-4f57297f0568 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:05.716992 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 185/364] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:05.723102 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f94186-4171-468b-bd6f-e4e7b3afb5e9 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:05.723604 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f94186-4171-468b-bd6f-e4e7b3afb5e9 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:05.723766 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f94186-4171-468b-bd6f-e4e7b3afb5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:05.745581 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-71f94186-4171-468b-bd6f-e4e7b3afb5e9 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:05.746784 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-71f94186-4171-468b-bd6f-e4e7b3afb5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:05.755036 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 180/365] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:05 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:47:05.757689 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e46d6-737b-4824-a5b8-4439b99194bf None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:05.757974 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e46d6-737b-4824-a5b8-4439b99194bf None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:05.758250 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e46d6-737b-4824-a5b8-4439b99194bf None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:05.760008 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 186/366] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:05.766203 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e45b9-f48f-42ad-894f-13b93c15ec24 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:05.766494 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e45b9-f48f-42ad-894f-13b93c15ec24 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:05.766771 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e45b9-f48f-42ad-894f-13b93c15ec24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:05.783241 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e46d6-737b-4824-a5b8-4439b99194bf None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:05.797438 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-a51e45b9-f48f-42ad-894f-13b93c15ec24 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:05.798655 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-a51e45b9-f48f-42ad-894f-13b93c15ec24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:05.803712 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e46d6-737b-4824-a5b8-4439b99194bf None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:05.814119 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b970b2d4-89a3-4e58-b494-0a41b82e1e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:05.815424 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 181/367] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:05 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:47:05.816937 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970b2d4-89a3-4e58-b494-0a41b82e1e48 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:05.817821 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970b2d4-89a3-4e58-b494-0a41b82e1e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:05.818290 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970b2d4-89a3-4e58-b494-0a41b82e1e48 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:05.831104 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b970b2d4-89a3-4e58-b494-0a41b82e1e48 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:47:05.839206 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-b970b2d4-89a3-4e58-b494-0a41b82e1e48 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 24 04:47:05.844885 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 187/368] 10.222.0.43 () {56 vars in 1135 bytes} [Fri Dec 24 04:47:05 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:05.847909 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e45b9-f48f-42ad-894f-13b93c15ec24 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:05.849413 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b970b2d4-89a3-4e58-b494-0a41b82e1e48 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:05.865268 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e45b9-f48f-42ad-894f-13b93c15ec24 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:05.869400 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b970b2d4-89a3-4e58-b494-0a41b82e1e48 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:05.875098 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb8bb6-50fd-4b02-9f27-ce406652824d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:05.876484 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb8bb6-50fd-4b02-9f27-ce406652824d admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:05.878236 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb8bb6-50fd-4b02-9f27-ce406652824d admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:05.878713 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb8bb6-50fd-4b02-9f27-ce406652824d admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:05.879484 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d864b1-e2c6-428a-bfaf-9e0cc1dc19e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:05.880486 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cb8bb6-50fd-4b02-9f27-ce406652824d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:05.881043 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cb8bb6-50fd-4b02-9f27-ce406652824d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:05.881454 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d864b1-e2c6-428a-bfaf-9e0cc1dc19e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:05.881742 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d864b1-e2c6-428a-bfaf-9e0cc1dc19e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:05.882018 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d864b1-e2c6-428a-bfaf-9e0cc1dc19e9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:05.883510 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cb8bb6-50fd-4b02-9f27-ce406652824d admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:05.905659 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 182/369] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Dec 24 04:47:05 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:05.906967 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d864b1-e2c6-428a-bfaf-9e0cc1dc19e9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:47:05.908116 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb8bb6-50fd-4b02-9f27-ce406652824d admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:05.922493 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-a5d864b1-e2c6-428a-bfaf-9e0cc1dc19e9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 24 04:47:05.927001 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb8bb6-50fd-4b02-9f27-ce406652824d admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:05.928403 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 188/370] 10.222.0.43 () {56 vars in 1117 bytes} [Fri Dec 24 04:47:05 2021] GET /identity/v3/roles/admin => generated 83 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:47:05.934870 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d864b1-e2c6-428a-bfaf-9e0cc1dc19e9 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:05.936423 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df3dfa7-3610-4ed8-a7e6-50b73c0765ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:05.937193 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3dfa7-3610-4ed8-a7e6-50b73c0765ed admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:05.937480 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3dfa7-3610-4ed8-a7e6-50b73c0765ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:05.937756 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3dfa7-3610-4ed8-a7e6-50b73c0765ed admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:05.946246 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df3dfa7-3610-4ed8-a7e6-50b73c0765ed admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:05.948005 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df3dfa7-3610-4ed8-a7e6-50b73c0765ed admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:05.950335 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d864b1-e2c6-428a-bfaf-9e0cc1dc19e9 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:05.957525 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 183/371] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:47:05 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 24 04:47:05.960225 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02064d8-27e4-4354-8a12-c9c5c61a431f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:05.961040 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02064d8-27e4-4354-8a12-c9c5c61a431f admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:05.961420 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02064d8-27e4-4354-8a12-c9c5c61a431f admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:05.961793 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02064d8-27e4-4354-8a12-c9c5c61a431f admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:05.962666 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02064d8-27e4-4354-8a12-c9c5c61a431f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:05.963072 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02064d8-27e4-4354-8a12-c9c5c61a431f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:05.965451 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df3dfa7-3610-4ed8-a7e6-50b73c0765ed admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:05.969453 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02064d8-27e4-4354-8a12-c9c5c61a431f admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:05.974606 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df3dfa7-3610-4ed8-a7e6-50b73c0765ed admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:05.979960 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 189/372] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:47:05 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:05.985274 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5965a9-00c5-4685-8c50-dc1a55bbf64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:05.986150 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5965a9-00c5-4685-8c50-dc1a55bbf64b admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:05.986435 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5965a9-00c5-4685-8c50-dc1a55bbf64b admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:05.986708 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5965a9-00c5-4685-8c50-dc1a55bbf64b admin admin] PATH_INFO: `/v3/projects/74b19d07d8a647c7af2381d4e80089ad` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:05.989293 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5965a9-00c5-4685-8c50-dc1a55bbf64b admin admin] RBAC: Authorizing `identity:get_project(project_id=74b19d07d8a647c7af2381d4e80089ad)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:05.989548 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02064d8-27e4-4354-8a12-c9c5c61a431f admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:05.991358 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5965a9-00c5-4685-8c50-dc1a55bbf64b admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:05.993390 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 184/373] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:47:05 2021] GET /identity/v3/projects/74b19d07d8a647c7af2381d4e80089ad => generated 302 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:06.002944 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5965a9-00c5-4685-8c50-dc1a55bbf64b admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:06.005469 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02064d8-27e4-4354-8a12-c9c5c61a431f admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:06.013216 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d156bf5-11fd-4825-8a6e-0d12df48e2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:06.014495 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d156bf5-11fd-4825-8a6e-0d12df48e2b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:06.015062 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d156bf5-11fd-4825-8a6e-0d12df48e2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:06.015529 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d156bf5-11fd-4825-8a6e-0d12df48e2b3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:06.016276 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5965a9-00c5-4685-8c50-dc1a55bbf64b admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:06.021765 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c200b27b-64c5-45f9-a2b6-cfe01b3cfc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:06.022674 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c200b27b-64c5-45f9-a2b6-cfe01b3cfc60 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:06.022951 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c200b27b-64c5-45f9-a2b6-cfe01b3cfc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:06.023221 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c200b27b-64c5-45f9-a2b6-cfe01b3cfc60 admin admin] PATH_INFO: `/v3/groups/32939ca35fa249848108ba3789f4aaa1` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:06.024470 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c200b27b-64c5-45f9-a2b6-cfe01b3cfc60 admin admin] RBAC: Authorizing `identity:get_group(group_id=32939ca35fa249848108ba3789f4aaa1)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:06.026380 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d156bf5-11fd-4825-8a6e-0d12df48e2b3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:06.026497 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c200b27b-64c5-45f9-a2b6-cfe01b3cfc60 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:06.028135 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 185/374] 10.222.0.43 () {56 vars in 1201 bytes} [Fri Dec 24 04:47:06 2021] GET /identity/v3/groups/32939ca35fa249848108ba3789f4aaa1 => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:06.028739 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d156bf5-11fd-4825-8a6e-0d12df48e2b3 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:06.036442 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c200b27b-64c5-45f9-a2b6-cfe01b3cfc60 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:06.040746 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 190/375] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:47:05 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 24 04:47:06.046820 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c200b27b-64c5-45f9-a2b6-cfe01b3cfc60 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:06.047645 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d156bf5-11fd-4825-8a6e-0d12df48e2b3 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:06.051481 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ff937-2125-4aad-805d-28466638c4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:06.052131 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ff937-2125-4aad-805d-28466638c4ea admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:06.052411 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ff937-2125-4aad-805d-28466638c4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:06.052770 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ff937-2125-4aad-805d-28466638c4ea admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:06.053617 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ff937-2125-4aad-805d-28466638c4ea admin admin] RBAC: Adding query filter params (group.id=32939ca35fa249848108ba3789f4aaa1, role.id=62790996bc274dda9199846ea736d771, scope.project.id=74b19d07d8a647c7af2381d4e80089ad) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:06.053971 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ff937-2125-4aad-805d-28466638c4ea admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:06.055896 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ff937-2125-4aad-805d-28466638c4ea admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:06.059529 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d156bf5-11fd-4825-8a6e-0d12df48e2b3 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:06.064627 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f367b-8246-4bef-940e-f133fa8a6ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:06.065763 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f367b-8246-4bef-940e-f133fa8a6ade admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:06.066250 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f367b-8246-4bef-940e-f133fa8a6ade admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:06.066742 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f367b-8246-4bef-940e-f133fa8a6ade admin admin] PATH_INFO: `/v3/projects/49af853a7d674e84987f8788493d4239` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:06.068241 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855f367b-8246-4bef-940e-f133fa8a6ade admin admin] RBAC: Authorizing `identity:get_project(project_id=49af853a7d674e84987f8788493d4239)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:06.068718 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 186/376] 10.222.0.43 () {56 vars in 1397 bytes} [Fri Dec 24 04:47:06 2021] GET /identity/v3/role_assignments?group.id=32939ca35fa249848108ba3789f4aaa1&scope.project.id=74b19d07d8a647c7af2381d4e80089ad&role.id=62790996bc274dda9199846ea736d771 => generated 260 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:06.070604 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855f367b-8246-4bef-940e-f133fa8a6ade admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:06.074208 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 191/377] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:47:06 2021] GET /identity/v3/projects/49af853a7d674e84987f8788493d4239 => generated 344 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:06.079973 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ff937-2125-4aad-805d-28466638c4ea admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:06.091715 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ff937-2125-4aad-805d-28466638c4ea admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:06.096809 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0946fda-862f-4c4c-9676-5e1772c268f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:06.097707 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0946fda-862f-4c4c-9676-5e1772c268f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:06.097987 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0946fda-862f-4c4c-9676-5e1772c268f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:06.098263 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0946fda-862f-4c4c-9676-5e1772c268f4 admin admin] PATH_INFO: `/v3/groups/513206e4cc1646e6b5dbe4f1e489430d` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:06.104741 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0946fda-862f-4c4c-9676-5e1772c268f4 admin admin] RBAC: Authorizing `identity:get_group(group_id=513206e4cc1646e6b5dbe4f1e489430d)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:06.106838 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0946fda-862f-4c4c-9676-5e1772c268f4 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:06.109549 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 187/378] 10.222.0.43 () {56 vars in 1201 bytes} [Fri Dec 24 04:47:06 2021] GET /identity/v3/groups/513206e4cc1646e6b5dbe4f1e489430d => generated 229 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:06.116669 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f367b-8246-4bef-940e-f133fa8a6ade admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:06.134122 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f367b-8246-4bef-940e-f133fa8a6ade admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:06.145064 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ccfa2-d91d-46ec-9b4b-372ab4f24026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:06.145753 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ccfa2-d91d-46ec-9b4b-372ab4f24026 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:06.146061 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ccfa2-d91d-46ec-9b4b-372ab4f24026 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:06.146315 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ccfa2-d91d-46ec-9b4b-372ab4f24026 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:06.147254 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ccfa2-d91d-46ec-9b4b-372ab4f24026 admin admin] RBAC: Adding query filter params (group.id=513206e4cc1646e6b5dbe4f1e489430d, role.id=d5e6fc257d8541d5a5ed1988eacd5be7, scope.project.id=49af853a7d674e84987f8788493d4239) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:06.147573 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ccfa2-d91d-46ec-9b4b-372ab4f24026 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:06.149573 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ccfa2-d91d-46ec-9b4b-372ab4f24026 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:06.161576 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 192/379] 10.222.0.43 () {56 vars in 1397 bytes} [Fri Dec 24 04:47:06 2021] GET /identity/v3/role_assignments?group.id=513206e4cc1646e6b5dbe4f1e489430d&scope.project.id=49af853a7d674e84987f8788493d4239&role.id=d5e6fc257d8541d5a5ed1988eacd5be7 => generated 260 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:07.071991 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b613bf1-57c6-4f0a-aee0-47668c29ac67 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:07.072561 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b613bf1-57c6-4f0a-aee0-47668c29ac67 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:07.072561 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b613bf1-57c6-4f0a-aee0-47668c29ac67 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:07.074341 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 188/380] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:07.080077 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee42157c-dc4c-4577-8173-399d887a042a None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:07.080501 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee42157c-dc4c-4577-8173-399d887a042a None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:07.080688 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee42157c-dc4c-4577-8173-399d887a042a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:07.106637 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-ee42157c-dc4c-4577-8173-399d887a042a None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:07.108037 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-ee42157c-dc4c-4577-8173-399d887a042a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:07.118514 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 193/381] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:07 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 24 04:47:07.149767 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b613bf1-57c6-4f0a-aee0-47668c29ac67 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:07.164111 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b613bf1-57c6-4f0a-aee0-47668c29ac67 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:07.168480 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423335c-e21c-4409-9bcc-f62e43cb1995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:07.169482 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423335c-e21c-4409-9bcc-f62e43cb1995 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:07.169826 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423335c-e21c-4409-9bcc-f62e43cb1995 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:07.170152 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423335c-e21c-4409-9bcc-f62e43cb1995 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:07.180909 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6423335c-e21c-4409-9bcc-f62e43cb1995 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:47:07.187901 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-6423335c-e21c-4409-9bcc-f62e43cb1995 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 24 04:47:07.189441 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 189/382] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:47:07 2021] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:07.195272 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee42157c-dc4c-4577-8173-399d887a042a None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:07.204648 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee42157c-dc4c-4577-8173-399d887a042a None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:07.209444 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb98c16-5237-446b-ab90-9d2623be294e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:07.210143 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb98c16-5237-446b-ab90-9d2623be294e admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:07.210427 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb98c16-5237-446b-ab90-9d2623be294e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:07.210697 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb98c16-5237-446b-ab90-9d2623be294e admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:07.211456 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb98c16-5237-446b-ab90-9d2623be294e admin admin] RBAC: Adding query filter params (name=member) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:07.211758 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb98c16-5237-446b-ab90-9d2623be294e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:07.213442 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb98c16-5237-446b-ab90-9d2623be294e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:07.222507 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 194/383] 10.222.0.43 () {56 vars in 1122 bytes} [Fri Dec 24 04:47:07 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:07.228047 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423335c-e21c-4409-9bcc-f62e43cb1995 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:07.242747 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423335c-e21c-4409-9bcc-f62e43cb1995 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:07.250527 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692df8a-5488-47e1-86dd-1700843430b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:07.251389 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692df8a-5488-47e1-86dd-1700843430b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:07.251671 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692df8a-5488-47e1-86dd-1700843430b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:07.251944 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692df8a-5488-47e1-86dd-1700843430b9 admin admin] PATH_INFO: `/v3/groups/32939ca35fa249848108ba3789f4aaa1` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:07.257318 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3692df8a-5488-47e1-86dd-1700843430b9 admin admin] RBAC: Authorizing `identity:get_group(group_id=32939ca35fa249848108ba3789f4aaa1)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:07.259439 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3692df8a-5488-47e1-86dd-1700843430b9 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:07.261319 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 190/384] 10.222.0.43 () {56 vars in 1201 bytes} [Fri Dec 24 04:47:07 2021] GET /identity/v3/groups/32939ca35fa249848108ba3789f4aaa1 => generated 226 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:07.267027 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb98c16-5237-446b-ab90-9d2623be294e admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:07.281865 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb98c16-5237-446b-ab90-9d2623be294e admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:07.289102 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a529d4cb-796e-4ce7-b09c-2812ae66b151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:07.289953 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529d4cb-796e-4ce7-b09c-2812ae66b151 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:07.290229 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529d4cb-796e-4ce7-b09c-2812ae66b151 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:07.290499 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529d4cb-796e-4ce7-b09c-2812ae66b151 admin admin] PATH_INFO: `/v3/projects/036a37ec848b4c9bb369e71b5c2453c7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:07.291717 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a529d4cb-796e-4ce7-b09c-2812ae66b151 admin admin] RBAC: Authorizing `identity:get_project(project_id=036a37ec848b4c9bb369e71b5c2453c7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:07.293825 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a529d4cb-796e-4ce7-b09c-2812ae66b151 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:07.295864 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 195/385] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:47:07 2021] GET /identity/v3/projects/036a37ec848b4c9bb369e71b5c2453c7 => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:07.301701 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692df8a-5488-47e1-86dd-1700843430b9 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:07.326484 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692df8a-5488-47e1-86dd-1700843430b9 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:07.332119 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3935ac-52b7-4fac-b2ec-a8db15aeac2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:07.333074 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3935ac-52b7-4fac-b2ec-a8db15aeac2e admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:07.333400 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3935ac-52b7-4fac-b2ec-a8db15aeac2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:07.333676 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3935ac-52b7-4fac-b2ec-a8db15aeac2e admin admin] PATH_INFO: `/v3/projects/036a37ec848b4c9bb369e71b5c2453c7/groups/32939ca35fa249848108ba3789f4aaa1/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:07.336258 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3935ac-52b7-4fac-b2ec-a8db15aeac2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=036a37ec848b4c9bb369e71b5c2453c7, group_id=32939ca35fa249848108ba3789f4aaa1, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:07.338964 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3935ac-52b7-4fac-b2ec-a8db15aeac2e admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:07.357107 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 191/386] 10.222.0.43 () {58 vars in 1463 bytes} [Fri Dec 24 04:47:07 2021] PUT /identity/v3/projects/036a37ec848b4c9bb369e71b5c2453c7/groups/32939ca35fa249848108ba3789f4aaa1/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:47:07.848062 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79415bef-e87e-4ccd-8dbd-aaf70597bac2 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:07.848454 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79415bef-e87e-4ccd-8dbd-aaf70597bac2 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:07.848658 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79415bef-e87e-4ccd-8dbd-aaf70597bac2 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:07.850655 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 196/387] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:07.857939 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496f783-6240-4eaa-8d26-0d99a9f0c716 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:07.857939 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496f783-6240-4eaa-8d26-0d99a9f0c716 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:07.857939 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496f783-6240-4eaa-8d26-0d99a9f0c716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:07.880747 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-e496f783-6240-4eaa-8d26-0d99a9f0c716 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:07.881947 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-e496f783-6240-4eaa-8d26-0d99a9f0c716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:07.945410 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 192/388] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:07 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 24 04:47:07.981197 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79415bef-e87e-4ccd-8dbd-aaf70597bac2 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:07.995776 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79415bef-e87e-4ccd-8dbd-aaf70597bac2 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:08.001115 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852b8954-47d9-4219-aec6-484f7d02a099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:08.001928 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b8954-47d9-4219-aec6-484f7d02a099 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:08.002207 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b8954-47d9-4219-aec6-484f7d02a099 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:08.002483 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b8954-47d9-4219-aec6-484f7d02a099 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:08.014899 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852b8954-47d9-4219-aec6-484f7d02a099 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:47:08.022341 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-852b8954-47d9-4219-aec6-484f7d02a099 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 24 04:47:08.023847 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 197/389] 10.222.0.43 () {56 vars in 1135 bytes} [Fri Dec 24 04:47:07 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:08.032460 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496f783-6240-4eaa-8d26-0d99a9f0c716 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:08.042117 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496f783-6240-4eaa-8d26-0d99a9f0c716 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:08.052457 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a906c3-fd4c-408b-80ec-d4581cbc47b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:08.053281 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a906c3-fd4c-408b-80ec-d4581cbc47b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:08.053562 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a906c3-fd4c-408b-80ec-d4581cbc47b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:08.053880 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a906c3-fd4c-408b-80ec-d4581cbc47b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:08.054666 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a906c3-fd4c-408b-80ec-d4581cbc47b5 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:08.054974 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a906c3-fd4c-408b-80ec-d4581cbc47b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:08.056700 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a906c3-fd4c-408b-80ec-d4581cbc47b5 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:08.066179 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 193/390] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Dec 24 04:47:08 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:08.072734 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852b8954-47d9-4219-aec6-484f7d02a099 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:08.083638 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852b8954-47d9-4219-aec6-484f7d02a099 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:08.091742 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a07753-6a9a-49f1-9577-32d8db1c0aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:08.092661 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a07753-6a9a-49f1-9577-32d8db1c0aec admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:08.092952 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a07753-6a9a-49f1-9577-32d8db1c0aec admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:08.093224 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a07753-6a9a-49f1-9577-32d8db1c0aec admin admin] PATH_INFO: `/v3/groups/32939ca35fa249848108ba3789f4aaa1` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:08.094514 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a07753-6a9a-49f1-9577-32d8db1c0aec admin admin] RBAC: Authorizing `identity:get_group(group_id=32939ca35fa249848108ba3789f4aaa1)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:08.096560 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a07753-6a9a-49f1-9577-32d8db1c0aec admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:08.098306 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 198/391] 10.222.0.43 () {56 vars in 1201 bytes} [Fri Dec 24 04:47:08 2021] GET /identity/v3/groups/32939ca35fa249848108ba3789f4aaa1 => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:08.104562 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a906c3-fd4c-408b-80ec-d4581cbc47b5 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:08.115630 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a906c3-fd4c-408b-80ec-d4581cbc47b5 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:08.125239 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1d7a41-528b-46f7-a6b0-11df044cd31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:08.126175 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d7a41-528b-46f7-a6b0-11df044cd31f admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:08.126455 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d7a41-528b-46f7-a6b0-11df044cd31f admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:08.126729 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d7a41-528b-46f7-a6b0-11df044cd31f admin admin] PATH_INFO: `/v3/projects/036a37ec848b4c9bb369e71b5c2453c7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:08.128032 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1d7a41-528b-46f7-a6b0-11df044cd31f admin admin] RBAC: Authorizing `identity:get_project(project_id=036a37ec848b4c9bb369e71b5c2453c7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:08.130230 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1d7a41-528b-46f7-a6b0-11df044cd31f admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:08.132356 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 194/392] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:47:08 2021] GET /identity/v3/projects/036a37ec848b4c9bb369e71b5c2453c7 => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:08.138886 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a07753-6a9a-49f1-9577-32d8db1c0aec admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:08.149407 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a07753-6a9a-49f1-9577-32d8db1c0aec admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:08.156877 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19dc390-1e11-4f5c-9311-cd635158db75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:08.157816 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19dc390-1e11-4f5c-9311-cd635158db75 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:08.158099 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19dc390-1e11-4f5c-9311-cd635158db75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:08.158421 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19dc390-1e11-4f5c-9311-cd635158db75 admin admin] PATH_INFO: `/v3/projects/036a37ec848b4c9bb369e71b5c2453c7/groups/32939ca35fa249848108ba3789f4aaa1/roles/62790996bc274dda9199846ea736d771` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:08.160844 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19dc390-1e11-4f5c-9311-cd635158db75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=036a37ec848b4c9bb369e71b5c2453c7, group_id=32939ca35fa249848108ba3789f4aaa1, role_id=62790996bc274dda9199846ea736d771)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:08.163650 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19dc390-1e11-4f5c-9311-cd635158db75 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:08.180482 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 199/393] 10.222.0.43 () {58 vars in 1463 bytes} [Fri Dec 24 04:47:08 2021] PUT /identity/v3/projects/036a37ec848b4c9bb369e71b5c2453c7/groups/32939ca35fa249848108ba3789f4aaa1/roles/62790996bc274dda9199846ea736d771 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:47:08.189540 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691e786-8d0a-4565-b811-4e6b7937e080 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:08.189847 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691e786-8d0a-4565-b811-4e6b7937e080 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:08.190185 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691e786-8d0a-4565-b811-4e6b7937e080 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:08.192173 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 195/394] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:08.198973 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d649b-f81b-49c1-abd8-f5d172345479 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:08.199291 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d649b-f81b-49c1-abd8-f5d172345479 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:08.199682 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d649b-f81b-49c1-abd8-f5d172345479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:08.220456 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-965d649b-f81b-49c1-abd8-f5d172345479 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:08.221806 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-965d649b-f81b-49c1-abd8-f5d172345479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:08.290014 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 200/395] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:08 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:47:08.324736 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691e786-8d0a-4565-b811-4e6b7937e080 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:08.338231 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691e786-8d0a-4565-b811-4e6b7937e080 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:08.343057 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6b7d1-daca-4053-876d-dcbe0a87c900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:08.343876 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6b7d1-daca-4053-876d-dcbe0a87c900 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:08.344204 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6b7d1-daca-4053-876d-dcbe0a87c900 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:08.344482 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6b7d1-daca-4053-876d-dcbe0a87c900 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:08.356926 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a6b7d1-daca-4053-876d-dcbe0a87c900 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:47:08.364330 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-40a6b7d1-daca-4053-876d-dcbe0a87c900 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 24 04:47:08.365968 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 196/396] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:47:08 2021] GET /identity/v3/roles/member => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:08.372234 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d649b-f81b-49c1-abd8-f5d172345479 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:08.382196 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d649b-f81b-49c1-abd8-f5d172345479 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:08.386838 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed44205-4e9a-477b-83f5-701f46f84303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:08.387616 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed44205-4e9a-477b-83f5-701f46f84303 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:08.388298 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed44205-4e9a-477b-83f5-701f46f84303 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:08.388298 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed44205-4e9a-477b-83f5-701f46f84303 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:08.389046 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed44205-4e9a-477b-83f5-701f46f84303 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:08.389347 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed44205-4e9a-477b-83f5-701f46f84303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:08.391084 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed44205-4e9a-477b-83f5-701f46f84303 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:08.402080 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 201/397] 10.222.0.43 () {56 vars in 1122 bytes} [Fri Dec 24 04:47:08 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:08.408229 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6b7d1-daca-4053-876d-dcbe0a87c900 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:08.418896 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6b7d1-daca-4053-876d-dcbe0a87c900 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:08.423425 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e9f8c-c627-4563-839e-1d2368c942e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:08.424273 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e9f8c-c627-4563-839e-1d2368c942e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:08.424574 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e9f8c-c627-4563-839e-1d2368c942e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:08.424827 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e9f8c-c627-4563-839e-1d2368c942e4 admin admin] PATH_INFO: `/v3/groups/32939ca35fa249848108ba3789f4aaa1` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:08.426023 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784e9f8c-c627-4563-839e-1d2368c942e4 admin admin] RBAC: Authorizing `identity:get_group(group_id=32939ca35fa249848108ba3789f4aaa1)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:08.427960 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784e9f8c-c627-4563-839e-1d2368c942e4 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:08.429942 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 197/398] 10.222.0.43 () {56 vars in 1201 bytes} [Fri Dec 24 04:47:08 2021] GET /identity/v3/groups/32939ca35fa249848108ba3789f4aaa1 => generated 226 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:08.435890 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed44205-4e9a-477b-83f5-701f46f84303 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:08.446218 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed44205-4e9a-477b-83f5-701f46f84303 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:08.450931 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caba850-7f06-41c5-a961-e91a1c0224f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:08.451807 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caba850-7f06-41c5-a961-e91a1c0224f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:08.452087 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caba850-7f06-41c5-a961-e91a1c0224f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:08.452360 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caba850-7f06-41c5-a961-e91a1c0224f0 admin admin] PATH_INFO: `/v3/projects/74b19d07d8a647c7af2381d4e80089ad` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:08.453663 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caba850-7f06-41c5-a961-e91a1c0224f0 admin admin] RBAC: Authorizing `identity:get_project(project_id=74b19d07d8a647c7af2381d4e80089ad)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:08.455727 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caba850-7f06-41c5-a961-e91a1c0224f0 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:08.465146 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 202/399] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:47:08 2021] GET /identity/v3/projects/74b19d07d8a647c7af2381d4e80089ad => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:08.466160 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e9f8c-c627-4563-839e-1d2368c942e4 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:08.478831 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e9f8c-c627-4563-839e-1d2368c942e4 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:08.488425 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9559f940-5295-431e-aaa6-72d99168ba46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:08.489373 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9559f940-5295-431e-aaa6-72d99168ba46 admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:08.489650 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9559f940-5295-431e-aaa6-72d99168ba46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:08.489921 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9559f940-5295-431e-aaa6-72d99168ba46 admin admin] PATH_INFO: `/v3/projects/74b19d07d8a647c7af2381d4e80089ad/groups/32939ca35fa249848108ba3789f4aaa1/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:08.491910 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9559f940-5295-431e-aaa6-72d99168ba46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74b19d07d8a647c7af2381d4e80089ad, group_id=32939ca35fa249848108ba3789f4aaa1, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:08.494606 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9559f940-5295-431e-aaa6-72d99168ba46 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:08.521730 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 198/400] 10.222.0.43 () {58 vars in 1463 bytes} [Fri Dec 24 04:47:08 2021] PUT /identity/v3/projects/74b19d07d8a647c7af2381d4e80089ad/groups/32939ca35fa249848108ba3789f4aaa1/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 04:47:09.070680 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5695117-2853-4dc1-8ca9-d22ad75fb9e8 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:09.071260 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5695117-2853-4dc1-8ca9-d22ad75fb9e8 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:09.071731 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5695117-2853-4dc1-8ca9-d22ad75fb9e8 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:09.074033 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 203/401] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:09.086902 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b3503-a47a-4cb4-9e8d-76d013289edf None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:09.087191 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b3503-a47a-4cb4-9e8d-76d013289edf None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:09.087458 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b3503-a47a-4cb4-9e8d-76d013289edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:09.112685 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-670b3503-a47a-4cb4-9e8d-76d013289edf None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:09.113869 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-670b3503-a47a-4cb4-9e8d-76d013289edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:09.195318 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 199/402] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:09 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:47:09.233993 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5695117-2853-4dc1-8ca9-d22ad75fb9e8 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:09.250443 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5695117-2853-4dc1-8ca9-d22ad75fb9e8 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:09.257104 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525bd173-bcce-4fbe-9724-352712e73997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:09.257911 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525bd173-bcce-4fbe-9724-352712e73997 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:09.258186 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525bd173-bcce-4fbe-9724-352712e73997 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:09.258456 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525bd173-bcce-4fbe-9724-352712e73997 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:09.273415 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525bd173-bcce-4fbe-9724-352712e73997 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:47:09.281249 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-525bd173-bcce-4fbe-9724-352712e73997 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 24 04:47:09.282477 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 204/403] 10.222.0.43 () {56 vars in 1135 bytes} [Fri Dec 24 04:47:09 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:09.288792 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670b3503-a47a-4cb4-9e8d-76d013289edf None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:09.298176 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670b3503-a47a-4cb4-9e8d-76d013289edf None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:09.312341 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53139b-d480-4479-897d-e7c6aead39bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:09.313087 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53139b-d480-4479-897d-e7c6aead39bb admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:09.313571 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53139b-d480-4479-897d-e7c6aead39bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:09.313571 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53139b-d480-4479-897d-e7c6aead39bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:09.314480 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc53139b-d480-4479-897d-e7c6aead39bb admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:09.314634 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc53139b-d480-4479-897d-e7c6aead39bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:09.316248 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc53139b-d480-4479-897d-e7c6aead39bb admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:09.331088 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 200/404] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Dec 24 04:47:09 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:09.337326 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525bd173-bcce-4fbe-9724-352712e73997 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:09.353575 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525bd173-bcce-4fbe-9724-352712e73997 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:09.364276 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180b8a7-1966-4ae1-b39e-0379aea6caf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:09.365167 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180b8a7-1966-4ae1-b39e-0379aea6caf0 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:09.365442 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180b8a7-1966-4ae1-b39e-0379aea6caf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:09.365705 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180b8a7-1966-4ae1-b39e-0379aea6caf0 admin admin] PATH_INFO: `/v3/groups/32939ca35fa249848108ba3789f4aaa1` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:09.369256 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4180b8a7-1966-4ae1-b39e-0379aea6caf0 admin admin] RBAC: Authorizing `identity:get_group(group_id=32939ca35fa249848108ba3789f4aaa1)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:09.371163 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4180b8a7-1966-4ae1-b39e-0379aea6caf0 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:09.373090 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 205/405] 10.222.0.43 () {56 vars in 1201 bytes} [Fri Dec 24 04:47:09 2021] GET /identity/v3/groups/32939ca35fa249848108ba3789f4aaa1 => generated 226 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:09.378886 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53139b-d480-4479-897d-e7c6aead39bb admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:09.390014 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53139b-d480-4479-897d-e7c6aead39bb admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:09.401707 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a303e309-fbcf-4c0c-9dfe-440130c4ed00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:09.402584 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303e309-fbcf-4c0c-9dfe-440130c4ed00 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:09.402866 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303e309-fbcf-4c0c-9dfe-440130c4ed00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:09.403136 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303e309-fbcf-4c0c-9dfe-440130c4ed00 admin admin] PATH_INFO: `/v3/projects/74b19d07d8a647c7af2381d4e80089ad` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:09.404430 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a303e309-fbcf-4c0c-9dfe-440130c4ed00 admin admin] RBAC: Authorizing `identity:get_project(project_id=74b19d07d8a647c7af2381d4e80089ad)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:09.406606 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a303e309-fbcf-4c0c-9dfe-440130c4ed00 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:09.408288 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 201/406] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:47:09 2021] GET /identity/v3/projects/74b19d07d8a647c7af2381d4e80089ad => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:09.414427 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180b8a7-1966-4ae1-b39e-0379aea6caf0 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:09.429753 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180b8a7-1966-4ae1-b39e-0379aea6caf0 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:09.437457 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3157d1-30a1-4f2e-82d1-58218ffdc50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:09.439435 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3157d1-30a1-4f2e-82d1-58218ffdc50b admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:09.439697 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3157d1-30a1-4f2e-82d1-58218ffdc50b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:09.442873 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df187e5f-a748-4b0e-a026-069121ee315c None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:09.444277 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df187e5f-a748-4b0e-a026-069121ee315c None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:09.444570 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df187e5f-a748-4b0e-a026-069121ee315c None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:09.446540 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 202/407] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:09 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:09.446721 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3157d1-30a1-4f2e-82d1-58218ffdc50b admin admin] PATH_INFO: `/v3/projects/74b19d07d8a647c7af2381d4e80089ad/groups/32939ca35fa249848108ba3789f4aaa1/roles/62790996bc274dda9199846ea736d771` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:09.449192 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3157d1-30a1-4f2e-82d1-58218ffdc50b admin admin] RBAC: Authorizing `identity:create_grant(project_id=74b19d07d8a647c7af2381d4e80089ad, group_id=32939ca35fa249848108ba3789f4aaa1, role_id=62790996bc274dda9199846ea736d771)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:09.452874 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3157d1-30a1-4f2e-82d1-58218ffdc50b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:09.453087 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ba687-8e3f-49a6-9907-37bd2477c689 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:09.453225 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ba687-8e3f-49a6-9907-37bd2477c689 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:09.453524 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ba687-8e3f-49a6-9907-37bd2477c689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:09.483383 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-6d3ba687-8e3f-49a6-9907-37bd2477c689 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:09.484717 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-6d3ba687-8e3f-49a6-9907-37bd2477c689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:09.487225 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 206/408] 10.222.0.43 () {58 vars in 1463 bytes} [Fri Dec 24 04:47:09 2021] PUT /identity/v3/projects/74b19d07d8a647c7af2381d4e80089ad/groups/32939ca35fa249848108ba3789f4aaa1/roles/62790996bc274dda9199846ea736d771 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 04:47:09.556604 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 203/409] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:09 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 24 04:47:09.577095 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3157d1-30a1-4f2e-82d1-58218ffdc50b admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:09.587924 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3157d1-30a1-4f2e-82d1-58218ffdc50b admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:09.593309 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c4b5e-9ca3-442e-8d63-18e48e28090f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:09.594417 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c4b5e-9ca3-442e-8d63-18e48e28090f admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:09.594702 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c4b5e-9ca3-442e-8d63-18e48e28090f admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:09.594977 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c4b5e-9ca3-442e-8d63-18e48e28090f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:09.606282 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8c4b5e-9ca3-442e-8d63-18e48e28090f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:47:09.614069 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-1c8c4b5e-9ca3-442e-8d63-18e48e28090f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 24 04:47:09.620870 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 207/410] 10.222.0.43 () {56 vars in 1117 bytes} [Fri Dec 24 04:47:09 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:09.622517 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ba687-8e3f-49a6-9907-37bd2477c689 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:09.632856 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ba687-8e3f-49a6-9907-37bd2477c689 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:09.637648 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbaa41e-18eb-41b2-9f11-f525025df367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:09.639084 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbaa41e-18eb-41b2-9f11-f525025df367 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:09.639372 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbaa41e-18eb-41b2-9f11-f525025df367 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:09.639693 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbaa41e-18eb-41b2-9f11-f525025df367 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:09.640498 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbaa41e-18eb-41b2-9f11-f525025df367 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:09.640840 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbaa41e-18eb-41b2-9f11-f525025df367 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:09.642690 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbaa41e-18eb-41b2-9f11-f525025df367 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:09.656381 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 204/411] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:47:09 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:09.662866 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c4b5e-9ca3-442e-8d63-18e48e28090f admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:09.674866 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c4b5e-9ca3-442e-8d63-18e48e28090f admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:09.680940 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5919dce7-af2c-4e85-be20-ee617c846e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:09.681808 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5919dce7-af2c-4e85-be20-ee617c846e28 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:09.682128 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5919dce7-af2c-4e85-be20-ee617c846e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:09.682405 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5919dce7-af2c-4e85-be20-ee617c846e28 admin admin] PATH_INFO: `/v3/groups/513206e4cc1646e6b5dbe4f1e489430d` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:09.686189 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5919dce7-af2c-4e85-be20-ee617c846e28 admin admin] RBAC: Authorizing `identity:get_group(group_id=513206e4cc1646e6b5dbe4f1e489430d)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:09.688142 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5919dce7-af2c-4e85-be20-ee617c846e28 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:09.690321 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 208/412] 10.222.0.43 () {56 vars in 1201 bytes} [Fri Dec 24 04:47:09 2021] GET /identity/v3/groups/513206e4cc1646e6b5dbe4f1e489430d => generated 229 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:09.696574 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbaa41e-18eb-41b2-9f11-f525025df367 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:09.710344 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbaa41e-18eb-41b2-9f11-f525025df367 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:09.715631 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1b110-944f-42b1-9154-f5c0d1e21889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:09.716879 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1b110-944f-42b1-9154-f5c0d1e21889 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:09.717249 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1b110-944f-42b1-9154-f5c0d1e21889 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:09.717531 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1b110-944f-42b1-9154-f5c0d1e21889 admin admin] PATH_INFO: `/v3/projects/49af853a7d674e84987f8788493d4239` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:09.718907 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec1b110-944f-42b1-9154-f5c0d1e21889 admin admin] RBAC: Authorizing `identity:get_project(project_id=49af853a7d674e84987f8788493d4239)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:09.720849 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec1b110-944f-42b1-9154-f5c0d1e21889 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:09.722655 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 205/413] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:47:09 2021] GET /identity/v3/projects/49af853a7d674e84987f8788493d4239 => generated 344 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:09.730006 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5919dce7-af2c-4e85-be20-ee617c846e28 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:09.746580 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5919dce7-af2c-4e85-be20-ee617c846e28 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:09.752179 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e956f34-9caa-427a-b743-26b5aa808317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:09.753208 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e956f34-9caa-427a-b743-26b5aa808317 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:09.753484 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e956f34-9caa-427a-b743-26b5aa808317 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:09.753755 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e956f34-9caa-427a-b743-26b5aa808317 admin admin] PATH_INFO: `/v3/projects/49af853a7d674e84987f8788493d4239/groups/513206e4cc1646e6b5dbe4f1e489430d/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:09.758106 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e956f34-9caa-427a-b743-26b5aa808317 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49af853a7d674e84987f8788493d4239, group_id=513206e4cc1646e6b5dbe4f1e489430d, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:09.760982 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e956f34-9caa-427a-b743-26b5aa808317 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:09.784715 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 209/414] 10.222.0.43 () {58 vars in 1463 bytes} [Fri Dec 24 04:47:09 2021] PUT /identity/v3/projects/49af853a7d674e84987f8788493d4239/groups/513206e4cc1646e6b5dbe4f1e489430d/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:47:10.677731 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045bdd58-cdd3-445c-9379-3dc7733b3872 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:10.678215 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045bdd58-cdd3-445c-9379-3dc7733b3872 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:10.678215 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045bdd58-cdd3-445c-9379-3dc7733b3872 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:10.680222 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 206/415] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:10.687936 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68f4e6-e3a6-440c-8ec8-9ad7f3331e94 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:10.688405 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68f4e6-e3a6-440c-8ec8-9ad7f3331e94 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:10.688482 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68f4e6-e3a6-440c-8ec8-9ad7f3331e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:10.707063 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-4f68f4e6-e3a6-440c-8ec8-9ad7f3331e94 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:10.708272 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-4f68f4e6-e3a6-440c-8ec8-9ad7f3331e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:10.773047 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 210/416] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:10 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 24 04:47:10.793639 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045bdd58-cdd3-445c-9379-3dc7733b3872 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:10.807040 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045bdd58-cdd3-445c-9379-3dc7733b3872 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:10.812024 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9755271-e949-4893-98e3-f239829024aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:10.812879 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9755271-e949-4893-98e3-f239829024aa admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:10.813158 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9755271-e949-4893-98e3-f239829024aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:10.813424 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9755271-e949-4893-98e3-f239829024aa admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:10.826065 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9755271-e949-4893-98e3-f239829024aa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:47:10.834316 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-a9755271-e949-4893-98e3-f239829024aa admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 24 04:47:10.838709 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 207/417] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:47:10 2021] GET /identity/v3/roles/member => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:10.843016 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f68f4e6-e3a6-440c-8ec8-9ad7f3331e94 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:10.852849 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f68f4e6-e3a6-440c-8ec8-9ad7f3331e94 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:10.858023 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a263289d-0820-4163-8c34-036848544d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:10.858704 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263289d-0820-4163-8c34-036848544d6d admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:10.858985 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263289d-0820-4163-8c34-036848544d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:10.859313 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263289d-0820-4163-8c34-036848544d6d admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:10.860092 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a263289d-0820-4163-8c34-036848544d6d admin admin] RBAC: Adding query filter params (name=member) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:10.860393 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a263289d-0820-4163-8c34-036848544d6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:10.862042 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a263289d-0820-4163-8c34-036848544d6d admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:10.871172 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 211/418] 10.222.0.43 () {56 vars in 1122 bytes} [Fri Dec 24 04:47:10 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:10.877830 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9755271-e949-4893-98e3-f239829024aa admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:10.889378 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9755271-e949-4893-98e3-f239829024aa admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:10.893847 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d5e765-0f8f-4a78-9d98-edea2515f453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:10.894500 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5e765-0f8f-4a78-9d98-edea2515f453 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:10.894777 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5e765-0f8f-4a78-9d98-edea2515f453 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:10.895048 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5e765-0f8f-4a78-9d98-edea2515f453 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:10.904016 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d5e765-0f8f-4a78-9d98-edea2515f453 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:10.905896 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d5e765-0f8f-4a78-9d98-edea2515f453 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:10.919622 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 208/419] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:47:10 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 24 04:47:10.926432 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a263289d-0820-4163-8c34-036848544d6d admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:10.937551 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a263289d-0820-4163-8c34-036848544d6d admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:10.942028 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dee768-c834-4b12-ae4c-2642e487f041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:10.942888 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dee768-c834-4b12-ae4c-2642e487f041 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:10.943164 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dee768-c834-4b12-ae4c-2642e487f041 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:10.943436 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dee768-c834-4b12-ae4c-2642e487f041 admin admin] PATH_INFO: `/v3/projects/036a37ec848b4c9bb369e71b5c2453c7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:10.944689 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dee768-c834-4b12-ae4c-2642e487f041 admin admin] RBAC: Authorizing `identity:get_project(project_id=036a37ec848b4c9bb369e71b5c2453c7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:10.946747 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dee768-c834-4b12-ae4c-2642e487f041 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:10.948991 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 212/420] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:47:10 2021] GET /identity/v3/projects/036a37ec848b4c9bb369e71b5c2453c7 => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:10.957922 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d5e765-0f8f-4a78-9d98-edea2515f453 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:10.975932 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d5e765-0f8f-4a78-9d98-edea2515f453 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:10.985106 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df6ae7-d013-4577-a1e7-70d131f0ba53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:10.986017 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df6ae7-d013-4577-a1e7-70d131f0ba53 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:10.986297 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df6ae7-d013-4577-a1e7-70d131f0ba53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:10.986561 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df6ae7-d013-4577-a1e7-70d131f0ba53 admin admin] PATH_INFO: `/v3/groups/32939ca35fa249848108ba3789f4aaa1` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:10.987766 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79df6ae7-d013-4577-a1e7-70d131f0ba53 admin admin] RBAC: Authorizing `identity:get_group(group_id=32939ca35fa249848108ba3789f4aaa1)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:10.989714 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79df6ae7-d013-4577-a1e7-70d131f0ba53 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:10.992293 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 209/421] 10.222.0.43 () {56 vars in 1201 bytes} [Fri Dec 24 04:47:10 2021] GET /identity/v3/groups/32939ca35fa249848108ba3789f4aaa1 => generated 226 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:10.997763 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dee768-c834-4b12-ae4c-2642e487f041 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:11.007979 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dee768-c834-4b12-ae4c-2642e487f041 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:11.016836 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a082e-ace9-4b3f-9486-fa7d66888b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:11.017491 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a082e-ace9-4b3f-9486-fa7d66888b1b admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:11.017773 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a082e-ace9-4b3f-9486-fa7d66888b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:11.018102 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a082e-ace9-4b3f-9486-fa7d66888b1b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:11.018958 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a082e-ace9-4b3f-9486-fa7d66888b1b admin admin] RBAC: Adding query filter params (group.id=32939ca35fa249848108ba3789f4aaa1, role.id=19e41972301c400193cf0c53e0462e49, scope.project.id=036a37ec848b4c9bb369e71b5c2453c7) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:11.019266 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a082e-ace9-4b3f-9486-fa7d66888b1b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:11.021154 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a082e-ace9-4b3f-9486-fa7d66888b1b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:11.027697 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 213/422] 10.222.0.43 () {56 vars in 1397 bytes} [Fri Dec 24 04:47:10 2021] GET /identity/v3/role_assignments?group.id=32939ca35fa249848108ba3789f4aaa1&scope.project.id=036a37ec848b4c9bb369e71b5c2453c7&role.id=19e41972301c400193cf0c53e0462e49 => generated 611 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:11.404167 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2bc8e-c9e6-4e35-bfe4-77c55543b6a2 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:11.404694 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2bc8e-c9e6-4e35-bfe4-77c55543b6a2 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:11.404978 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2bc8e-c9e6-4e35-bfe4-77c55543b6a2 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:11.406923 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 210/423] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:11.412848 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7abe4-1e4b-43eb-90ca-df5d908f5722 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:11.413141 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7abe4-1e4b-43eb-90ca-df5d908f5722 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:11.413423 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7abe4-1e4b-43eb-90ca-df5d908f5722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:11.432807 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-64b7abe4-1e4b-43eb-90ca-df5d908f5722 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:11.434010 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-64b7abe4-1e4b-43eb-90ca-df5d908f5722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:11.448633 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 214/424] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:11 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:47:11.472507 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2bc8e-c9e6-4e35-bfe4-77c55543b6a2 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:11.485956 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2bc8e-c9e6-4e35-bfe4-77c55543b6a2 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:11.494471 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a654d6-c274-4a31-a61d-b9baa887efad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:11.495283 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a654d6-c274-4a31-a61d-b9baa887efad admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:11.495561 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a654d6-c274-4a31-a61d-b9baa887efad admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:11.495827 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a654d6-c274-4a31-a61d-b9baa887efad admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:11.509458 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a654d6-c274-4a31-a61d-b9baa887efad admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:47:11.517429 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-11a654d6-c274-4a31-a61d-b9baa887efad admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 24 04:47:11.524128 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 211/425] 10.222.0.43 () {56 vars in 1135 bytes} [Fri Dec 24 04:47:11 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:11.525593 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7abe4-1e4b-43eb-90ca-df5d908f5722 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:11.536180 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7abe4-1e4b-43eb-90ca-df5d908f5722 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:11.542082 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ba041-2927-4f0d-b096-a61fbf0d6d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:11.542791 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ba041-2927-4f0d-b096-a61fbf0d6d82 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:11.543033 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ba041-2927-4f0d-b096-a61fbf0d6d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:11.543311 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ba041-2927-4f0d-b096-a61fbf0d6d82 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:11.544195 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1ba041-2927-4f0d-b096-a61fbf0d6d82 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:11.544498 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1ba041-2927-4f0d-b096-a61fbf0d6d82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:11.546617 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1ba041-2927-4f0d-b096-a61fbf0d6d82 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:11.556050 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 215/426] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Dec 24 04:47:11 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:11.563030 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a654d6-c274-4a31-a61d-b9baa887efad admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:11.573083 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a654d6-c274-4a31-a61d-b9baa887efad admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:11.579197 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece9e02-a8c5-42cd-9d37-43e2bea9e56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:11.579844 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece9e02-a8c5-42cd-9d37-43e2bea9e56f admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:11.580125 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece9e02-a8c5-42cd-9d37-43e2bea9e56f admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:11.580402 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece9e02-a8c5-42cd-9d37-43e2bea9e56f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:11.589748 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece9e02-a8c5-42cd-9d37-43e2bea9e56f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:11.592048 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece9e02-a8c5-42cd-9d37-43e2bea9e56f admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:11.606969 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 212/427] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:47:11 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 24 04:47:11.608402 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ba041-2927-4f0d-b096-a61fbf0d6d82 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:11.618555 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ba041-2927-4f0d-b096-a61fbf0d6d82 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:11.623716 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8113be84-6add-4b92-91d0-3a750780d7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:11.624665 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113be84-6add-4b92-91d0-3a750780d7d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:11.624946 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113be84-6add-4b92-91d0-3a750780d7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:11.625222 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113be84-6add-4b92-91d0-3a750780d7d3 admin admin] PATH_INFO: `/v3/projects/036a37ec848b4c9bb369e71b5c2453c7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:11.626496 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8113be84-6add-4b92-91d0-3a750780d7d3 admin admin] RBAC: Authorizing `identity:get_project(project_id=036a37ec848b4c9bb369e71b5c2453c7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:11.628624 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8113be84-6add-4b92-91d0-3a750780d7d3 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:11.635552 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 216/428] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:47:11 2021] GET /identity/v3/projects/036a37ec848b4c9bb369e71b5c2453c7 => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:11.637015 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece9e02-a8c5-42cd-9d37-43e2bea9e56f admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:11.648414 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece9e02-a8c5-42cd-9d37-43e2bea9e56f admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:11.653397 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e0203e-d5b7-4045-9475-e8bed0f2a368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:11.654777 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0203e-d5b7-4045-9475-e8bed0f2a368 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:11.655187 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0203e-d5b7-4045-9475-e8bed0f2a368 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:11.655464 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0203e-d5b7-4045-9475-e8bed0f2a368 admin admin] PATH_INFO: `/v3/groups/32939ca35fa249848108ba3789f4aaa1` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:11.656773 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e0203e-d5b7-4045-9475-e8bed0f2a368 admin admin] RBAC: Authorizing `identity:get_group(group_id=32939ca35fa249848108ba3789f4aaa1)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:11.658832 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e0203e-d5b7-4045-9475-e8bed0f2a368 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:11.664648 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 213/429] 10.222.0.43 () {56 vars in 1201 bytes} [Fri Dec 24 04:47:11 2021] GET /identity/v3/groups/32939ca35fa249848108ba3789f4aaa1 => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:11.667420 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8113be84-6add-4b92-91d0-3a750780d7d3 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:11.678305 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8113be84-6add-4b92-91d0-3a750780d7d3 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:11.682969 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60418c6e-52ec-401e-90f6-bfd11074a178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:11.683614 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60418c6e-52ec-401e-90f6-bfd11074a178 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:11.683984 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60418c6e-52ec-401e-90f6-bfd11074a178 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:11.684216 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60418c6e-52ec-401e-90f6-bfd11074a178 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:11.685536 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60418c6e-52ec-401e-90f6-bfd11074a178 admin admin] RBAC: Adding query filter params (group.id=32939ca35fa249848108ba3789f4aaa1, role.id=62790996bc274dda9199846ea736d771, scope.project.id=036a37ec848b4c9bb369e71b5c2453c7) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:11.686086 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60418c6e-52ec-401e-90f6-bfd11074a178 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:11.688050 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60418c6e-52ec-401e-90f6-bfd11074a178 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:11.700697 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 217/430] 10.222.0.43 () {56 vars in 1397 bytes} [Fri Dec 24 04:47:11 2021] GET /identity/v3/role_assignments?group.id=32939ca35fa249848108ba3789f4aaa1&scope.project.id=036a37ec848b4c9bb369e71b5c2453c7&role.id=62790996bc274dda9199846ea736d771 => generated 611 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:11.989560 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40f372-61cf-4805-94df-8864a9a9a599 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:11.990274 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40f372-61cf-4805-94df-8864a9a9a599 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:11.990274 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40f372-61cf-4805-94df-8864a9a9a599 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:11.992073 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 214/431] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:11.998756 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27882895-4707-4ff6-a1ac-53bd4a3f706f None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:11.999084 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27882895-4707-4ff6-a1ac-53bd4a3f706f None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:11.999354 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27882895-4707-4ff6-a1ac-53bd4a3f706f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:12.019178 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-27882895-4707-4ff6-a1ac-53bd4a3f706f None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:12.020734 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-27882895-4707-4ff6-a1ac-53bd4a3f706f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:12.033413 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 218/432] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:11 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 24 04:47:12.063925 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d40f372-61cf-4805-94df-8864a9a9a599 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:12.077344 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d40f372-61cf-4805-94df-8864a9a9a599 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:12.082008 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b62554d-1982-43ae-98d8-7f2326ad8b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:12.083043 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62554d-1982-43ae-98d8-7f2326ad8b86 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:12.083518 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62554d-1982-43ae-98d8-7f2326ad8b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:12.084322 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62554d-1982-43ae-98d8-7f2326ad8b86 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:12.095834 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b62554d-1982-43ae-98d8-7f2326ad8b86 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:47:12.103348 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-3b62554d-1982-43ae-98d8-7f2326ad8b86 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 24 04:47:12.105155 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 215/433] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:47:12 2021] GET /identity/v3/roles/member => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:12.111808 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27882895-4707-4ff6-a1ac-53bd4a3f706f None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:12.124035 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27882895-4707-4ff6-a1ac-53bd4a3f706f None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:12.130585 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a79763-6ed3-4f17-920c-14749df0422a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:12.131603 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a79763-6ed3-4f17-920c-14749df0422a admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:12.132121 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a79763-6ed3-4f17-920c-14749df0422a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:12.132664 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a79763-6ed3-4f17-920c-14749df0422a admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:12.133719 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a79763-6ed3-4f17-920c-14749df0422a admin admin] RBAC: Adding query filter params (name=member) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:12.134239 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a79763-6ed3-4f17-920c-14749df0422a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:12.136111 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a79763-6ed3-4f17-920c-14749df0422a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:12.147162 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 219/434] 10.222.0.43 () {56 vars in 1122 bytes} [Fri Dec 24 04:47:12 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:12.153926 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b62554d-1982-43ae-98d8-7f2326ad8b86 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:12.164432 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b62554d-1982-43ae-98d8-7f2326ad8b86 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:12.169447 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea69ab-fa1d-4e76-8a74-547824747d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:12.170340 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea69ab-fa1d-4e76-8a74-547824747d5c admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:12.170762 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea69ab-fa1d-4e76-8a74-547824747d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:12.171274 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea69ab-fa1d-4e76-8a74-547824747d5c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:12.180904 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ea69ab-fa1d-4e76-8a74-547824747d5c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:12.182996 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ea69ab-fa1d-4e76-8a74-547824747d5c admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:12.193530 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 216/435] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:47:12 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 24 04:47:12.199698 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a79763-6ed3-4f17-920c-14749df0422a admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:12.210382 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a79763-6ed3-4f17-920c-14749df0422a admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:12.215055 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a007d53-6116-4d17-bbc5-0acfa04ad126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:12.216207 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a007d53-6116-4d17-bbc5-0acfa04ad126 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:12.216662 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a007d53-6116-4d17-bbc5-0acfa04ad126 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:12.217130 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a007d53-6116-4d17-bbc5-0acfa04ad126 admin admin] PATH_INFO: `/v3/projects/74b19d07d8a647c7af2381d4e80089ad` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:12.218478 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a007d53-6116-4d17-bbc5-0acfa04ad126 admin admin] RBAC: Authorizing `identity:get_project(project_id=74b19d07d8a647c7af2381d4e80089ad)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:12.220804 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a007d53-6116-4d17-bbc5-0acfa04ad126 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:12.222963 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 220/436] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:47:12 2021] GET /identity/v3/projects/74b19d07d8a647c7af2381d4e80089ad => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:12.229145 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea69ab-fa1d-4e76-8a74-547824747d5c admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:12.239166 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea69ab-fa1d-4e76-8a74-547824747d5c admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:12.244318 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c86f38e-b655-4770-9b34-37eefb49af16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:12.245477 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86f38e-b655-4770-9b34-37eefb49af16 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:12.245902 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86f38e-b655-4770-9b34-37eefb49af16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:12.246313 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86f38e-b655-4770-9b34-37eefb49af16 admin admin] PATH_INFO: `/v3/groups/32939ca35fa249848108ba3789f4aaa1` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:12.248174 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c86f38e-b655-4770-9b34-37eefb49af16 admin admin] RBAC: Authorizing `identity:get_group(group_id=32939ca35fa249848108ba3789f4aaa1)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:12.250642 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c86f38e-b655-4770-9b34-37eefb49af16 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:12.253064 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 217/437] 10.222.0.43 () {56 vars in 1201 bytes} [Fri Dec 24 04:47:12 2021] GET /identity/v3/groups/32939ca35fa249848108ba3789f4aaa1 => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:12.259800 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a007d53-6116-4d17-bbc5-0acfa04ad126 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:12.271240 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a007d53-6116-4d17-bbc5-0acfa04ad126 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:12.276008 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f6c19d-162e-4657-b061-f7456ad3e6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:12.276694 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6c19d-162e-4657-b061-f7456ad3e6ad admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:12.276977 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6c19d-162e-4657-b061-f7456ad3e6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:12.277252 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6c19d-162e-4657-b061-f7456ad3e6ad admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:12.278169 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f6c19d-162e-4657-b061-f7456ad3e6ad admin admin] RBAC: Adding query filter params (group.id=32939ca35fa249848108ba3789f4aaa1, role.id=19e41972301c400193cf0c53e0462e49, scope.project.id=74b19d07d8a647c7af2381d4e80089ad) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:12.278665 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f6c19d-162e-4657-b061-f7456ad3e6ad admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:12.281118 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f6c19d-162e-4657-b061-f7456ad3e6ad admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:12.290851 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 221/438] 10.222.0.43 () {56 vars in 1397 bytes} [Fri Dec 24 04:47:12 2021] GET /identity/v3/role_assignments?group.id=32939ca35fa249848108ba3789f4aaa1&scope.project.id=74b19d07d8a647c7af2381d4e80089ad&role.id=19e41972301c400193cf0c53e0462e49 => generated 611 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:12.654883 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbc362-5cc6-411b-81ec-ade45a8bcf36 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:12.655253 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbc362-5cc6-411b-81ec-ade45a8bcf36 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:12.655433 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbc362-5cc6-411b-81ec-ade45a8bcf36 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:12.657278 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 218/439] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:12.663107 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f123f-8622-4e27-84f7-09193166be44 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:12.663397 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f123f-8622-4e27-84f7-09193166be44 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:12.663674 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f123f-8622-4e27-84f7-09193166be44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:12.681436 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-744f123f-8622-4e27-84f7-09193166be44 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:12.682634 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-744f123f-8622-4e27-84f7-09193166be44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:12.690649 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 222/440] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:12 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:47:12.714960 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fbc362-5cc6-411b-81ec-ade45a8bcf36 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:12.728197 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fbc362-5cc6-411b-81ec-ade45a8bcf36 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:12.732657 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9839718-4810-4eed-8b3b-0d23d3d27719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:12.733453 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9839718-4810-4eed-8b3b-0d23d3d27719 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:12.733724 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9839718-4810-4eed-8b3b-0d23d3d27719 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:12.733987 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9839718-4810-4eed-8b3b-0d23d3d27719 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:12.745389 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9839718-4810-4eed-8b3b-0d23d3d27719 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:47:12.753433 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-f9839718-4810-4eed-8b3b-0d23d3d27719 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 24 04:47:12.754662 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 219/441] 10.222.0.43 () {56 vars in 1135 bytes} [Fri Dec 24 04:47:12 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:12.761311 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f123f-8622-4e27-84f7-09193166be44 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:12.771182 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f123f-8622-4e27-84f7-09193166be44 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:12.775618 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd62a0c-e5a4-47ea-b7be-e52f8dad3229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:12.776286 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd62a0c-e5a4-47ea-b7be-e52f8dad3229 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:12.776592 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd62a0c-e5a4-47ea-b7be-e52f8dad3229 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:12.776862 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd62a0c-e5a4-47ea-b7be-e52f8dad3229 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:12.777721 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd62a0c-e5a4-47ea-b7be-e52f8dad3229 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:12.778028 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd62a0c-e5a4-47ea-b7be-e52f8dad3229 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:12.779631 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35bfc44-80dd-41a3-9e29-f9ec3a90da56 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:12.779933 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35bfc44-80dd-41a3-9e29-f9ec3a90da56 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:12.780215 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35bfc44-80dd-41a3-9e29-f9ec3a90da56 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:12.780317 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd62a0c-e5a4-47ea-b7be-e52f8dad3229 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:12.782172 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 220/442] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 24 04:47:12.789227 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 223/443] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Dec 24 04:47:12 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:12.789477 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624d2be-95b6-4f8b-b27e-8031696b152e None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:12.789725 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624d2be-95b6-4f8b-b27e-8031696b152e None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:12.790005 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624d2be-95b6-4f8b-b27e-8031696b152e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:12.795365 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd62a0c-e5a4-47ea-b7be-e52f8dad3229 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:12.806134 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd62a0c-e5a4-47ea-b7be-e52f8dad3229 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:12.808248 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-2624d2be-95b6-4f8b-b27e-8031696b152e None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:12.809481 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-2624d2be-95b6-4f8b-b27e-8031696b152e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:12.811190 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8574fa9f-53dd-42d3-bcb3-19b651c95369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:12.811817 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574fa9f-53dd-42d3-bcb3-19b651c95369 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:12.812094 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574fa9f-53dd-42d3-bcb3-19b651c95369 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:12.812364 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574fa9f-53dd-42d3-bcb3-19b651c95369 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:12.817301 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 221/444] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:12 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 24 04:47:12.820219 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8574fa9f-53dd-42d3-bcb3-19b651c95369 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:12.821987 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8574fa9f-53dd-42d3-bcb3-19b651c95369 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:12.830490 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 224/445] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:47:12 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 24 04:47:12.837087 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624d2be-95b6-4f8b-b27e-8031696b152e None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:12.841060 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8574fa9f-53dd-42d3-bcb3-19b651c95369 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:12.846407 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624d2be-95b6-4f8b-b27e-8031696b152e None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:12.849989 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8574fa9f-53dd-42d3-bcb3-19b651c95369 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:12.850714 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e39a79-9bac-4ff4-a898-f2185b6e344b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:12.851556 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e39a79-9bac-4ff4-a898-f2185b6e344b admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:12.851839 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e39a79-9bac-4ff4-a898-f2185b6e344b admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:12.852109 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e39a79-9bac-4ff4-a898-f2185b6e344b admin admin] PATH_INFO: `/v3/projects/74b19d07d8a647c7af2381d4e80089ad` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:12.853340 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e39a79-9bac-4ff4-a898-f2185b6e344b admin admin] RBAC: Authorizing `identity:get_project(project_id=74b19d07d8a647c7af2381d4e80089ad)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:12.854279 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae58acd-2785-4ace-8c7b-7a6d55677508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:12.855048 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae58acd-2785-4ace-8c7b-7a6d55677508 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:12.855330 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae58acd-2785-4ace-8c7b-7a6d55677508 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:12.855414 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e39a79-9bac-4ff4-a898-f2185b6e344b admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:12.855611 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae58acd-2785-4ace-8c7b-7a6d55677508 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:12.857228 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 222/446] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:47:12 2021] GET /identity/v3/projects/74b19d07d8a647c7af2381d4e80089ad => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:12.863248 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e39a79-9bac-4ff4-a898-f2185b6e344b admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:12.865948 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae58acd-2785-4ace-8c7b-7a6d55677508 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:47:12.872358 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e39a79-9bac-4ff4-a898-f2185b6e344b admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:12.873013 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-9ae58acd-2785-4ace-8c7b-7a6d55677508 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 24 04:47:12.874174 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 225/447] 10.222.0.43 () {56 vars in 1117 bytes} [Fri Dec 24 04:47:12 2021] GET /identity/v3/roles/admin => generated 83 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:47:12.876704 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead7c79-8cab-427b-84f4-6d8906de82b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:12.877501 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead7c79-8cab-427b-84f4-6d8906de82b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:12.877782 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead7c79-8cab-427b-84f4-6d8906de82b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:12.878064 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead7c79-8cab-427b-84f4-6d8906de82b7 admin admin] PATH_INFO: `/v3/groups/32939ca35fa249848108ba3789f4aaa1` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:12.879223 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eead7c79-8cab-427b-84f4-6d8906de82b7 admin admin] RBAC: Authorizing `identity:get_group(group_id=32939ca35fa249848108ba3789f4aaa1)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:12.879981 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae58acd-2785-4ace-8c7b-7a6d55677508 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:12.881131 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eead7c79-8cab-427b-84f4-6d8906de82b7 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:12.882774 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 223/448] 10.222.0.43 () {56 vars in 1201 bytes} [Fri Dec 24 04:47:12 2021] GET /identity/v3/groups/32939ca35fa249848108ba3789f4aaa1 => generated 226 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:12.888689 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead7c79-8cab-427b-84f4-6d8906de82b7 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:12.890062 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae58acd-2785-4ace-8c7b-7a6d55677508 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:12.894704 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec5b67-31a4-4d46-9c7d-e62e7c291510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:12.895324 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec5b67-31a4-4d46-9c7d-e62e7c291510 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:12.895605 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec5b67-31a4-4d46-9c7d-e62e7c291510 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:12.895880 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec5b67-31a4-4d46-9c7d-e62e7c291510 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:12.896665 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec5b67-31a4-4d46-9c7d-e62e7c291510 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:12.896974 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec5b67-31a4-4d46-9c7d-e62e7c291510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:12.898312 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead7c79-8cab-427b-84f4-6d8906de82b7 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:12.898580 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec5b67-31a4-4d46-9c7d-e62e7c291510 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:12.903151 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feeeb22-7e00-4a25-81f5-7d0d0df715b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:12.903818 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feeeb22-7e00-4a25-81f5-7d0d0df715b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:12.904102 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feeeb22-7e00-4a25-81f5-7d0d0df715b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:12.904410 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feeeb22-7e00-4a25-81f5-7d0d0df715b7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:12.905336 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feeeb22-7e00-4a25-81f5-7d0d0df715b7 admin admin] RBAC: Adding query filter params (group.id=32939ca35fa249848108ba3789f4aaa1, role.id=62790996bc274dda9199846ea736d771, scope.project.id=74b19d07d8a647c7af2381d4e80089ad) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:12.905579 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feeeb22-7e00-4a25-81f5-7d0d0df715b7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:12.907336 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 226/449] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:47:12 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:12.907463 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feeeb22-7e00-4a25-81f5-7d0d0df715b7 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:12.913049 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec5b67-31a4-4d46-9c7d-e62e7c291510 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:12.913583 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 224/450] 10.222.0.43 () {56 vars in 1397 bytes} [Fri Dec 24 04:47:12 2021] GET /identity/v3/role_assignments?group.id=32939ca35fa249848108ba3789f4aaa1&scope.project.id=74b19d07d8a647c7af2381d4e80089ad&role.id=62790996bc274dda9199846ea736d771 => generated 611 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:12.923190 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec5b67-31a4-4d46-9c7d-e62e7c291510 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:12.927821 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d916023d-9e0a-4ac7-9776-387bb42e7079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:12.928492 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d916023d-9e0a-4ac7-9776-387bb42e7079 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:12.928814 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d916023d-9e0a-4ac7-9776-387bb42e7079 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:12.929123 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d916023d-9e0a-4ac7-9776-387bb42e7079 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:12.938751 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d916023d-9e0a-4ac7-9776-387bb42e7079 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:12.940572 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d916023d-9e0a-4ac7-9776-387bb42e7079 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:12.950759 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 227/451] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:47:12 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 24 04:47:12.957508 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feeeb22-7e00-4a25-81f5-7d0d0df715b7 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:12.968255 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feeeb22-7e00-4a25-81f5-7d0d0df715b7 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:12.974106 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aa109c-50c0-43a7-8ff9-f73c6436d3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:12.974991 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa109c-50c0-43a7-8ff9-f73c6436d3e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:12.975269 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa109c-50c0-43a7-8ff9-f73c6436d3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:12.975539 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa109c-50c0-43a7-8ff9-f73c6436d3e7 admin admin] PATH_INFO: `/v3/projects/49af853a7d674e84987f8788493d4239` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:12.976965 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aa109c-50c0-43a7-8ff9-f73c6436d3e7 admin admin] RBAC: Authorizing `identity:get_project(project_id=49af853a7d674e84987f8788493d4239)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:12.978807 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aa109c-50c0-43a7-8ff9-f73c6436d3e7 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:12.980603 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 225/452] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:47:12 2021] GET /identity/v3/projects/49af853a7d674e84987f8788493d4239 => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:12.987589 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d916023d-9e0a-4ac7-9776-387bb42e7079 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:12.997652 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d916023d-9e0a-4ac7-9776-387bb42e7079 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:13.003205 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea51b6-844f-46c4-80bd-26ecd9447df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:13.004075 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea51b6-844f-46c4-80bd-26ecd9447df6 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:13.004351 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea51b6-844f-46c4-80bd-26ecd9447df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:13.004653 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea51b6-844f-46c4-80bd-26ecd9447df6 admin admin] PATH_INFO: `/v3/groups/513206e4cc1646e6b5dbe4f1e489430d` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:13.005936 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea51b6-844f-46c4-80bd-26ecd9447df6 admin admin] RBAC: Authorizing `identity:get_group(group_id=513206e4cc1646e6b5dbe4f1e489430d)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:13.007859 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea51b6-844f-46c4-80bd-26ecd9447df6 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:13.009775 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 228/453] 10.222.0.43 () {56 vars in 1201 bytes} [Fri Dec 24 04:47:12 2021] GET /identity/v3/groups/513206e4cc1646e6b5dbe4f1e489430d => generated 229 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:13.016295 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aa109c-50c0-43a7-8ff9-f73c6436d3e7 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:13.026944 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aa109c-50c0-43a7-8ff9-f73c6436d3e7 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:13.032881 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3419b2-b772-4c92-994e-e5dc3fd512e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:13.033558 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3419b2-b772-4c92-994e-e5dc3fd512e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:13.033821 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3419b2-b772-4c92-994e-e5dc3fd512e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:13.034091 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3419b2-b772-4c92-994e-e5dc3fd512e1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:13.034963 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3419b2-b772-4c92-994e-e5dc3fd512e1 admin admin] RBAC: Adding query filter params (group.id=513206e4cc1646e6b5dbe4f1e489430d, role.id=d5e6fc257d8541d5a5ed1988eacd5be7, scope.project.id=49af853a7d674e84987f8788493d4239) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:13.035274 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3419b2-b772-4c92-994e-e5dc3fd512e1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:13.037231 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3419b2-b772-4c92-994e-e5dc3fd512e1 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:13.044286 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 226/454] 10.222.0.43 () {56 vars in 1397 bytes} [Fri Dec 24 04:47:13 2021] GET /identity/v3/role_assignments?group.id=513206e4cc1646e6b5dbe4f1e489430d&scope.project.id=49af853a7d674e84987f8788493d4239&role.id=d5e6fc257d8541d5a5ed1988eacd5be7 => generated 611 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:15.935269 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8a277-d2ae-4dfe-81f6-35ea64de4cb5 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:15.935800 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8a277-d2ae-4dfe-81f6-35ea64de4cb5 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:15.935800 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8a277-d2ae-4dfe-81f6-35ea64de4cb5 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:15.937914 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 229/455] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:15.943958 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc89ce-cf81-4da1-b69c-574df069306c None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:15.944390 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc89ce-cf81-4da1-b69c-574df069306c None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:15.944582 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc89ce-cf81-4da1-b69c-574df069306c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:15.969613 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-82bc89ce-cf81-4da1-b69c-574df069306c None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:15.971179 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-82bc89ce-cf81-4da1-b69c-574df069306c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:15.982969 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 227/456] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:15 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 24 04:47:16.014361 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6542200-0a04-4f9c-9156-a2e53af3e084 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:16.014661 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6542200-0a04-4f9c-9156-a2e53af3e084 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:16.014913 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6542200-0a04-4f9c-9156-a2e53af3e084 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:16.016983 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 230/457] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:16.022977 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066f3c4-8cc4-4334-b456-0e5b874ced52 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:16.023356 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6542200-0a04-4f9c-9156-a2e53af3e084 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:16.023713 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066f3c4-8cc4-4334-b456-0e5b874ced52 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:16.024200 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066f3c4-8cc4-4334-b456-0e5b874ced52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:16.043659 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-e066f3c4-8cc4-4334-b456-0e5b874ced52 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:16.045245 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-e066f3c4-8cc4-4334-b456-0e5b874ced52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:16.045747 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6542200-0a04-4f9c-9156-a2e53af3e084 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:16.053673 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 228/458] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:16 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:47:16.054971 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185d279-ab35-4a56-b82f-b239bb0707b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:16.055766 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185d279-ab35-4a56-b82f-b239bb0707b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:16.056062 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185d279-ab35-4a56-b82f-b239bb0707b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:16.056336 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185d279-ab35-4a56-b82f-b239bb0707b8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:16.078188 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e066f3c4-8cc4-4334-b456-0e5b874ced52 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:16.080726 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9185d279-ab35-4a56-b82f-b239bb0707b8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:16.082794 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9185d279-ab35-4a56-b82f-b239bb0707b8 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:16.094469 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e066f3c4-8cc4-4334-b456-0e5b874ced52 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:16.106775 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-9185d279-ab35-4a56-b82f-b239bb0707b8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:47:16.108545 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 231/459] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:16.114660 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185d279-ab35-4a56-b82f-b239bb0707b8 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:16.116202 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b283dedd-d967-49e6-b3b8-2196216db3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:16.117112 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283dedd-d967-49e6-b3b8-2196216db3da admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:16.117392 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283dedd-d967-49e6-b3b8-2196216db3da admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:16.117662 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283dedd-d967-49e6-b3b8-2196216db3da admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:16.131020 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185d279-ab35-4a56-b82f-b239bb0707b8 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:16.131353 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b283dedd-d967-49e6-b3b8-2196216db3da admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:16.133398 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b283dedd-d967-49e6-b3b8-2196216db3da admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:16.135595 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd4d278-fe8f-4433-bb66-f9a63c2d5242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:16.136256 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4d278-fe8f-4433-bb66-f9a63c2d5242 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:16.136653 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4d278-fe8f-4433-bb66-f9a63c2d5242 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:16.136934 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4d278-fe8f-4433-bb66-f9a63c2d5242 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:16.137682 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd4d278-fe8f-4433-bb66-f9a63c2d5242 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:16.138022 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd4d278-fe8f-4433-bb66-f9a63c2d5242 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:16.139037 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING py.warnings [None req-4bd4d278-fe8f-4433-bb66-f9a63c2d5242 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:47:16.139037 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: warnings.warn(msg) Dec 24 04:47:16.139037 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: Dec 24 04:47:16.139913 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd4d278-fe8f-4433-bb66-f9a63c2d5242 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:16.151346 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-b283dedd-d967-49e6-b3b8-2196216db3da admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:47:16.152946 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 229/460] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:47:16.154380 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2e2c3-3cf1-4277-93bb-cee84a2dc53a None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:16.154660 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2e2c3-3cf1-4277-93bb-cee84a2dc53a None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:16.154930 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2e2c3-3cf1-4277-93bb-cee84a2dc53a None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:16.156785 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 230/461] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:16.160131 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 232/462] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:47:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:16.161676 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2e2c3-3cf1-4277-93bb-cee84a2dc53a None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:16.163494 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4cc231-972e-4c85-b5f3-7ab1b433a101 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:16.163775 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4cc231-972e-4c85-b5f3-7ab1b433a101 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:16.164046 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4cc231-972e-4c85-b5f3-7ab1b433a101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:16.177538 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2e2c3-3cf1-4277-93bb-cee84a2dc53a None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:16.182183 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb16934-774a-4b87-89dc-630025b1c11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:16.182567 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-0f4cc231-972e-4c85-b5f3-7ab1b433a101 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:16.183333 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb16934-774a-4b87-89dc-630025b1c11a admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:16.183784 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-0f4cc231-972e-4c85-b5f3-7ab1b433a101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:16.184012 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb16934-774a-4b87-89dc-630025b1c11a admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:16.184797 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb16934-774a-4b87-89dc-630025b1c11a admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:16.186574 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb16934-774a-4b87-89dc-630025b1c11a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:16.187279 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb16934-774a-4b87-89dc-630025b1c11a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:16.189587 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb16934-774a-4b87-89dc-630025b1c11a admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:16.200541 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 233/463] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:16 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:47:16.200541 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4cc231-972e-4c85-b5f3-7ab1b433a101 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:16.202821 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4cc231-972e-4c85-b5f3-7ab1b433a101 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:16.211595 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 231/464] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:47:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:16.217536 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb16934-774a-4b87-89dc-630025b1c11a admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:16.222194 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7456c37-3692-475c-99aa-d7fb71a720f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:16.222887 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7456c37-3692-475c-99aa-d7fb71a720f6 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:16.223405 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7456c37-3692-475c-99aa-d7fb71a720f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:16.223683 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7456c37-3692-475c-99aa-d7fb71a720f6 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:16.225041 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7456c37-3692-475c-99aa-d7fb71a720f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:16.227264 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7456c37-3692-475c-99aa-d7fb71a720f6 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:16.227779 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb16934-774a-4b87-89dc-630025b1c11a admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:16.232368 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfccaeb-cbcc-48a6-81e7-559e06aed78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:16.233132 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfccaeb-cbcc-48a6-81e7-559e06aed78a admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:16.233400 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfccaeb-cbcc-48a6-81e7-559e06aed78a admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:16.233666 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfccaeb-cbcc-48a6-81e7-559e06aed78a admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:16.234387 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfccaeb-cbcc-48a6-81e7-559e06aed78a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:16.236318 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfccaeb-cbcc-48a6-81e7-559e06aed78a admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:16.253182 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 234/465] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Dec 24 04:47:16 2021] POST /identity/v3/users => generated 246 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:47:16.261573 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 232/466] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Dec 24 04:47:16 2021] POST /identity/v3/users => generated 248 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 04:47:16.261764 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7456c37-3692-475c-99aa-d7fb71a720f6 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:16.291361 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7456c37-3692-475c-99aa-d7fb71a720f6 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:16.309003 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad54f0-e70d-4d0a-8e89-8f5e08f09fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:16.309003 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad54f0-e70d-4d0a-8e89-8f5e08f09fcf admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:16.309003 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad54f0-e70d-4d0a-8e89-8f5e08f09fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:16.309003 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad54f0-e70d-4d0a-8e89-8f5e08f09fcf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:16.334248 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad54f0-e70d-4d0a-8e89-8f5e08f09fcf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:16.336259 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad54f0-e70d-4d0a-8e89-8f5e08f09fcf admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:16.363800 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-15ad54f0-e70d-4d0a-8e89-8f5e08f09fcf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:47:16.365103 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 235/467] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 111 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:16.371958 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfccaeb-cbcc-48a6-81e7-559e06aed78a admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:16.383425 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfccaeb-cbcc-48a6-81e7-559e06aed78a admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:16.393121 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0274032-cedd-4a3c-a2fe-5061cdcc4cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:16.393829 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0274032-cedd-4a3c-a2fe-5061cdcc4cfa admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:16.394112 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0274032-cedd-4a3c-a2fe-5061cdcc4cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:16.394389 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0274032-cedd-4a3c-a2fe-5061cdcc4cfa admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:16.395186 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0274032-cedd-4a3c-a2fe-5061cdcc4cfa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:16.395499 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0274032-cedd-4a3c-a2fe-5061cdcc4cfa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:16.397233 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0274032-cedd-4a3c-a2fe-5061cdcc4cfa admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:16.423150 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 233/468] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:47:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:16.429724 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad54f0-e70d-4d0a-8e89-8f5e08f09fcf admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:16.446666 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad54f0-e70d-4d0a-8e89-8f5e08f09fcf admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:16.459260 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca4dfe-7181-41ac-b508-8691c6b9448d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:16.460326 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca4dfe-7181-41ac-b508-8691c6b9448d admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:16.460848 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca4dfe-7181-41ac-b508-8691c6b9448d admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:16.461342 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca4dfe-7181-41ac-b508-8691c6b9448d admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:16.462404 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ca4dfe-7181-41ac-b508-8691c6b9448d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:16.464756 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ca4dfe-7181-41ac-b508-8691c6b9448d admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:16.497802 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 236/469] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Dec 24 04:47:16 2021] POST /identity/v3/users => generated 248 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 04:47:16.901309 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa35aed-4e67-4cb8-8a5a-152a8fc2c110 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:16.902011 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa35aed-4e67-4cb8-8a5a-152a8fc2c110 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:16.902515 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa35aed-4e67-4cb8-8a5a-152a8fc2c110 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:16.904871 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 234/470] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:16 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:16.911751 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fd96d-8b28-4575-8e6c-7912ac93f513 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:16.912303 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fd96d-8b28-4575-8e6c-7912ac93f513 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:16.912818 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fd96d-8b28-4575-8e6c-7912ac93f513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:16.931391 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-614fd96d-8b28-4575-8e6c-7912ac93f513 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:16.932928 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-614fd96d-8b28-4575-8e6c-7912ac93f513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:16.941405 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 237/471] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:16 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:47:16.967252 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa35aed-4e67-4cb8-8a5a-152a8fc2c110 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:16.980244 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa35aed-4e67-4cb8-8a5a-152a8fc2c110 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:16.984922 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dad628-52d2-4bc3-a6fc-8af1706ee94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:16.986028 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dad628-52d2-4bc3-a6fc-8af1706ee94d admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:16.986506 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dad628-52d2-4bc3-a6fc-8af1706ee94d admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:16.986990 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dad628-52d2-4bc3-a6fc-8af1706ee94d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:16.997725 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dad628-52d2-4bc3-a6fc-8af1706ee94d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:16.999867 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dad628-52d2-4bc3-a6fc-8af1706ee94d admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:17.017866 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-34dad628-52d2-4bc3-a6fc-8af1706ee94d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:47:17.019622 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 235/472] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:17.026129 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614fd96d-8b28-4575-8e6c-7912ac93f513 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:17.035796 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614fd96d-8b28-4575-8e6c-7912ac93f513 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:17.041454 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b359f40d-297f-4dff-a89d-263a4ce4daea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:17.042364 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359f40d-297f-4dff-a89d-263a4ce4daea admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:17.042839 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359f40d-297f-4dff-a89d-263a4ce4daea admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:17.043302 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359f40d-297f-4dff-a89d-263a4ce4daea admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:17.044316 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b359f40d-297f-4dff-a89d-263a4ce4daea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:17.044862 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b359f40d-297f-4dff-a89d-263a4ce4daea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:17.046726 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b359f40d-297f-4dff-a89d-263a4ce4daea admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:17.059447 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 238/473] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:47:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:17.065719 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dad628-52d2-4bc3-a6fc-8af1706ee94d admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:17.075822 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dad628-52d2-4bc3-a6fc-8af1706ee94d admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:17.080466 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f6dcf-6de9-4341-a007-d556e771956b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:17.081415 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f6dcf-6de9-4341-a007-d556e771956b admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:17.081890 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f6dcf-6de9-4341-a007-d556e771956b admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:17.082408 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f6dcf-6de9-4341-a007-d556e771956b admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:17.083372 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4f6dcf-6de9-4341-a007-d556e771956b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:17.085834 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4f6dcf-6de9-4341-a007-d556e771956b admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:17.111289 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 236/474] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Dec 24 04:47:17 2021] POST /identity/v3/users => generated 249 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:47:17.553157 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a779ce-5aa1-41a2-90aa-5fed03ff7caa None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:17.553830 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a779ce-5aa1-41a2-90aa-5fed03ff7caa None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:17.554331 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a779ce-5aa1-41a2-90aa-5fed03ff7caa None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:17.556612 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 239/475] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:17.562387 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb904fc8-ffea-4956-86fa-bd1959146a58 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:17.562908 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb904fc8-ffea-4956-86fa-bd1959146a58 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:17.563392 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb904fc8-ffea-4956-86fa-bd1959146a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:17.581940 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-bb904fc8-ffea-4956-86fa-bd1959146a58 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:17.583455 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-bb904fc8-ffea-4956-86fa-bd1959146a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:17.593194 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 237/476] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:17 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:47:17.617553 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a779ce-5aa1-41a2-90aa-5fed03ff7caa None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:17.630686 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a779ce-5aa1-41a2-90aa-5fed03ff7caa None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:17.635586 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eab3f4-e461-40da-ae7d-8d4281d19e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:17.636510 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eab3f4-e461-40da-ae7d-8d4281d19e48 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:17.637017 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eab3f4-e461-40da-ae7d-8d4281d19e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:17.637484 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eab3f4-e461-40da-ae7d-8d4281d19e48 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:17.638667 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eab3f4-e461-40da-ae7d-8d4281d19e48 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:17.640550 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eab3f4-e461-40da-ae7d-8d4281d19e48 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:17.650859 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.sql.core [None req-79eab3f4-e461-40da-ae7d-8d4281d19e48 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Dec 24 04:47:17.650859 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Dec 24 04:47:17.650859 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [parameters: {'id': '89a298c685ad420aa6955cc1b53ff782', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Dec 24 04:47:17.650859 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79113) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Dec 24 04:47:17.667964 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-79eab3f4-e461-40da-ae7d-8d4281d19e48 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Dec 24 04:47:17.670275 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 240/477] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 04:47:17 2021] POST /identity/v3/roles => generated 144 bytes in 53 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:17.676342 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb904fc8-ffea-4956-86fa-bd1959146a58 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:17.686384 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb904fc8-ffea-4956-86fa-bd1959146a58 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:17.693300 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ac948-b74c-4150-b0df-b9b39fe7d4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:17.694381 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ac948-b74c-4150-b0df-b9b39fe7d4df admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:17.694956 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ac948-b74c-4150-b0df-b9b39fe7d4df admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:17.695421 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ac948-b74c-4150-b0df-b9b39fe7d4df admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:17.707731 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1ac948-b74c-4150-b0df-b9b39fe7d4df admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:47:17.715912 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-9e1ac948-b74c-4150-b0df-b9b39fe7d4df admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 24 04:47:17.717814 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 238/478] 10.222.0.43 () {56 vars in 1135 bytes} [Fri Dec 24 04:47:17 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:17.723834 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eab3f4-e461-40da-ae7d-8d4281d19e48 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:17.736402 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eab3f4-e461-40da-ae7d-8d4281d19e48 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:17.741556 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596a0db2-32d2-4b85-8976-634f5df140f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:17.742563 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a0db2-32d2-4b85-8976-634f5df140f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:17.743035 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a0db2-32d2-4b85-8976-634f5df140f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:17.744812 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a0db2-32d2-4b85-8976-634f5df140f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:17.744812 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596a0db2-32d2-4b85-8976-634f5df140f1 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:17.744812 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596a0db2-32d2-4b85-8976-634f5df140f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:17.748362 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596a0db2-32d2-4b85-8976-634f5df140f1 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:17.758303 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 241/479] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Dec 24 04:47:17 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:19.087190 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d7620-6688-4d9c-8c58-dfa5935b2b17 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:19.088104 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d7620-6688-4d9c-8c58-dfa5935b2b17 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:19.088612 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d7620-6688-4d9c-8c58-dfa5935b2b17 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:19.090565 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 239/480] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:19.096639 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c45b0f-4499-4a14-a4a0-fdbda4a4961b None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:19.097454 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c45b0f-4499-4a14-a4a0-fdbda4a4961b None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:19.097900 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c45b0f-4499-4a14-a4a0-fdbda4a4961b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:19.119661 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-a2c45b0f-4499-4a14-a4a0-fdbda4a4961b None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:19.119843 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc042d0d-1153-4ada-85e1-f4b870cddddb None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:19.120002 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc042d0d-1153-4ada-85e1-f4b870cddddb None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:19.120277 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc042d0d-1153-4ada-85e1-f4b870cddddb None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:19.121540 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-a2c45b0f-4499-4a14-a4a0-fdbda4a4961b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:19.122420 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 240/481] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:19.128070 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20daa1a9-cdb5-4033-a356-a6c81d4e6813 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:19.128325 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20daa1a9-cdb5-4033-a356-a6c81d4e6813 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:19.128641 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20daa1a9-cdb5-4033-a356-a6c81d4e6813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:19.145713 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 242/482] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:19 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:47:19.161551 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-20daa1a9-cdb5-4033-a356-a6c81d4e6813 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:19.162775 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-20daa1a9-cdb5-4033-a356-a6c81d4e6813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:19.170315 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c45b0f-4499-4a14-a4a0-fdbda4a4961b None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:19.174027 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 241/483] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:19 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 24 04:47:19.179581 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c45b0f-4499-4a14-a4a0-fdbda4a4961b None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:19.184020 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955344f9-9c8e-4741-b4d9-bffd6699964e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:19.184991 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955344f9-9c8e-4741-b4d9-bffd6699964e admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:19.185275 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955344f9-9c8e-4741-b4d9-bffd6699964e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:19.185545 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955344f9-9c8e-4741-b4d9-bffd6699964e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:19.195877 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955344f9-9c8e-4741-b4d9-bffd6699964e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:47:19.202917 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-955344f9-9c8e-4741-b4d9-bffd6699964e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 24 04:47:19.208623 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 243/484] 10.222.0.43 () {56 vars in 1123 bytes} [Fri Dec 24 04:47:19 2021] GET /identity/v3/roles/service => generated 85 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:47:19.210921 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20daa1a9-cdb5-4033-a356-a6c81d4e6813 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:19.220488 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20daa1a9-cdb5-4033-a356-a6c81d4e6813 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:19.222138 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955344f9-9c8e-4741-b4d9-bffd6699964e admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:19.232617 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955344f9-9c8e-4741-b4d9-bffd6699964e admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:19.237363 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e35bf-fec8-4747-9f01-9d8c826b3d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:19.238035 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e35bf-fec8-4747-9f01-9d8c826b3d8b admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:19.238309 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e35bf-fec8-4747-9f01-9d8c826b3d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:19.238576 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e35bf-fec8-4747-9f01-9d8c826b3d8b admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:19.239348 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3e35bf-fec8-4747-9f01-9d8c826b3d8b admin admin] RBAC: Adding query filter params (name=service) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:19.239647 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3e35bf-fec8-4747-9f01-9d8c826b3d8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:19.241299 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3e35bf-fec8-4747-9f01-9d8c826b3d8b admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:19.244632 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe4e6d-30d4-408d-b4b5-c9f49ef664c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:19.245413 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe4e6d-30d4-408d-b4b5-c9f49ef664c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:19.245688 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe4e6d-30d4-408d-b4b5-c9f49ef664c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:19.245952 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe4e6d-30d4-408d-b4b5-c9f49ef664c8 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:19.258544 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 242/485] 10.222.0.43 () {56 vars in 1124 bytes} [Fri Dec 24 04:47:19 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:19.266343 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e35bf-fec8-4747-9f01-9d8c826b3d8b admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:19.273663 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fe4e6d-30d4-408d-b4b5-c9f49ef664c8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:47:19.281110 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-65fe4e6d-30d4-408d-b4b5-c9f49ef664c8 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 24 04:47:19.282476 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 244/486] 10.222.0.43 () {56 vars in 1123 bytes} [Fri Dec 24 04:47:19 2021] GET /identity/v3/roles/service => generated 85 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:47:19.287777 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e35bf-fec8-4747-9f01-9d8c826b3d8b admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:19.289352 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe4e6d-30d4-408d-b4b5-c9f49ef664c8 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:19.296720 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f84392-76d7-4a82-8255-7d722863a3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:19.298090 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f84392-76d7-4a82-8255-7d722863a3e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:19.298570 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f84392-76d7-4a82-8255-7d722863a3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:19.299039 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f84392-76d7-4a82-8255-7d722863a3e7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:19.299677 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe4e6d-30d4-408d-b4b5-c9f49ef664c8 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:19.312552 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cedebe7-26af-4cc0-b75a-21e05abf73da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:19.312552 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cedebe7-26af-4cc0-b75a-21e05abf73da admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:19.312552 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cedebe7-26af-4cc0-b75a-21e05abf73da admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:19.312552 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cedebe7-26af-4cc0-b75a-21e05abf73da admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:19.312940 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cedebe7-26af-4cc0-b75a-21e05abf73da admin admin] RBAC: Adding query filter params (name=service) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:19.312940 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cedebe7-26af-4cc0-b75a-21e05abf73da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:19.312940 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cedebe7-26af-4cc0-b75a-21e05abf73da admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:19.329609 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f84392-76d7-4a82-8255-7d722863a3e7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:19.331467 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f84392-76d7-4a82-8255-7d722863a3e7 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:19.334703 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 245/487] 10.222.0.43 () {56 vars in 1124 bytes} [Fri Dec 24 04:47:19 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:19.340130 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cedebe7-26af-4cc0-b75a-21e05abf73da admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:19.359771 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-f3f84392-76d7-4a82-8255-7d722863a3e7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:47:19.362848 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cedebe7-26af-4cc0-b75a-21e05abf73da admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:19.367490 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34bed2f-ebf3-4e90-9929-edb1a114b8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:19.368303 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34bed2f-ebf3-4e90-9929-edb1a114b8cf admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:19.368601 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34bed2f-ebf3-4e90-9929-edb1a114b8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:19.368882 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34bed2f-ebf3-4e90-9929-edb1a114b8cf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:19.376792 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 243/488] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 106 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:19.385569 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f84392-76d7-4a82-8255-7d722863a3e7 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:19.396615 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f84392-76d7-4a82-8255-7d722863a3e7 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:19.398569 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34bed2f-ebf3-4e90-9929-edb1a114b8cf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:19.400415 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34bed2f-ebf3-4e90-9929-edb1a114b8cf admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:19.410168 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295155b8-3c51-45e6-bf98-b6ff5c6f98f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:19.410830 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295155b8-3c51-45e6-bf98-b6ff5c6f98f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:19.411105 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295155b8-3c51-45e6-bf98-b6ff5c6f98f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:19.411370 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295155b8-3c51-45e6-bf98-b6ff5c6f98f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:19.412112 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295155b8-3c51-45e6-bf98-b6ff5c6f98f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:19.412410 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295155b8-3c51-45e6-bf98-b6ff5c6f98f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:19.414054 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295155b8-3c51-45e6-bf98-b6ff5c6f98f9 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:19.428576 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-a34bed2f-ebf3-4e90-9929-edb1a114b8cf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:47:19.432744 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 244/489] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:47:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:19.436377 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295155b8-3c51-45e6-bf98-b6ff5c6f98f9 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:19.437792 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 246/490] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:47:19.443179 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34bed2f-ebf3-4e90-9929-edb1a114b8cf admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:19.454427 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295155b8-3c51-45e6-bf98-b6ff5c6f98f9 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:19.459188 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34bed2f-ebf3-4e90-9929-edb1a114b8cf admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:19.464870 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88ac0e-ecfa-472f-8b14-238ab7bd0e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:19.466451 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88ac0e-ecfa-472f-8b14-238ab7bd0e03 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:19.468181 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88ac0e-ecfa-472f-8b14-238ab7bd0e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:19.468961 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acadf05-22df-4115-a757-1584c2f68820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:19.469447 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88ac0e-ecfa-472f-8b14-238ab7bd0e03 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:19.470848 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acadf05-22df-4115-a757-1584c2f68820 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:19.472911 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acadf05-22df-4115-a757-1584c2f68820 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:19.473381 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acadf05-22df-4115-a757-1584c2f68820 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:19.474311 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acadf05-22df-4115-a757-1584c2f68820 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:19.476074 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acadf05-22df-4115-a757-1584c2f68820 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:19.481457 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acadf05-22df-4115-a757-1584c2f68820 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:19.485173 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee88ac0e-ecfa-472f-8b14-238ab7bd0e03 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:19.491864 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee88ac0e-ecfa-472f-8b14-238ab7bd0e03 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:19.508781 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-ee88ac0e-ecfa-472f-8b14-238ab7bd0e03 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Dec 24 04:47:19.510938 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 247/491] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:47:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:19.515704 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 245/492] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:47:19 2021] GET /identity/v3/users/glance => generated 84 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:19.516835 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acadf05-22df-4115-a757-1584c2f68820 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:19.525889 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88ac0e-ecfa-472f-8b14-238ab7bd0e03 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:19.531395 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acadf05-22df-4115-a757-1584c2f68820 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:19.543637 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33b275-d629-4cef-8a51-3a040ff6aee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:19.544911 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33b275-d629-4cef-8a51-3a040ff6aee5 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:19.545387 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33b275-d629-4cef-8a51-3a040ff6aee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:19.545868 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33b275-d629-4cef-8a51-3a040ff6aee5 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:19.556549 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88ac0e-ecfa-472f-8b14-238ab7bd0e03 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:19.563680 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4b72bf-4ef4-4291-a642-192022dc028d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:19.564398 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b72bf-4ef4-4291-a642-192022dc028d admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:19.564713 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b72bf-4ef4-4291-a642-192022dc028d admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:19.564984 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b72bf-4ef4-4291-a642-192022dc028d admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:19.565547 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c33b275-d629-4cef-8a51-3a040ff6aee5 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:19.567403 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4b72bf-4ef4-4291-a642-192022dc028d admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:19.567778 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4b72bf-4ef4-4291-a642-192022dc028d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:19.569220 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c33b275-d629-4cef-8a51-3a040ff6aee5 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:19.570249 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING py.warnings [None req-ca4b72bf-4ef4-4291-a642-192022dc028d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:47:19.570249 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: warnings.warn(msg) Dec 24 04:47:19.570249 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: Dec 24 04:47:19.571358 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4b72bf-4ef4-4291-a642-192022dc028d admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:19.593926 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-4c33b275-d629-4cef-8a51-3a040ff6aee5 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 24 04:47:19.595859 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 248/493] 10.222.0.43 () {56 vars in 1114 bytes} [Fri Dec 24 04:47:19 2021] GET /identity/v3/users/nova => generated 82 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:19.601381 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33b275-d629-4cef-8a51-3a040ff6aee5 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:19.623278 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33b275-d629-4cef-8a51-3a040ff6aee5 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:19.636289 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 246/494] 10.222.0.43 () {56 vars in 1158 bytes} [Fri Dec 24 04:47:19 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:19.638131 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4b72bf-4ef4-4291-a642-192022dc028d admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:19.641245 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21504412-df0d-41ac-9ea9-b62728174a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:19.641944 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21504412-df0d-41ac-9ea9-b62728174a2e admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:19.642228 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21504412-df0d-41ac-9ea9-b62728174a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:19.642502 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21504412-df0d-41ac-9ea9-b62728174a2e admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:19.643382 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21504412-df0d-41ac-9ea9-b62728174a2e admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:19.643689 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21504412-df0d-41ac-9ea9-b62728174a2e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:19.644781 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING py.warnings [None req-21504412-df0d-41ac-9ea9-b62728174a2e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:47:19.644781 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: warnings.warn(msg) Dec 24 04:47:19.644781 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: Dec 24 04:47:19.645936 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21504412-df0d-41ac-9ea9-b62728174a2e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:19.650610 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4b72bf-4ef4-4291-a642-192022dc028d admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:19.666907 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad189ed-560c-4071-b11d-9ea4b5488942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:19.667964 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad189ed-560c-4071-b11d-9ea4b5488942 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:19.668469 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad189ed-560c-4071-b11d-9ea4b5488942 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:19.669010 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad189ed-560c-4071-b11d-9ea4b5488942 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:19.683611 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad189ed-560c-4071-b11d-9ea4b5488942 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:19.686108 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad189ed-560c-4071-b11d-9ea4b5488942 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:19.700638 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 247/495] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:47:19 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 24 04:47:19.703230 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad189ed-560c-4071-b11d-9ea4b5488942 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:19.713005 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad189ed-560c-4071-b11d-9ea4b5488942 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:19.719743 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 249/496] 10.222.0.43 () {56 vars in 1154 bytes} [Fri Dec 24 04:47:19 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:19.721993 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf143269-8c16-40dd-baf7-e17eb82b7436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:19.723011 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf143269-8c16-40dd-baf7-e17eb82b7436 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:19.723478 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf143269-8c16-40dd-baf7-e17eb82b7436 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:19.723950 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf143269-8c16-40dd-baf7-e17eb82b7436 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:19.725648 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21504412-df0d-41ac-9ea9-b62728174a2e admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:19.742753 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21504412-df0d-41ac-9ea9-b62728174a2e admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:19.747294 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf143269-8c16-40dd-baf7-e17eb82b7436 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:19.749763 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf143269-8c16-40dd-baf7-e17eb82b7436 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:19.761927 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3242c95f-eabd-443f-8ef8-c1948b360f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:19.762632 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242c95f-eabd-443f-8ef8-c1948b360f01 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:19.763033 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242c95f-eabd-443f-8ef8-c1948b360f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:19.763308 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242c95f-eabd-443f-8ef8-c1948b360f01 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:19.769243 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-cf143269-8c16-40dd-baf7-e17eb82b7436 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:47:19.775839 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 248/497] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:19.777913 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf143269-8c16-40dd-baf7-e17eb82b7436 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:19.784310 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3242c95f-eabd-443f-8ef8-c1948b360f01 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:19.786190 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3242c95f-eabd-443f-8ef8-c1948b360f01 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:19.788705 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf143269-8c16-40dd-baf7-e17eb82b7436 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:19.793453 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b5469-2aab-46f1-8ada-c7a6c8d06fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:19.794399 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b5469-2aab-46f1-8ada-c7a6c8d06fc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:19.794891 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b5469-2aab-46f1-8ada-c7a6c8d06fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:19.795351 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b5469-2aab-46f1-8ada-c7a6c8d06fc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:19.796282 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949b5469-2aab-46f1-8ada-c7a6c8d06fc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:19.796811 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949b5469-2aab-46f1-8ada-c7a6c8d06fc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:19.799341 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949b5469-2aab-46f1-8ada-c7a6c8d06fc4 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:19.804379 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 250/498] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:47:19 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 24 04:47:19.810117 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3242c95f-eabd-443f-8ef8-c1948b360f01 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:19.816782 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 249/499] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:47:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:19.819028 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b5469-2aab-46f1-8ada-c7a6c8d06fc4 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:19.821572 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3242c95f-eabd-443f-8ef8-c1948b360f01 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:19.829184 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b5469-2aab-46f1-8ada-c7a6c8d06fc4 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:19.834300 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5950016a-8e90-444e-972b-495d2fbbc7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:19.834879 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee391a0-72a5-47ba-aaae-b1bcb55e76bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:19.835148 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950016a-8e90-444e-972b-495d2fbbc7ec admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:19.835425 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950016a-8e90-444e-972b-495d2fbbc7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:19.835696 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950016a-8e90-444e-972b-495d2fbbc7ec admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:19.836562 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee391a0-72a5-47ba-aaae-b1bcb55e76bd admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:19.837199 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee391a0-72a5-47ba-aaae-b1bcb55e76bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:19.837735 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee391a0-72a5-47ba-aaae-b1bcb55e76bd admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:19.845376 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee391a0-72a5-47ba-aaae-b1bcb55e76bd admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:19.847659 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee391a0-72a5-47ba-aaae-b1bcb55e76bd admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:19.848060 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5950016a-8e90-444e-972b-495d2fbbc7ec admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:19.849955 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5950016a-8e90-444e-972b-495d2fbbc7ec admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:19.862311 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-3ee391a0-72a5-47ba-aaae-b1bcb55e76bd admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 24 04:47:19.868547 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-5950016a-8e90-444e-972b-495d2fbbc7ec admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:47:19.868811 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 250/500] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Dec 24 04:47:19 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:47:19.869008 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 251/501] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:47:19.870596 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928b2ff-ab1d-4987-aeb5-bc92a1497860 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:19.870883 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee391a0-72a5-47ba-aaae-b1bcb55e76bd admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:19.870982 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928b2ff-ab1d-4987-aeb5-bc92a1497860 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:19.871179 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928b2ff-ab1d-4987-aeb5-bc92a1497860 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:19.873262 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 252/502] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:19.878653 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928b2ff-ab1d-4987-aeb5-bc92a1497860 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:19.882802 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee391a0-72a5-47ba-aaae-b1bcb55e76bd admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:19.887222 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c553eaf-78c5-40c9-ad52-5b3c1d99c4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:19.888072 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c553eaf-78c5-40c9-ad52-5b3c1d99c4fb admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:19.888606 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c553eaf-78c5-40c9-ad52-5b3c1d99c4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:19.889018 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c553eaf-78c5-40c9-ad52-5b3c1d99c4fb admin admin] PATH_INFO: `/v3/projects` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:19.890048 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c553eaf-78c5-40c9-ad52-5b3c1d99c4fb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:19.890658 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c553eaf-78c5-40c9-ad52-5b3c1d99c4fb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:19.891759 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928b2ff-ab1d-4987-aeb5-bc92a1497860 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:19.892084 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING py.warnings [None req-8c553eaf-78c5-40c9-ad52-5b3c1d99c4fb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:47:19.892084 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: warnings.warn(msg) Dec 24 04:47:19.892084 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: Dec 24 04:47:19.893907 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c553eaf-78c5-40c9-ad52-5b3c1d99c4fb admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:19.896781 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9baa8f-979f-45f2-86e0-c9fee50cb751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:19.897542 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9baa8f-979f-45f2-86e0-c9fee50cb751 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:19.897883 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9baa8f-979f-45f2-86e0-c9fee50cb751 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:19.898264 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9baa8f-979f-45f2-86e0-c9fee50cb751 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:19.899495 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9baa8f-979f-45f2-86e0-c9fee50cb751 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:19.899495 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9baa8f-979f-45f2-86e0-c9fee50cb751 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:19.901300 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9baa8f-979f-45f2-86e0-c9fee50cb751 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:19.913532 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 253/503] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:47:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:19.918231 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84e05f-b72d-45ce-840b-06c51cf3a6e8 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:19.918231 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84e05f-b72d-45ce-840b-06c51cf3a6e8 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:19.918231 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84e05f-b72d-45ce-840b-06c51cf3a6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:19.918721 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 251/504] 10.222.0.43 () {56 vars in 1169 bytes} [Fri Dec 24 04:47:19 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:19.920291 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c553eaf-78c5-40c9-ad52-5b3c1d99c4fb admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:19.932188 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c553eaf-78c5-40c9-ad52-5b3c1d99c4fb admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:19.936639 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-3f84e05f-b72d-45ce-840b-06c51cf3a6e8 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:19.937536 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be74e2db-f06d-4971-b460-b38767e00016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:19.938057 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-3f84e05f-b72d-45ce-840b-06c51cf3a6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:19.938805 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74e2db-f06d-4971-b460-b38767e00016 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:19.939325 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74e2db-f06d-4971-b460-b38767e00016 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:19.939763 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74e2db-f06d-4971-b460-b38767e00016 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:19.946644 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 254/505] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:19 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:47:19.947340 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84e05f-b72d-45ce-840b-06c51cf3a6e8 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:19.948822 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be74e2db-f06d-4971-b460-b38767e00016 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:19.951079 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be74e2db-f06d-4971-b460-b38767e00016 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:19.964915 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-be74e2db-f06d-4971-b460-b38767e00016 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 24 04:47:19.966668 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 252/506] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Dec 24 04:47:19 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:19.967447 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84e05f-b72d-45ce-840b-06c51cf3a6e8 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:19.973159 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be74e2db-f06d-4971-b460-b38767e00016 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:19.982655 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc485799-070a-4316-be97-59f84861d87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:19.983324 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc485799-070a-4316-be97-59f84861d87c admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:19.983604 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc485799-070a-4316-be97-59f84861d87c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:19.983871 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc485799-070a-4316-be97-59f84861d87c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:19.984757 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc485799-070a-4316-be97-59f84861d87c admin admin] RBAC: Adding query filter params (role.id=81b14dd0538e44b4bfa9bb906718914a, scope.project.id=c19ba4a2c0224c079c5a8a6a56569fd6, user.id=c1782324ce854868bd11b32bd24b435c) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:19.985065 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc485799-070a-4316-be97-59f84861d87c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:19.985946 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be74e2db-f06d-4971-b460-b38767e00016 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:19.986919 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc485799-070a-4316-be97-59f84861d87c admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:19.991457 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2765f-8251-43f7-b51b-2044fefc43d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:19.992275 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2765f-8251-43f7-b51b-2044fefc43d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:19.992772 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2765f-8251-43f7-b51b-2044fefc43d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:19.993568 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2765f-8251-43f7-b51b-2044fefc43d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:19.994594 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af2765f-8251-43f7-b51b-2044fefc43d9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:19.995089 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af2765f-8251-43f7-b51b-2044fefc43d9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:19.996475 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 255/507] 10.222.0.43 () {56 vars in 1395 bytes} [Fri Dec 24 04:47:19 2021] GET /identity/v3/role_assignments?user.id=c1782324ce854868bd11b32bd24b435c&scope.project.id=c19ba4a2c0224c079c5a8a6a56569fd6&role.id=81b14dd0538e44b4bfa9bb906718914a => generated 259 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:19.997469 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc485799-070a-4316-be97-59f84861d87c admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:19.997783 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af2765f-8251-43f7-b51b-2044fefc43d9 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:20.009370 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc485799-070a-4316-be97-59f84861d87c admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:20.011195 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 253/508] 10.222.0.43 () {56 vars in 1169 bytes} [Fri Dec 24 04:47:19 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:20.015891 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3010833-6fc6-489b-a25f-cca26c23f50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:20.016983 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3010833-6fc6-489b-a25f-cca26c23f50e admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:20.017345 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2765f-8251-43f7-b51b-2044fefc43d9 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:20.017653 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3010833-6fc6-489b-a25f-cca26c23f50e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:20.018175 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3010833-6fc6-489b-a25f-cca26c23f50e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:20.029909 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2765f-8251-43f7-b51b-2044fefc43d9 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:20.030588 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3010833-6fc6-489b-a25f-cca26c23f50e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:47:20.034947 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e62f3-89ae-4a26-9464-d3b15ada8b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:20.035751 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e62f3-89ae-4a26-9464-d3b15ada8b2b admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:20.036126 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e62f3-89ae-4a26-9464-d3b15ada8b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:20.036491 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e62f3-89ae-4a26-9464-d3b15ada8b2b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:20.037522 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e62f3-89ae-4a26-9464-d3b15ada8b2b admin admin] RBAC: Adding query filter params (role.id=81b14dd0538e44b4bfa9bb906718914a, scope.project.id=c19ba4a2c0224c079c5a8a6a56569fd6, user.id=6f9ad1e8f8f74edcb44aabe17eb59648) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:20.037965 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e62f3-89ae-4a26-9464-d3b15ada8b2b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:20.039253 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-e3010833-6fc6-489b-a25f-cca26c23f50e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 24 04:47:20.040154 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e62f3-89ae-4a26-9464-d3b15ada8b2b admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:20.041100 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 256/509] 10.222.0.43 () {56 vars in 1123 bytes} [Fri Dec 24 04:47:19 2021] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:20.049548 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3010833-6fc6-489b-a25f-cca26c23f50e admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:20.054732 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 254/510] 10.222.0.43 () {56 vars in 1395 bytes} [Fri Dec 24 04:47:20 2021] GET /identity/v3/role_assignments?user.id=6f9ad1e8f8f74edcb44aabe17eb59648&scope.project.id=c19ba4a2c0224c079c5a8a6a56569fd6&role.id=81b14dd0538e44b4bfa9bb906718914a => generated 259 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:20.079031 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3010833-6fc6-489b-a25f-cca26c23f50e admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:20.090575 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16d928-ebd3-4abc-a716-413222794f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:20.091322 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16d928-ebd3-4abc-a716-413222794f6a admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:20.091648 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16d928-ebd3-4abc-a716-413222794f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:20.091894 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16d928-ebd3-4abc-a716-413222794f6a admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:20.092719 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f16d928-ebd3-4abc-a716-413222794f6a admin admin] RBAC: Adding query filter params (name=service) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:20.093033 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f16d928-ebd3-4abc-a716-413222794f6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:20.094745 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f16d928-ebd3-4abc-a716-413222794f6a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:20.116608 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 257/511] 10.222.0.43 () {56 vars in 1124 bytes} [Fri Dec 24 04:47:20 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:20.123333 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e62f3-89ae-4a26-9464-d3b15ada8b2b admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:20.136450 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e62f3-89ae-4a26-9464-d3b15ada8b2b admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:20.149846 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62adbfe9-2e05-4cc9-a66d-e25fdac32957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:20.151063 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62adbfe9-2e05-4cc9-a66d-e25fdac32957 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:20.151616 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62adbfe9-2e05-4cc9-a66d-e25fdac32957 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:20.152087 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62adbfe9-2e05-4cc9-a66d-e25fdac32957 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:20.156196 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f0de44-6aaf-45df-be77-2ac82e47c050 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:20.156493 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f0de44-6aaf-45df-be77-2ac82e47c050 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:20.156762 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f0de44-6aaf-45df-be77-2ac82e47c050 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:20.158588 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 258/512] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 24 04:47:20.166959 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f042c5b-3c33-4781-b6f4-950eeda539c1 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:20.167898 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f042c5b-3c33-4781-b6f4-950eeda539c1 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:20.167898 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f042c5b-3c33-4781-b6f4-950eeda539c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:20.170760 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62adbfe9-2e05-4cc9-a66d-e25fdac32957 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:20.173156 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62adbfe9-2e05-4cc9-a66d-e25fdac32957 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:20.195602 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-62adbfe9-2e05-4cc9-a66d-e25fdac32957 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:47:20.197322 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 255/513] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:20.204895 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62adbfe9-2e05-4cc9-a66d-e25fdac32957 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:20.216679 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62adbfe9-2e05-4cc9-a66d-e25fdac32957 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:20.217888 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-3f042c5b-3c33-4781-b6f4-950eeda539c1 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:20.219328 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-3f042c5b-3c33-4781-b6f4-950eeda539c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:20.222266 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc2b19-4f40-420e-ab20-e16d3608f357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:20.223272 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc2b19-4f40-420e-ab20-e16d3608f357 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:20.223780 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc2b19-4f40-420e-ab20-e16d3608f357 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:20.224309 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc2b19-4f40-420e-ab20-e16d3608f357 admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:20.225391 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bc2b19-4f40-420e-ab20-e16d3608f357 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:20.225903 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bc2b19-4f40-420e-ab20-e16d3608f357 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:20.227805 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bc2b19-4f40-420e-ab20-e16d3608f357 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:20.234415 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 259/514] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:20 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 24 04:47:20.243276 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 256/515] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:47:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:20.250198 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f042c5b-3c33-4781-b6f4-950eeda539c1 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:20.260811 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f042c5b-3c33-4781-b6f4-950eeda539c1 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:20.266075 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc2b19-4f40-420e-ab20-e16d3608f357 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:20.269769 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1217d-f682-4ec6-b3a8-f774a65e09cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:20.270602 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1217d-f682-4ec6-b3a8-f774a65e09cc admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:20.270884 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1217d-f682-4ec6-b3a8-f774a65e09cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:20.271147 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1217d-f682-4ec6-b3a8-f774a65e09cc admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:20.278805 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc2b19-4f40-420e-ab20-e16d3608f357 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:20.279414 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a1217d-f682-4ec6-b3a8-f774a65e09cc admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:20.281846 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a1217d-f682-4ec6-b3a8-f774a65e09cc admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:20.286512 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8afe524-0dea-4fe0-8eb0-e27f06a2a49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:20.287661 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afe524-0dea-4fe0-8eb0-e27f06a2a49a admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:20.288147 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afe524-0dea-4fe0-8eb0-e27f06a2a49a admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:20.288632 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afe524-0dea-4fe0-8eb0-e27f06a2a49a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:20.298814 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-c0a1217d-f682-4ec6-b3a8-f774a65e09cc admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 24 04:47:20.301063 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 260/516] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:47:20 2021] GET /identity/v3/users/cinder => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:20.302021 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8afe524-0dea-4fe0-8eb0-e27f06a2a49a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:47:20.307293 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1217d-f682-4ec6-b3a8-f774a65e09cc admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:20.310640 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-a8afe524-0dea-4fe0-8eb0-e27f06a2a49a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 24 04:47:20.312466 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 257/517] 10.222.0.43 () {56 vars in 1123 bytes} [Fri Dec 24 04:47:20 2021] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:47:20.318843 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8afe524-0dea-4fe0-8eb0-e27f06a2a49a admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:20.329959 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1217d-f682-4ec6-b3a8-f774a65e09cc admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:20.331120 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8afe524-0dea-4fe0-8eb0-e27f06a2a49a admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:20.335925 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4679d8b-5271-499b-9312-0629e420670a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:20.337047 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4679d8b-5271-499b-9312-0629e420670a admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:20.337517 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4679d8b-5271-499b-9312-0629e420670a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:20.338020 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4679d8b-5271-499b-9312-0629e420670a admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:20.339081 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4679d8b-5271-499b-9312-0629e420670a admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:20.339655 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4679d8b-5271-499b-9312-0629e420670a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:20.342680 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4679d8b-5271-499b-9312-0629e420670a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:20.349853 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e5f9a-2cbb-4b78-b209-28d72b091fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:20.350537 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e5f9a-2cbb-4b78-b209-28d72b091fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:20.350816 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e5f9a-2cbb-4b78-b209-28d72b091fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:20.351085 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e5f9a-2cbb-4b78-b209-28d72b091fa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:20.351979 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915e5f9a-2cbb-4b78-b209-28d72b091fa7 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:20.352151 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915e5f9a-2cbb-4b78-b209-28d72b091fa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:20.353803 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915e5f9a-2cbb-4b78-b209-28d72b091fa7 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:20.369764 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 261/519] 10.222.0.43 () {56 vars in 1158 bytes} [Fri Dec 24 04:47:20 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:20.369932 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 258/519] 10.222.0.43 () {56 vars in 1124 bytes} [Fri Dec 24 04:47:20 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:20.376728 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e5f9a-2cbb-4b78-b209-28d72b091fa7 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:20.380418 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4679d8b-5271-499b-9312-0629e420670a admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:20.386840 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e5f9a-2cbb-4b78-b209-28d72b091fa7 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:20.392548 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9447519-ad1c-4344-ab48-daa845e39b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:20.393408 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9447519-ad1c-4344-ab48-daa845e39b46 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:20.393728 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9447519-ad1c-4344-ab48-daa845e39b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:20.393996 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9447519-ad1c-4344-ab48-daa845e39b46 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:20.394577 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4679d8b-5271-499b-9312-0629e420670a admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:20.399126 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b0baf5-fd6d-4f35-a23f-70172136ecb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:20.399818 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0baf5-fd6d-4f35-a23f-70172136ecb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:20.400096 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0baf5-fd6d-4f35-a23f-70172136ecb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:20.400362 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0baf5-fd6d-4f35-a23f-70172136ecb4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:20.405638 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9447519-ad1c-4344-ab48-daa845e39b46 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:20.407570 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9447519-ad1c-4344-ab48-daa845e39b46 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:20.408899 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b0baf5-fd6d-4f35-a23f-70172136ecb4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:20.410646 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b0baf5-fd6d-4f35-a23f-70172136ecb4 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:20.422118 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 262/520] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:47:20 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 24 04:47:20.426064 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-e9447519-ad1c-4344-ab48-daa845e39b46 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:47:20.427928 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 259/521] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:20.428152 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b0baf5-fd6d-4f35-a23f-70172136ecb4 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:20.437609 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9447519-ad1c-4344-ab48-daa845e39b46 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:20.439276 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b0baf5-fd6d-4f35-a23f-70172136ecb4 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:20.449673 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd5658-2e11-4caf-989e-8dcbc637f042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:20.450546 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd5658-2e11-4caf-989e-8dcbc637f042 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:20.450866 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd5658-2e11-4caf-989e-8dcbc637f042 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:20.451183 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd5658-2e11-4caf-989e-8dcbc637f042 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:20.456277 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9447519-ad1c-4344-ab48-daa845e39b46 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:20.468281 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12342827-babd-4df8-805d-fe69d5449ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:20.470069 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12342827-babd-4df8-805d-fe69d5449ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:20.470347 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12342827-babd-4df8-805d-fe69d5449ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:20.470616 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12342827-babd-4df8-805d-fe69d5449ca1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:20.471705 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd5658-2e11-4caf-989e-8dcbc637f042 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:20.472807 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12342827-babd-4df8-805d-fe69d5449ca1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:20.473667 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12342827-babd-4df8-805d-fe69d5449ca1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:20.476387 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd5658-2e11-4caf-989e-8dcbc637f042 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:20.476854 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12342827-babd-4df8-805d-fe69d5449ca1 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:20.496877 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-87bd5658-2e11-4caf-989e-8dcbc637f042 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:47:20.498356 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 263/522] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:20.504130 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd5658-2e11-4caf-989e-8dcbc637f042 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:20.505843 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 260/523] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:47:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:20.511569 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12342827-babd-4df8-805d-fe69d5449ca1 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:20.517769 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd5658-2e11-4caf-989e-8dcbc637f042 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:20.521164 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12342827-babd-4df8-805d-fe69d5449ca1 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:20.525849 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65533a93-57e7-43af-ab8b-1af463f68a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:20.526641 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65533a93-57e7-43af-ab8b-1af463f68a60 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:20.526922 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65533a93-57e7-43af-ab8b-1af463f68a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:20.527283 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65533a93-57e7-43af-ab8b-1af463f68a60 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:20.528617 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60bb3b-9f79-4d2b-a833-316349dabb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:20.529351 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60bb3b-9f79-4d2b-a833-316349dabb51 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:20.529676 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60bb3b-9f79-4d2b-a833-316349dabb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:20.529944 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60bb3b-9f79-4d2b-a833-316349dabb51 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:20.530729 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e60bb3b-9f79-4d2b-a833-316349dabb51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:20.531028 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e60bb3b-9f79-4d2b-a833-316349dabb51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:20.532717 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e60bb3b-9f79-4d2b-a833-316349dabb51 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:20.535664 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65533a93-57e7-43af-ab8b-1af463f68a60 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:20.537726 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65533a93-57e7-43af-ab8b-1af463f68a60 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:20.566006 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 264/524] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:47:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:20.567044 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-65533a93-57e7-43af-ab8b-1af463f68a60 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Dec 24 04:47:20.576684 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 261/525] 10.222.0.43 () {56 vars in 1123 bytes} [Fri Dec 24 04:47:20 2021] GET /identity/v3/users/neutron => generated 85 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:47:20.578299 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60bb3b-9f79-4d2b-a833-316349dabb51 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:20.585590 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65533a93-57e7-43af-ab8b-1af463f68a60 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:20.593802 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60bb3b-9f79-4d2b-a833-316349dabb51 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:20.602722 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65533a93-57e7-43af-ab8b-1af463f68a60 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:20.603905 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80980a96-c1d5-4931-b129-fc6f9f70995e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:20.604601 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80980a96-c1d5-4931-b129-fc6f9f70995e admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:20.604882 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80980a96-c1d5-4931-b129-fc6f9f70995e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:20.605156 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80980a96-c1d5-4931-b129-fc6f9f70995e admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:20.606020 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80980a96-c1d5-4931-b129-fc6f9f70995e admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:20.606327 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80980a96-c1d5-4931-b129-fc6f9f70995e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:20.608256 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80980a96-c1d5-4931-b129-fc6f9f70995e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:20.614299 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5692da19-bf56-4044-bf7e-7a112edd3649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:20.615118 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692da19-bf56-4044-bf7e-7a112edd3649 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:20.615400 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692da19-bf56-4044-bf7e-7a112edd3649 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:20.615673 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692da19-bf56-4044-bf7e-7a112edd3649 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:20.623714 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5692da19-bf56-4044-bf7e-7a112edd3649 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:20.625704 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5692da19-bf56-4044-bf7e-7a112edd3649 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:20.639262 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 265/526] 10.222.0.43 () {56 vars in 1160 bytes} [Fri Dec 24 04:47:20 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:20.640664 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-5692da19-bf56-4044-bf7e-7a112edd3649 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 24 04:47:20.642151 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 262/527] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Dec 24 04:47:20 2021] GET /identity/v3/projects/service => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:20.645373 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80980a96-c1d5-4931-b129-fc6f9f70995e admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:20.648077 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5692da19-bf56-4044-bf7e-7a112edd3649 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:20.658148 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5692da19-bf56-4044-bf7e-7a112edd3649 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:20.658672 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80980a96-c1d5-4931-b129-fc6f9f70995e admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:20.665242 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7202151-96b5-4030-9ba8-1a032c6c4e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:20.665895 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7202151-96b5-4030-9ba8-1a032c6c4e9c admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:20.666178 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7202151-96b5-4030-9ba8-1a032c6c4e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:20.666458 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7202151-96b5-4030-9ba8-1a032c6c4e9c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:20.668415 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f639c31-a969-4944-b03b-4c2c25f1b7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:20.669402 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f639c31-a969-4944-b03b-4c2c25f1b7df admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:20.669685 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f639c31-a969-4944-b03b-4c2c25f1b7df admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:20.669961 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f639c31-a969-4944-b03b-4c2c25f1b7df admin admin] PATH_INFO: `/v3/projects` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:20.670780 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f639c31-a969-4944-b03b-4c2c25f1b7df admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:20.671089 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f639c31-a969-4944-b03b-4c2c25f1b7df admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:20.673020 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f639c31-a969-4944-b03b-4c2c25f1b7df admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:20.689423 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7202151-96b5-4030-9ba8-1a032c6c4e9c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:20.690632 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7202151-96b5-4030-9ba8-1a032c6c4e9c admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:20.692233 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 263/528] 10.222.0.43 () {56 vars in 1169 bytes} [Fri Dec 24 04:47:20 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:20.698526 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f639c31-a969-4944-b03b-4c2c25f1b7df admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:20.699936 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 266/529] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:47:20 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 24 04:47:20.709765 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7202151-96b5-4030-9ba8-1a032c6c4e9c admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:20.710382 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f639c31-a969-4944-b03b-4c2c25f1b7df admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:20.715014 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f82f468-2c9c-46dc-a045-ad618213b885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:20.716074 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82f468-2c9c-46dc-a045-ad618213b885 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:20.716491 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82f468-2c9c-46dc-a045-ad618213b885 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:20.716941 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82f468-2c9c-46dc-a045-ad618213b885 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:20.717916 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f82f468-2c9c-46dc-a045-ad618213b885 admin admin] RBAC: Adding query filter params (role.id=81b14dd0538e44b4bfa9bb906718914a, scope.project.id=c19ba4a2c0224c079c5a8a6a56569fd6, user.id=38517ab5a29c438e89634209652d9963) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:20.718344 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f82f468-2c9c-46dc-a045-ad618213b885 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:20.720311 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f82f468-2c9c-46dc-a045-ad618213b885 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:20.726404 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 264/530] 10.222.0.43 () {56 vars in 1395 bytes} [Fri Dec 24 04:47:20 2021] GET /identity/v3/role_assignments?user.id=38517ab5a29c438e89634209652d9963&scope.project.id=c19ba4a2c0224c079c5a8a6a56569fd6&role.id=81b14dd0538e44b4bfa9bb906718914a => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:20.727749 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7202151-96b5-4030-9ba8-1a032c6c4e9c admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:20.735635 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732cc67-f0e0-4a1f-82d5-07e8f8f46113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:20.737818 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732cc67-f0e0-4a1f-82d5-07e8f8f46113 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:20.737818 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732cc67-f0e0-4a1f-82d5-07e8f8f46113 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:20.737818 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732cc67-f0e0-4a1f-82d5-07e8f8f46113 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:20.749251 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1732cc67-f0e0-4a1f-82d5-07e8f8f46113 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:20.751534 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1732cc67-f0e0-4a1f-82d5-07e8f8f46113 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:20.771044 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-1732cc67-f0e0-4a1f-82d5-07e8f8f46113 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:47:20.772938 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 267/531] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:20.778862 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f82f468-2c9c-46dc-a045-ad618213b885 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:20.794734 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f82f468-2c9c-46dc-a045-ad618213b885 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:20.810542 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ebba8-fb0c-4035-aebd-fbf1f2292c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:20.811230 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ebba8-fb0c-4035-aebd-fbf1f2292c2a admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:20.811515 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ebba8-fb0c-4035-aebd-fbf1f2292c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:20.811787 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ebba8-fb0c-4035-aebd-fbf1f2292c2a admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:20.812562 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2ebba8-fb0c-4035-aebd-fbf1f2292c2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:20.812872 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2ebba8-fb0c-4035-aebd-fbf1f2292c2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:20.814531 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2ebba8-fb0c-4035-aebd-fbf1f2292c2a admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:20.837340 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 265/532] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:47:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:20.843124 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732cc67-f0e0-4a1f-82d5-07e8f8f46113 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:20.854093 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732cc67-f0e0-4a1f-82d5-07e8f8f46113 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:20.865342 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ff6f8-72c1-4894-a541-5a443495f567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:20.866402 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ff6f8-72c1-4894-a541-5a443495f567 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:20.866818 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ff6f8-72c1-4894-a541-5a443495f567 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:20.867233 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ff6f8-72c1-4894-a541-5a443495f567 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:20.880644 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ff6f8-72c1-4894-a541-5a443495f567 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:20.883085 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ff6f8-72c1-4894-a541-5a443495f567 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:20.905675 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-457ff6f8-72c1-4894-a541-5a443495f567 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 24 04:47:20.907176 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 268/533] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Dec 24 04:47:20 2021] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:20.913490 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ebba8-fb0c-4035-aebd-fbf1f2292c2a admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:20.924800 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ebba8-fb0c-4035-aebd-fbf1f2292c2a admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:20.935779 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ff36a-356d-4ad2-a565-a4804addc0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:20.936463 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ff36a-356d-4ad2-a565-a4804addc0f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:20.936771 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ff36a-356d-4ad2-a565-a4804addc0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:20.937050 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ff36a-356d-4ad2-a565-a4804addc0f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:20.937878 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528ff36a-356d-4ad2-a565-a4804addc0f6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:20.938190 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528ff36a-356d-4ad2-a565-a4804addc0f6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:20.940142 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528ff36a-356d-4ad2-a565-a4804addc0f6 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:20.966820 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 266/534] 10.222.0.43 () {56 vars in 1169 bytes} [Fri Dec 24 04:47:20 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:20.973417 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ff6f8-72c1-4894-a541-5a443495f567 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:20.988324 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ff6f8-72c1-4894-a541-5a443495f567 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:20.995680 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f791cb-d131-444e-b9f1-80caf055a5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:20.996353 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f791cb-d131-444e-b9f1-80caf055a5d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:20.996661 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f791cb-d131-444e-b9f1-80caf055a5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:20.996932 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f791cb-d131-444e-b9f1-80caf055a5d3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:20.997840 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f791cb-d131-444e-b9f1-80caf055a5d3 admin admin] RBAC: Adding query filter params (role.id=81b14dd0538e44b4bfa9bb906718914a, scope.project.id=c19ba4a2c0224c079c5a8a6a56569fd6, user.id=b36f253fbce04e9ea028f02ff57fb272) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:20.998144 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f791cb-d131-444e-b9f1-80caf055a5d3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:21.000049 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f791cb-d131-444e-b9f1-80caf055a5d3 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:21.008974 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 269/535] 10.222.0.43 () {56 vars in 1395 bytes} [Fri Dec 24 04:47:20 2021] GET /identity/v3/role_assignments?user.id=b36f253fbce04e9ea028f02ff57fb272&scope.project.id=c19ba4a2c0224c079c5a8a6a56569fd6&role.id=81b14dd0538e44b4bfa9bb906718914a => generated 259 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:21.084891 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab072c-c039-41cf-bbb0-c168d6e834a2 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:21.085177 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab072c-c039-41cf-bbb0-c168d6e834a2 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:21.085450 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab072c-c039-41cf-bbb0-c168d6e834a2 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:21.087643 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 267/536] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:21.094059 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c0125-23f2-4457-b843-3ff1f80b1567 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:21.094486 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c0125-23f2-4457-b843-3ff1f80b1567 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:21.094850 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c0125-23f2-4457-b843-3ff1f80b1567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:21.116024 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-570c0125-23f2-4457-b843-3ff1f80b1567 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:21.117412 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-570c0125-23f2-4457-b843-3ff1f80b1567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:21.129615 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 270/537] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:21 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:47:21.171563 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab072c-c039-41cf-bbb0-c168d6e834a2 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:21.187430 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab072c-c039-41cf-bbb0-c168d6e834a2 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:21.192297 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa06e628-33f1-457e-a366-042d8837337c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:21.193260 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06e628-33f1-457e-a366-042d8837337c admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:21.193638 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06e628-33f1-457e-a366-042d8837337c admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:21.194022 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06e628-33f1-457e-a366-042d8837337c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:21.214265 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa06e628-33f1-457e-a366-042d8837337c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:21.216382 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa06e628-33f1-457e-a366-042d8837337c admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:21.238063 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-aa06e628-33f1-457e-a366-042d8837337c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:47:21.239753 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 268/538] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:21.251836 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570c0125-23f2-4457-b843-3ff1f80b1567 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:21.259339 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570c0125-23f2-4457-b843-3ff1f80b1567 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:21.264297 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d6616-5ccc-426f-96e1-fd943bd215e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:21.265199 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d6616-5ccc-426f-96e1-fd943bd215e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:21.265624 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d6616-5ccc-426f-96e1-fd943bd215e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:21.266040 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d6616-5ccc-426f-96e1-fd943bd215e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:21.266956 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d6616-5ccc-426f-96e1-fd943bd215e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:21.267437 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d6616-5ccc-426f-96e1-fd943bd215e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:21.269237 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d6616-5ccc-426f-96e1-fd943bd215e6 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:21.283212 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 271/539] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:47:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:21.289408 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa06e628-33f1-457e-a366-042d8837337c admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:21.300916 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa06e628-33f1-457e-a366-042d8837337c admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:21.305707 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ca8a0-558e-4f39-832a-7b5610af4a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:21.306553 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ca8a0-558e-4f39-832a-7b5610af4a3d admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:21.306987 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ca8a0-558e-4f39-832a-7b5610af4a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:21.307441 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ca8a0-558e-4f39-832a-7b5610af4a3d admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:21.308339 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94ca8a0-558e-4f39-832a-7b5610af4a3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:21.310719 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94ca8a0-558e-4f39-832a-7b5610af4a3d admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:21.339489 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 269/540] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Dec 24 04:47:21 2021] POST /identity/v3/users => generated 247 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:47:22.858761 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff4430-3f6f-4f1b-864c-274731d5b408 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:22.859289 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff4430-3f6f-4f1b-864c-274731d5b408 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:22.859363 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff4430-3f6f-4f1b-864c-274731d5b408 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:22.861546 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 272/541] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:22.867271 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9801754-d786-4684-b8b3-727aeb1fdaf5 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:22.868109 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9801754-d786-4684-b8b3-727aeb1fdaf5 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:22.868594 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9801754-d786-4684-b8b3-727aeb1fdaf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:22.868693 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78977663-f8cb-404e-b163-9b7c15079fa0 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:22.868962 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78977663-f8cb-404e-b163-9b7c15079fa0 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:22.869273 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78977663-f8cb-404e-b163-9b7c15079fa0 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:22.871283 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 273/542] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:22.878114 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efadd2a-962a-4334-a582-f86413098f9c None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:22.878400 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efadd2a-962a-4334-a582-f86413098f9c None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:22.878676 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efadd2a-962a-4334-a582-f86413098f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:22.889382 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-e9801754-d786-4684-b8b3-727aeb1fdaf5 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:22.890861 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-e9801754-d786-4684-b8b3-727aeb1fdaf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:22.902165 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-6efadd2a-962a-4334-a582-f86413098f9c None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:22.904275 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 270/543] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:22 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 24 04:47:22.905845 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-6efadd2a-962a-4334-a582-f86413098f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:22.920616 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 274/544] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:22 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 24 04:47:22.935567 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9801754-d786-4684-b8b3-727aeb1fdaf5 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:22.945078 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9801754-d786-4684-b8b3-727aeb1fdaf5 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:22.948639 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efadd2a-962a-4334-a582-f86413098f9c None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:22.956979 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ad15c-5f7f-426e-937a-e48e6f240877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:22.958023 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ad15c-5f7f-426e-937a-e48e6f240877 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:22.958514 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ad15c-5f7f-426e-937a-e48e6f240877 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:22.959298 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ad15c-5f7f-426e-937a-e48e6f240877 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:22.965433 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efadd2a-962a-4334-a582-f86413098f9c None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:22.975106 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c405d-02f7-4e64-881e-a33de2f9e243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:22.977643 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c405d-02f7-4e64-881e-a33de2f9e243 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:22.978538 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c405d-02f7-4e64-881e-a33de2f9e243 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:22.979756 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c405d-02f7-4e64-881e-a33de2f9e243 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:22.983411 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18ad15c-5f7f-426e-937a-e48e6f240877 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:47:22.990584 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-e18ad15c-5f7f-426e-937a-e48e6f240877 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 24 04:47:22.995913 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 271/545] 10.222.0.43 () {56 vars in 1123 bytes} [Fri Dec 24 04:47:22 2021] GET /identity/v3/roles/service => generated 85 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:23.002002 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ad15c-5f7f-426e-937a-e48e6f240877 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:23.003360 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5c405d-02f7-4e64-881e-a33de2f9e243 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:47:23.010539 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-df5c405d-02f7-4e64-881e-a33de2f9e243 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 24 04:47:23.016895 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 275/546] 10.222.0.43 () {56 vars in 1123 bytes} [Fri Dec 24 04:47:22 2021] GET /identity/v3/roles/service => generated 85 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:23.025416 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c405d-02f7-4e64-881e-a33de2f9e243 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:23.027739 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ad15c-5f7f-426e-937a-e48e6f240877 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:23.039087 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c405d-02f7-4e64-881e-a33de2f9e243 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:23.043759 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e184a9-766a-493f-801b-d815660c7e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:23.045603 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e184a9-766a-493f-801b-d815660c7e13 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:23.046321 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e1e74-4fb4-4be7-9eb8-4b0e682bc057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:23.046826 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e184a9-766a-493f-801b-d815660c7e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:23.047655 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e1e74-4fb4-4be7-9eb8-4b0e682bc057 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:23.048135 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e184a9-766a-493f-801b-d815660c7e13 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:23.049128 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e184a9-766a-493f-801b-d815660c7e13 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:23.049591 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e1e74-4fb4-4be7-9eb8-4b0e682bc057 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:23.050062 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e1e74-4fb4-4be7-9eb8-4b0e682bc057 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:23.051012 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e1e74-4fb4-4be7-9eb8-4b0e682bc057 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:23.051502 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e184a9-766a-493f-801b-d815660c7e13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:23.053354 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e184a9-766a-493f-801b-d815660c7e13 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:23.053858 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e1e74-4fb4-4be7-9eb8-4b0e682bc057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:23.055663 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e1e74-4fb4-4be7-9eb8-4b0e682bc057 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:23.070903 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 272/547] 10.222.0.43 () {56 vars in 1124 bytes} [Fri Dec 24 04:47:23 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:23.073727 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 276/548] 10.222.0.43 () {56 vars in 1124 bytes} [Fri Dec 24 04:47:23 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:23.076895 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e184a9-766a-493f-801b-d815660c7e13 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:23.079302 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e1e74-4fb4-4be7-9eb8-4b0e682bc057 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:23.094500 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e184a9-766a-493f-801b-d815660c7e13 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:23.096801 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e1e74-4fb4-4be7-9eb8-4b0e682bc057 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:23.105075 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b35439e-e3ca-46b9-b1ee-9680c517ea45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:23.105832 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e13d7b-4343-41c3-ad19-458ec294733b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:23.107021 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35439e-e3ca-46b9-b1ee-9680c517ea45 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:23.108018 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e13d7b-4343-41c3-ad19-458ec294733b admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:23.108486 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e13d7b-4343-41c3-ad19-458ec294733b admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:23.109014 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e13d7b-4343-41c3-ad19-458ec294733b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:23.112932 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35439e-e3ca-46b9-b1ee-9680c517ea45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:23.113221 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35439e-e3ca-46b9-b1ee-9680c517ea45 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:23.125514 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e13d7b-4343-41c3-ad19-458ec294733b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:23.127675 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e13d7b-4343-41c3-ad19-458ec294733b admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:23.138620 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b35439e-e3ca-46b9-b1ee-9680c517ea45 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:23.140830 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b35439e-e3ca-46b9-b1ee-9680c517ea45 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:23.154660 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-32e13d7b-4343-41c3-ad19-458ec294733b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:47:23.156586 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 273/549] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:47:23.162763 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e13d7b-4343-41c3-ad19-458ec294733b admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:23.171301 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-0b35439e-e3ca-46b9-b1ee-9680c517ea45 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:47:23.180913 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e13d7b-4343-41c3-ad19-458ec294733b admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:23.182792 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 277/550] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 104 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:23.188306 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b35439e-e3ca-46b9-b1ee-9680c517ea45 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:23.194173 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fef303-7f5d-4223-b2b5-197f74226975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:23.195080 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fef303-7f5d-4223-b2b5-197f74226975 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:23.195569 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fef303-7f5d-4223-b2b5-197f74226975 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:23.196025 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fef303-7f5d-4223-b2b5-197f74226975 admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:23.197867 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fef303-7f5d-4223-b2b5-197f74226975 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:23.198718 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fef303-7f5d-4223-b2b5-197f74226975 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:23.201838 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fef303-7f5d-4223-b2b5-197f74226975 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:23.205918 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b35439e-e3ca-46b9-b1ee-9680c517ea45 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:23.220284 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84582c01-a33d-4453-982b-d3a60fb0edc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:23.221318 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84582c01-a33d-4453-982b-d3a60fb0edc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:23.221808 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84582c01-a33d-4453-982b-d3a60fb0edc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:23.222324 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84582c01-a33d-4453-982b-d3a60fb0edc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:23.223298 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84582c01-a33d-4453-982b-d3a60fb0edc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:23.223789 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84582c01-a33d-4453-982b-d3a60fb0edc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:23.225632 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84582c01-a33d-4453-982b-d3a60fb0edc0 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:23.227994 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 274/551] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:47:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:23.234727 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fef303-7f5d-4223-b2b5-197f74226975 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:23.243438 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 278/552] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:47:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:23.250011 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fef303-7f5d-4223-b2b5-197f74226975 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:23.250688 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84582c01-a33d-4453-982b-d3a60fb0edc0 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:23.261475 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84582c01-a33d-4453-982b-d3a60fb0edc0 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:23.267075 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793161b7-091f-4f2d-bb94-06b62f26ba92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:23.268279 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793161b7-091f-4f2d-bb94-06b62f26ba92 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:23.268794 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793161b7-091f-4f2d-bb94-06b62f26ba92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:23.269288 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793161b7-091f-4f2d-bb94-06b62f26ba92 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:23.269390 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81fc40d-bfd4-465b-bb1c-2869a279934d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:23.270273 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fc40d-bfd4-465b-bb1c-2869a279934d admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:23.270548 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fc40d-bfd4-465b-bb1c-2869a279934d admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:23.270824 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fc40d-bfd4-465b-bb1c-2869a279934d admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:23.281510 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793161b7-091f-4f2d-bb94-06b62f26ba92 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:23.284174 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793161b7-091f-4f2d-bb94-06b62f26ba92 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:23.285542 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81fc40d-bfd4-465b-bb1c-2869a279934d admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:23.287657 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81fc40d-bfd4-465b-bb1c-2869a279934d admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:23.301688 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-793161b7-091f-4f2d-bb94-06b62f26ba92 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Dec 24 04:47:23.303738 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 279/553] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:47:23 2021] GET /identity/v3/users/glance => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:23.313829 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-b81fc40d-bfd4-465b-bb1c-2869a279934d admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 24 04:47:23.317637 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793161b7-091f-4f2d-bb94-06b62f26ba92 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:23.322241 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 275/554] 10.222.0.43 () {56 vars in 1114 bytes} [Fri Dec 24 04:47:23 2021] GET /identity/v3/users/nova => generated 82 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:47:23.329575 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81fc40d-bfd4-465b-bb1c-2869a279934d admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:23.331957 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793161b7-091f-4f2d-bb94-06b62f26ba92 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:23.344318 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433e045-bc0f-49e0-8abd-4fceb1f24089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:23.345230 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433e045-bc0f-49e0-8abd-4fceb1f24089 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:23.346896 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433e045-bc0f-49e0-8abd-4fceb1f24089 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:23.347171 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433e045-bc0f-49e0-8abd-4fceb1f24089 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:23.348039 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0433e045-bc0f-49e0-8abd-4fceb1f24089 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:23.348960 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81fc40d-bfd4-465b-bb1c-2869a279934d admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:23.349992 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0433e045-bc0f-49e0-8abd-4fceb1f24089 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:23.352371 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0433e045-bc0f-49e0-8abd-4fceb1f24089 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:23.358653 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c965b9-e1c4-416a-86e6-bc1fe18c075b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:23.359617 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c965b9-e1c4-416a-86e6-bc1fe18c075b admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:23.359842 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c965b9-e1c4-416a-86e6-bc1fe18c075b admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:23.361726 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c965b9-e1c4-416a-86e6-bc1fe18c075b admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:23.362608 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c965b9-e1c4-416a-86e6-bc1fe18c075b admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:23.362923 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c965b9-e1c4-416a-86e6-bc1fe18c075b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:23.367593 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c965b9-e1c4-416a-86e6-bc1fe18c075b admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:23.387870 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 280/555] 10.222.0.43 () {56 vars in 1158 bytes} [Fri Dec 24 04:47:23 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:23.396408 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 276/556] 10.222.0.43 () {56 vars in 1154 bytes} [Fri Dec 24 04:47:23 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:23.398113 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433e045-bc0f-49e0-8abd-4fceb1f24089 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:23.403557 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c965b9-e1c4-416a-86e6-bc1fe18c075b admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:23.415226 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c965b9-e1c4-416a-86e6-bc1fe18c075b admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:23.416590 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433e045-bc0f-49e0-8abd-4fceb1f24089 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:23.425056 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c4214b-be16-48d6-afdb-95f7bba85f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:23.425888 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d9b165-5427-4b93-8543-23951317085d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:23.427184 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9b165-5427-4b93-8543-23951317085d admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:23.427945 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c4214b-be16-48d6-afdb-95f7bba85f20 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:23.428387 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c4214b-be16-48d6-afdb-95f7bba85f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:23.428838 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9b165-5427-4b93-8543-23951317085d admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:23.429393 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c4214b-be16-48d6-afdb-95f7bba85f20 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:23.429857 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9b165-5427-4b93-8543-23951317085d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:23.449918 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c4214b-be16-48d6-afdb-95f7bba85f20 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:23.451385 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d9b165-5427-4b93-8543-23951317085d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:23.453346 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c4214b-be16-48d6-afdb-95f7bba85f20 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:23.455859 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d9b165-5427-4b93-8543-23951317085d admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:23.488140 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-d5c4214b-be16-48d6-afdb-95f7bba85f20 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:47:23.489903 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-b2d9b165-5427-4b93-8543-23951317085d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:47:23.492891 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 281/557] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:23.496808 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 277/558] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:23.498062 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d9b165-5427-4b93-8543-23951317085d admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:23.501510 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c4214b-be16-48d6-afdb-95f7bba85f20 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:23.509738 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d9b165-5427-4b93-8543-23951317085d admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:23.514588 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f642e605-4c93-4fef-b24a-b4177e399f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:23.515491 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642e605-4c93-4fef-b24a-b4177e399f8c admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:23.515960 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642e605-4c93-4fef-b24a-b4177e399f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:23.516481 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642e605-4c93-4fef-b24a-b4177e399f8c admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:23.517448 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f642e605-4c93-4fef-b24a-b4177e399f8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:23.517966 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f642e605-4c93-4fef-b24a-b4177e399f8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:23.519744 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f642e605-4c93-4fef-b24a-b4177e399f8c admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:23.522842 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c4214b-be16-48d6-afdb-95f7bba85f20 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:23.532687 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 282/559] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:47:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:23.544542 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae653d-ec7b-49f8-9fb6-cc80a0b95cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:23.544542 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae653d-ec7b-49f8-9fb6-cc80a0b95cac admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:23.544542 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae653d-ec7b-49f8-9fb6-cc80a0b95cac admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:23.544542 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae653d-ec7b-49f8-9fb6-cc80a0b95cac admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:23.544978 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ae653d-ec7b-49f8-9fb6-cc80a0b95cac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:23.544978 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ae653d-ec7b-49f8-9fb6-cc80a0b95cac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:23.544978 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ae653d-ec7b-49f8-9fb6-cc80a0b95cac admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:23.545829 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f642e605-4c93-4fef-b24a-b4177e399f8c admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:23.565566 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 278/560] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:47:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:23.567903 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f642e605-4c93-4fef-b24a-b4177e399f8c admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:23.572601 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae653d-ec7b-49f8-9fb6-cc80a0b95cac admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:23.579845 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d9e93-7039-4041-b838-bffa7d4c1ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:23.581726 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d9e93-7039-4041-b838-bffa7d4c1ddd admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:23.582011 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d9e93-7039-4041-b838-bffa7d4c1ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:23.582285 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d9e93-7039-4041-b838-bffa7d4c1ddd admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:23.585612 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae653d-ec7b-49f8-9fb6-cc80a0b95cac admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:23.590390 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e54bf-1b7d-4341-9159-816d6191bcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:23.591521 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e54bf-1b7d-4341-9159-816d6191bcdb admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:23.592026 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e54bf-1b7d-4341-9159-816d6191bcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:23.592470 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e54bf-1b7d-4341-9159-816d6191bcdb admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:23.596188 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8d9e93-7039-4041-b838-bffa7d4c1ddd admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:23.598184 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8d9e93-7039-4041-b838-bffa7d4c1ddd admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:23.605770 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1e54bf-1b7d-4341-9159-816d6191bcdb admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:23.608057 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1e54bf-1b7d-4341-9159-816d6191bcdb admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:23.630079 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-fe8d9e93-7039-4041-b838-bffa7d4c1ddd admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 24 04:47:23.631576 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 283/561] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Dec 24 04:47:23 2021] GET /identity/v3/projects/service => generated 88 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:23.638268 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-be1e54bf-1b7d-4341-9159-816d6191bcdb admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 24 04:47:23.639917 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 279/562] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Dec 24 04:47:23 2021] GET /identity/v3/projects/service => generated 88 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:47:23.642070 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d9e93-7039-4041-b838-bffa7d4c1ddd admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:23.646844 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e54bf-1b7d-4341-9159-816d6191bcdb admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:23.658350 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d9e93-7039-4041-b838-bffa7d4c1ddd admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:23.663147 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e54bf-1b7d-4341-9159-816d6191bcdb admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:23.666555 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dfba02-bc44-42f6-b586-66f22928acf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:23.667468 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dfba02-bc44-42f6-b586-66f22928acf3 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:23.668036 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dfba02-bc44-42f6-b586-66f22928acf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:23.668556 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dfba02-bc44-42f6-b586-66f22928acf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:23.669710 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dfba02-bc44-42f6-b586-66f22928acf3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:23.670273 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dfba02-bc44-42f6-b586-66f22928acf3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:23.671513 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING py.warnings [None req-f2dfba02-bc44-42f6-b586-66f22928acf3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:47:23.671513 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: warnings.warn(msg) Dec 24 04:47:23.671513 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: Dec 24 04:47:23.673255 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dfba02-bc44-42f6-b586-66f22928acf3 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:23.674010 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b12d1-ac19-4d59-946f-3e2d7126084c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:23.674676 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b12d1-ac19-4d59-946f-3e2d7126084c admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:23.674952 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b12d1-ac19-4d59-946f-3e2d7126084c admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:23.675220 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b12d1-ac19-4d59-946f-3e2d7126084c admin admin] PATH_INFO: `/v3/projects` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:23.676026 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14b12d1-ac19-4d59-946f-3e2d7126084c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:23.676327 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14b12d1-ac19-4d59-946f-3e2d7126084c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:23.678192 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14b12d1-ac19-4d59-946f-3e2d7126084c admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:23.694150 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 284/563] 10.222.0.43 () {56 vars in 1169 bytes} [Fri Dec 24 04:47:23 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:23.700877 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dfba02-bc44-42f6-b586-66f22928acf3 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:23.702620 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 280/564] 10.222.0.43 () {56 vars in 1169 bytes} [Fri Dec 24 04:47:23 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:23.706359 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4c98a-0779-4c6c-9c8a-a9e715cc0187 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:23.706640 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4c98a-0779-4c6c-9c8a-a9e715cc0187 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:23.706908 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4c98a-0779-4c6c-9c8a-a9e715cc0187 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:23.708684 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 281/565] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:23.712515 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dfba02-bc44-42f6-b586-66f22928acf3 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:23.712825 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d4c98a-0779-4c6c-9c8a-a9e715cc0187 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:23.721719 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b842f-2c9e-4de0-8d39-e94defd90698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:23.722656 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b842f-2c9e-4de0-8d39-e94defd90698 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:23.722937 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b842f-2c9e-4de0-8d39-e94defd90698 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:23.723256 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b842f-2c9e-4de0-8d39-e94defd90698 admin admin] PATH_INFO: `/v3/projects/c19ba4a2c0224c079c5a8a6a56569fd6/users/6f9ad1e8f8f74edcb44aabe17eb59648/roles/81b14dd0538e44b4bfa9bb906718914a` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:23.727492 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d4c98a-0779-4c6c-9c8a-a9e715cc0187 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:23.732341 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7aa465-c9e6-4924-b044-3ddf98cd5aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:23.733499 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7aa465-c9e6-4924-b044-3ddf98cd5aa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:23.733970 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7aa465-c9e6-4924-b044-3ddf98cd5aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:23.734432 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7aa465-c9e6-4924-b044-3ddf98cd5aa7 admin admin] PATH_INFO: `/v3/projects/c19ba4a2c0224c079c5a8a6a56569fd6/users/c1782324ce854868bd11b32bd24b435c/roles/81b14dd0538e44b4bfa9bb906718914a` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:23.739595 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b842f-2c9e-4de0-8d39-e94defd90698 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c19ba4a2c0224c079c5a8a6a56569fd6, user_id=6f9ad1e8f8f74edcb44aabe17eb59648, role_id=81b14dd0538e44b4bfa9bb906718914a)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:23.742608 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b842f-2c9e-4de0-8d39-e94defd90698 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:23.752665 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7aa465-c9e6-4924-b044-3ddf98cd5aa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c19ba4a2c0224c079c5a8a6a56569fd6, user_id=c1782324ce854868bd11b32bd24b435c, role_id=81b14dd0538e44b4bfa9bb906718914a)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:23.756622 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7aa465-c9e6-4924-b044-3ddf98cd5aa7 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:23.758533 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 285/566] 10.222.0.43 () {58 vars in 1460 bytes} [Fri Dec 24 04:47:23 2021] PUT /identity/v3/projects/c19ba4a2c0224c079c5a8a6a56569fd6/users/6f9ad1e8f8f74edcb44aabe17eb59648/roles/81b14dd0538e44b4bfa9bb906718914a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 04:47:23.759963 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387feee-0141-4ff5-bc64-fbac6f234759 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:23.760282 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387feee-0141-4ff5-bc64-fbac6f234759 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:23.760976 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387feee-0141-4ff5-bc64-fbac6f234759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:23.774396 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 282/567] 10.222.0.43 () {58 vars in 1460 bytes} [Fri Dec 24 04:47:23 2021] PUT /identity/v3/projects/c19ba4a2c0224c079c5a8a6a56569fd6/users/c1782324ce854868bd11b32bd24b435c/roles/81b14dd0538e44b4bfa9bb906718914a => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 04:47:23.776094 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d83532-d8e8-4ccd-9022-9bd760d1ef0f None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:23.776546 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d83532-d8e8-4ccd-9022-9bd760d1ef0f None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:23.776962 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d83532-d8e8-4ccd-9022-9bd760d1ef0f None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:23.779222 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 283/568] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:23.786750 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2194f2-8080-4b03-b583-88d4ce09aae8 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:23.787439 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2194f2-8080-4b03-b583-88d4ce09aae8 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:23.787855 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2194f2-8080-4b03-b583-88d4ce09aae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:23.796300 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-6387feee-0141-4ff5-bc64-fbac6f234759 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:23.797460 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-6387feee-0141-4ff5-bc64-fbac6f234759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:23.808067 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-aa2194f2-8080-4b03-b583-88d4ce09aae8 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:23.809621 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-aa2194f2-8080-4b03-b583-88d4ce09aae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:23.888992 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 284/569] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:23 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 24 04:47:23.914964 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 286/570] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:23 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:47:23.918721 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2194f2-8080-4b03-b583-88d4ce09aae8 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:23.928739 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2194f2-8080-4b03-b583-88d4ce09aae8 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:23.933758 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293fbe3e-27f2-4c9e-9700-69517754a451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:23.934794 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293fbe3e-27f2-4c9e-9700-69517754a451 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:23.935078 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293fbe3e-27f2-4c9e-9700-69517754a451 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:23.935349 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293fbe3e-27f2-4c9e-9700-69517754a451 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:23.948447 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293fbe3e-27f2-4c9e-9700-69517754a451 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:47:23.950932 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387feee-0141-4ff5-bc64-fbac6f234759 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:23.962165 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387feee-0141-4ff5-bc64-fbac6f234759 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:23.972160 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677885b3-299c-464d-9510-6a57f24523be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:23.973024 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677885b3-299c-464d-9510-6a57f24523be admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:23.973354 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677885b3-299c-464d-9510-6a57f24523be admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:23.973624 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677885b3-299c-464d-9510-6a57f24523be admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:23.974526 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-293fbe3e-27f2-4c9e-9700-69517754a451 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 24 04:47:23.976057 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 285/571] 10.222.0.43 () {56 vars in 1123 bytes} [Fri Dec 24 04:47:23 2021] GET /identity/v3/roles/service => generated 85 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:23.986863 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293fbe3e-27f2-4c9e-9700-69517754a451 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:24.000414 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293fbe3e-27f2-4c9e-9700-69517754a451 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:24.002630 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677885b3-299c-464d-9510-6a57f24523be admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:47:24.006212 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79bcd08-0960-4e08-911e-1e4e0528a1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:24.007165 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bcd08-0960-4e08-911e-1e4e0528a1a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:24.007542 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bcd08-0960-4e08-911e-1e4e0528a1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:24.007911 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bcd08-0960-4e08-911e-1e4e0528a1a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:24.008851 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79bcd08-0960-4e08-911e-1e4e0528a1a2 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:24.009254 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79bcd08-0960-4e08-911e-1e4e0528a1a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:24.009781 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-677885b3-299c-464d-9510-6a57f24523be admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 24 04:47:24.011255 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 287/572] 10.222.0.43 () {56 vars in 1123 bytes} [Fri Dec 24 04:47:23 2021] GET /identity/v3/roles/service => generated 85 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:47:24.011363 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79bcd08-0960-4e08-911e-1e4e0528a1a2 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:24.017367 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677885b3-299c-464d-9510-6a57f24523be admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:24.021751 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 286/573] 10.222.0.43 () {56 vars in 1124 bytes} [Fri Dec 24 04:47:23 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:24.027824 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677885b3-299c-464d-9510-6a57f24523be admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:24.028014 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79bcd08-0960-4e08-911e-1e4e0528a1a2 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:24.032977 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc559cc-3fdf-403c-9c98-702b6ee004cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:24.034102 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc559cc-3fdf-403c-9c98-702b6ee004cb admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:24.034558 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc559cc-3fdf-403c-9c98-702b6ee004cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:24.034998 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc559cc-3fdf-403c-9c98-702b6ee004cb admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:24.036336 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc559cc-3fdf-403c-9c98-702b6ee004cb admin admin] RBAC: Adding query filter params (name=service) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:24.036806 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc559cc-3fdf-403c-9c98-702b6ee004cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:24.038572 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc559cc-3fdf-403c-9c98-702b6ee004cb admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:24.044351 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79bcd08-0960-4e08-911e-1e4e0528a1a2 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:24.050140 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 288/574] 10.222.0.43 () {56 vars in 1124 bytes} [Fri Dec 24 04:47:24 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:24.051605 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d149f-1a16-442a-8093-77d75bb879f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:24.052606 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d149f-1a16-442a-8093-77d75bb879f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:24.053024 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d149f-1a16-442a-8093-77d75bb879f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:24.053425 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d149f-1a16-442a-8093-77d75bb879f9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:24.055827 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc559cc-3fdf-403c-9c98-702b6ee004cb admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:24.066603 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc559cc-3fdf-403c-9c98-702b6ee004cb admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:24.067288 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54d149f-1a16-442a-8093-77d75bb879f9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:24.069658 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54d149f-1a16-442a-8093-77d75bb879f9 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:24.071261 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f9d5a5-b3dc-4e4a-9df0-a2da99767603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:24.072211 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9d5a5-b3dc-4e4a-9df0-a2da99767603 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:24.072491 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9d5a5-b3dc-4e4a-9df0-a2da99767603 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:24.072851 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9d5a5-b3dc-4e4a-9df0-a2da99767603 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:24.084731 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f9d5a5-b3dc-4e4a-9df0-a2da99767603 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:24.086684 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f9d5a5-b3dc-4e4a-9df0-a2da99767603 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:24.092156 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-c54d149f-1a16-442a-8093-77d75bb879f9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:47:24.094004 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 287/575] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:24 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:47:24.100781 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d149f-1a16-442a-8093-77d75bb879f9 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:24.108262 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-46f9d5a5-b3dc-4e4a-9df0-a2da99767603 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:47:24.109536 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 289/576] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:24 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:47:24.112558 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d149f-1a16-442a-8093-77d75bb879f9 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:24.115775 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f9d5a5-b3dc-4e4a-9df0-a2da99767603 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:24.117523 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda6a9bb-35bc-4bdc-88eb-5b3cfdb6613a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:24.118472 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda6a9bb-35bc-4bdc-88eb-5b3cfdb6613a admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:24.118947 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda6a9bb-35bc-4bdc-88eb-5b3cfdb6613a admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:24.119411 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda6a9bb-35bc-4bdc-88eb-5b3cfdb6613a admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:24.120358 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda6a9bb-35bc-4bdc-88eb-5b3cfdb6613a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:24.120840 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda6a9bb-35bc-4bdc-88eb-5b3cfdb6613a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:24.123019 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda6a9bb-35bc-4bdc-88eb-5b3cfdb6613a admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:24.127228 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f9d5a5-b3dc-4e4a-9df0-a2da99767603 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:24.133555 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e51b3-afa0-448c-aea3-44809a812879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:24.134267 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e51b3-afa0-448c-aea3-44809a812879 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:24.134543 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e51b3-afa0-448c-aea3-44809a812879 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:24.134823 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e51b3-afa0-448c-aea3-44809a812879 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:24.135730 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e51b3-afa0-448c-aea3-44809a812879 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:24.135994 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e51b3-afa0-448c-aea3-44809a812879 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:24.137828 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e51b3-afa0-448c-aea3-44809a812879 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:24.138448 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 288/577] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:47:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:24.144591 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda6a9bb-35bc-4bdc-88eb-5b3cfdb6613a admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:24.151240 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 290/578] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:47:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:24.156970 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda6a9bb-35bc-4bdc-88eb-5b3cfdb6613a admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:24.157349 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e51b3-afa0-448c-aea3-44809a812879 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:24.161852 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034933b9-fd8f-4283-be77-f272fcb46053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:24.163022 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034933b9-fd8f-4283-be77-f272fcb46053 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:24.164000 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034933b9-fd8f-4283-be77-f272fcb46053 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:24.164441 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034933b9-fd8f-4283-be77-f272fcb46053 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:24.167249 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e51b3-afa0-448c-aea3-44809a812879 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:24.173734 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34058f2-9516-4f20-b0d9-871c14a30506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:24.174268 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034933b9-fd8f-4283-be77-f272fcb46053 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:24.174540 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34058f2-9516-4f20-b0d9-871c14a30506 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:24.174865 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34058f2-9516-4f20-b0d9-871c14a30506 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:24.175135 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34058f2-9516-4f20-b0d9-871c14a30506 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:24.177114 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034933b9-fd8f-4283-be77-f272fcb46053 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:24.188084 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34058f2-9516-4f20-b0d9-871c14a30506 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:24.190282 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34058f2-9516-4f20-b0d9-871c14a30506 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:24.193334 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-034933b9-fd8f-4283-be77-f272fcb46053 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 24 04:47:24.195605 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 289/579] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:47:24 2021] GET /identity/v3/users/cinder => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:24.201291 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034933b9-fd8f-4283-be77-f272fcb46053 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:24.206957 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-f34058f2-9516-4f20-b0d9-871c14a30506 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Dec 24 04:47:24.208335 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 291/580] 10.222.0.43 () {56 vars in 1123 bytes} [Fri Dec 24 04:47:24 2021] GET /identity/v3/users/neutron => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:47:24.214437 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34058f2-9516-4f20-b0d9-871c14a30506 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:24.216819 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034933b9-fd8f-4283-be77-f272fcb46053 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:24.222070 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2545df-64b3-4b6f-9c07-9790c605b78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:24.222923 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2545df-64b3-4b6f-9c07-9790c605b78a admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:24.223612 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2545df-64b3-4b6f-9c07-9790c605b78a admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:24.224051 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2545df-64b3-4b6f-9c07-9790c605b78a admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:24.225102 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2545df-64b3-4b6f-9c07-9790c605b78a admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:24.225560 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2545df-64b3-4b6f-9c07-9790c605b78a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:24.225667 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34058f2-9516-4f20-b0d9-871c14a30506 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:24.227748 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2545df-64b3-4b6f-9c07-9790c605b78a admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:24.232547 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5765f6f-5c18-4f3a-9a2e-523e3b5c772d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:24.233695 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5765f6f-5c18-4f3a-9a2e-523e3b5c772d admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:24.234146 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5765f6f-5c18-4f3a-9a2e-523e3b5c772d admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:24.234629 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5765f6f-5c18-4f3a-9a2e-523e3b5c772d admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:24.235981 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5765f6f-5c18-4f3a-9a2e-523e3b5c772d admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:24.236325 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5765f6f-5c18-4f3a-9a2e-523e3b5c772d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:24.238437 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5765f6f-5c18-4f3a-9a2e-523e3b5c772d admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:24.250531 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 290/581] 10.222.0.43 () {56 vars in 1158 bytes} [Fri Dec 24 04:47:24 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:24.258137 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2545df-64b3-4b6f-9c07-9790c605b78a admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:24.261089 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 292/582] 10.222.0.43 () {56 vars in 1160 bytes} [Fri Dec 24 04:47:24 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:24.269305 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5765f6f-5c18-4f3a-9a2e-523e3b5c772d admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:24.278231 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2545df-64b3-4b6f-9c07-9790c605b78a admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:24.285844 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5765f6f-5c18-4f3a-9a2e-523e3b5c772d admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:24.288201 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c8961-d801-462a-b975-e5c7fe52bdd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:24.289072 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c8961-d801-462a-b975-e5c7fe52bdd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:24.289396 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c8961-d801-462a-b975-e5c7fe52bdd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:24.289666 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c8961-d801-462a-b975-e5c7fe52bdd2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:24.296933 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e33fed5-9437-4db1-abc0-383c6a860f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:24.298443 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33fed5-9437-4db1-abc0-383c6a860f36 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:24.298720 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33fed5-9437-4db1-abc0-383c6a860f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:24.298986 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33fed5-9437-4db1-abc0-383c6a860f36 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:24.316783 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c8961-d801-462a-b975-e5c7fe52bdd2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:24.320052 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c8961-d801-462a-b975-e5c7fe52bdd2 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:24.322789 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e33fed5-9437-4db1-abc0-383c6a860f36 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:24.328267 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e33fed5-9437-4db1-abc0-383c6a860f36 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:24.350717 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-b57c8961-d801-462a-b975-e5c7fe52bdd2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:47:24.356690 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 291/583] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:24 2021] GET /identity/v3/domains/Default => generated 87 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:24.360316 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-3e33fed5-9437-4db1-abc0-383c6a860f36 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:47:24.362212 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c8961-d801-462a-b975-e5c7fe52bdd2 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:24.367823 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 293/584] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:24 2021] GET /identity/v3/domains/Default => generated 87 bytes in 101 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:24.376953 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c8961-d801-462a-b975-e5c7fe52bdd2 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:24.378940 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e33fed5-9437-4db1-abc0-383c6a860f36 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:24.384653 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad2fa5b-caea-4c77-9069-1c2bac37cde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:24.386076 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2fa5b-caea-4c77-9069-1c2bac37cde7 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:24.386836 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2fa5b-caea-4c77-9069-1c2bac37cde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:24.387312 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2fa5b-caea-4c77-9069-1c2bac37cde7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:24.388311 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad2fa5b-caea-4c77-9069-1c2bac37cde7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:24.388675 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e33fed5-9437-4db1-abc0-383c6a860f36 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:24.392918 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad2fa5b-caea-4c77-9069-1c2bac37cde7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:24.394412 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad2fa5b-caea-4c77-9069-1c2bac37cde7 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:24.404848 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e6211e-531f-454a-a648-1959763465b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:24.405492 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6211e-531f-454a-a648-1959763465b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:24.405764 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6211e-531f-454a-a648-1959763465b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:24.406031 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6211e-531f-454a-a648-1959763465b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:24.406767 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e6211e-531f-454a-a648-1959763465b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:24.407110 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e6211e-531f-454a-a648-1959763465b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:24.408765 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e6211e-531f-454a-a648-1959763465b2 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:24.419427 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 292/585] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:47:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:24.424991 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad2fa5b-caea-4c77-9069-1c2bac37cde7 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:24.431942 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 294/586] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:47:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:24.435170 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad2fa5b-caea-4c77-9069-1c2bac37cde7 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:24.439162 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e6211e-531f-454a-a648-1959763465b2 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:24.441255 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e86d3a-7e96-45ae-a05a-2b6e5c11ed9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:24.442113 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e86d3a-7e96-45ae-a05a-2b6e5c11ed9e admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:24.442460 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e86d3a-7e96-45ae-a05a-2b6e5c11ed9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:24.442864 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e86d3a-7e96-45ae-a05a-2b6e5c11ed9e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:24.451126 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e86d3a-7e96-45ae-a05a-2b6e5c11ed9e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:24.453295 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e86d3a-7e96-45ae-a05a-2b6e5c11ed9e admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:24.459209 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e6211e-531f-454a-a648-1959763465b2 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:24.468317 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-87e86d3a-7e96-45ae-a05a-2b6e5c11ed9e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 24 04:47:24.469563 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 293/587] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Dec 24 04:47:24 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:47:24.471264 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4fae4e-c076-42b0-b4a5-79a137bcb273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:24.472067 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4fae4e-c076-42b0-b4a5-79a137bcb273 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:24.472358 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4fae4e-c076-42b0-b4a5-79a137bcb273 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:24.473241 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4fae4e-c076-42b0-b4a5-79a137bcb273 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:24.477668 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e86d3a-7e96-45ae-a05a-2b6e5c11ed9e admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:24.480801 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4fae4e-c076-42b0-b4a5-79a137bcb273 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:24.483150 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4fae4e-c076-42b0-b4a5-79a137bcb273 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:24.495777 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e86d3a-7e96-45ae-a05a-2b6e5c11ed9e admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:24.497869 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-4d4fae4e-c076-42b0-b4a5-79a137bcb273 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 24 04:47:24.499567 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 295/588] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Dec 24 04:47:24 2021] GET /identity/v3/projects/service => generated 88 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:47:24.506335 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4fae4e-c076-42b0-b4a5-79a137bcb273 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:24.510916 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d428e-3fb5-4df6-afda-eba1656c3771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:24.512484 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d428e-3fb5-4df6-afda-eba1656c3771 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:24.513303 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d428e-3fb5-4df6-afda-eba1656c3771 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:24.513755 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d428e-3fb5-4df6-afda-eba1656c3771 admin admin] PATH_INFO: `/v3/projects` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:24.514796 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d428e-3fb5-4df6-afda-eba1656c3771 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:24.515170 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4fae4e-c076-42b0-b4a5-79a137bcb273 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:24.515494 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d428e-3fb5-4df6-afda-eba1656c3771 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:24.518177 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d428e-3fb5-4df6-afda-eba1656c3771 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:24.525228 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1c704-4749-471f-af33-d65237ae77c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:24.525872 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1c704-4749-471f-af33-d65237ae77c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:24.526139 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1c704-4749-471f-af33-d65237ae77c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:24.526406 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1c704-4749-471f-af33-d65237ae77c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:24.527201 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd1c704-4749-471f-af33-d65237ae77c5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:24.527505 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd1c704-4749-471f-af33-d65237ae77c5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:24.529795 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd1c704-4749-471f-af33-d65237ae77c5 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:24.542815 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 294/589] 10.222.0.43 () {56 vars in 1169 bytes} [Fri Dec 24 04:47:24 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:24.548982 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d428e-3fb5-4df6-afda-eba1656c3771 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:24.557291 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 296/590] 10.222.0.43 () {56 vars in 1169 bytes} [Fri Dec 24 04:47:24 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:24.558505 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d428e-3fb5-4df6-afda-eba1656c3771 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:24.563233 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd5ecad-e86d-4cfe-bb2f-68b7c44cd2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:24.563501 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1c704-4749-471f-af33-d65237ae77c5 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:24.564144 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5ecad-e86d-4cfe-bb2f-68b7c44cd2c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:24.564421 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5ecad-e86d-4cfe-bb2f-68b7c44cd2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:24.564721 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5ecad-e86d-4cfe-bb2f-68b7c44cd2c6 admin admin] PATH_INFO: `/v3/projects/c19ba4a2c0224c079c5a8a6a56569fd6/users/38517ab5a29c438e89634209652d9963/roles/81b14dd0538e44b4bfa9bb906718914a` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:24.573914 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1c704-4749-471f-af33-d65237ae77c5 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:24.578538 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944df1f1-059b-4bec-991d-b0d0476443f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:24.579405 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944df1f1-059b-4bec-991d-b0d0476443f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:24.579680 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944df1f1-059b-4bec-991d-b0d0476443f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:24.579952 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944df1f1-059b-4bec-991d-b0d0476443f0 admin admin] PATH_INFO: `/v3/projects/c19ba4a2c0224c079c5a8a6a56569fd6/users/b36f253fbce04e9ea028f02ff57fb272/roles/81b14dd0538e44b4bfa9bb906718914a` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:24.596820 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944df1f1-059b-4bec-991d-b0d0476443f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c19ba4a2c0224c079c5a8a6a56569fd6, user_id=b36f253fbce04e9ea028f02ff57fb272, role_id=81b14dd0538e44b4bfa9bb906718914a)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:24.599396 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd5ecad-e86d-4cfe-bb2f-68b7c44cd2c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c19ba4a2c0224c079c5a8a6a56569fd6, user_id=38517ab5a29c438e89634209652d9963, role_id=81b14dd0538e44b4bfa9bb906718914a)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:24.599795 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944df1f1-059b-4bec-991d-b0d0476443f0 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:24.602062 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd5ecad-e86d-4cfe-bb2f-68b7c44cd2c6 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:24.620699 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 297/591] 10.222.0.43 () {58 vars in 1460 bytes} [Fri Dec 24 04:47:24 2021] PUT /identity/v3/projects/c19ba4a2c0224c079c5a8a6a56569fd6/users/b36f253fbce04e9ea028f02ff57fb272/roles/81b14dd0538e44b4bfa9bb906718914a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 04:47:24.624926 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 295/592] 10.222.0.43 () {58 vars in 1460 bytes} [Fri Dec 24 04:47:24 2021] PUT /identity/v3/projects/c19ba4a2c0224c079c5a8a6a56569fd6/users/38517ab5a29c438e89634209652d9963/roles/81b14dd0538e44b4bfa9bb906718914a => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:47:24.735466 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164a097-2af6-4da6-9262-0ce6f0c6a9d3 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:24.735650 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164a097-2af6-4da6-9262-0ce6f0c6a9d3 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:24.735916 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164a097-2af6-4da6-9262-0ce6f0c6a9d3 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:24.738190 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 298/593] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:24.747331 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf82ce-4c16-4696-809e-dc05d6ac6a65 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:24.747331 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf82ce-4c16-4696-809e-dc05d6ac6a65 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:24.747331 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf82ce-4c16-4696-809e-dc05d6ac6a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:24.774307 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-facf82ce-4c16-4696-809e-dc05d6ac6a65 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:24.775509 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-facf82ce-4c16-4696-809e-dc05d6ac6a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:24.860938 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 296/594] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:24 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:47:24.903152 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164a097-2af6-4da6-9262-0ce6f0c6a9d3 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:24.916192 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164a097-2af6-4da6-9262-0ce6f0c6a9d3 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:24.922228 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb25c423-8158-4308-aaa3-dcc5d5480ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:24.923136 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25c423-8158-4308-aaa3-dcc5d5480ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:24.923459 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25c423-8158-4308-aaa3-dcc5d5480ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:24.923729 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25c423-8158-4308-aaa3-dcc5d5480ce9 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:24.936047 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb25c423-8158-4308-aaa3-dcc5d5480ce9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:47:24.943880 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-fb25c423-8158-4308-aaa3-dcc5d5480ce9 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 24 04:47:24.949088 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 299/595] 10.222.0.43 () {56 vars in 1123 bytes} [Fri Dec 24 04:47:24 2021] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:24.955047 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf82ce-4c16-4696-809e-dc05d6ac6a65 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:24.964881 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf82ce-4c16-4696-809e-dc05d6ac6a65 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:24.970467 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb362d-d854-47c8-9795-8811d0099461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:24.971255 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb362d-d854-47c8-9795-8811d0099461 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:24.971533 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb362d-d854-47c8-9795-8811d0099461 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:24.971850 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb362d-d854-47c8-9795-8811d0099461 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:24.972694 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb362d-d854-47c8-9795-8811d0099461 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:24.972997 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb362d-d854-47c8-9795-8811d0099461 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:24.974690 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb362d-d854-47c8-9795-8811d0099461 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:24.985553 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 297/596] 10.222.0.43 () {56 vars in 1124 bytes} [Fri Dec 24 04:47:24 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:24.991048 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb25c423-8158-4308-aaa3-dcc5d5480ce9 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:25.001145 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb25c423-8158-4308-aaa3-dcc5d5480ce9 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:25.005699 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12db6c1a-1f65-4434-b317-e78da544d586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:25.006579 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db6c1a-1f65-4434-b317-e78da544d586 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:25.006858 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db6c1a-1f65-4434-b317-e78da544d586 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:25.007129 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db6c1a-1f65-4434-b317-e78da544d586 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:25.018903 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12db6c1a-1f65-4434-b317-e78da544d586 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:25.020833 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12db6c1a-1f65-4434-b317-e78da544d586 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:25.037890 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-12db6c1a-1f65-4434-b317-e78da544d586 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:47:25.039499 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 300/597] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:24 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:25.047408 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb362d-d854-47c8-9795-8811d0099461 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:25.058096 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb362d-d854-47c8-9795-8811d0099461 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:25.063432 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9015d43-2846-4608-93d9-5c675c1f62e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:25.064137 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9015d43-2846-4608-93d9-5c675c1f62e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:25.064424 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9015d43-2846-4608-93d9-5c675c1f62e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:25.064764 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9015d43-2846-4608-93d9-5c675c1f62e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:25.065564 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9015d43-2846-4608-93d9-5c675c1f62e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:25.065872 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9015d43-2846-4608-93d9-5c675c1f62e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:25.067480 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9015d43-2846-4608-93d9-5c675c1f62e2 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:25.080036 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 298/598] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:47:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:25.086810 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12db6c1a-1f65-4434-b317-e78da544d586 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:25.097363 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12db6c1a-1f65-4434-b317-e78da544d586 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:25.101892 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb71f8-a5ab-4a75-8edd-a3000f63d001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:25.102728 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb71f8-a5ab-4a75-8edd-a3000f63d001 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:25.103004 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb71f8-a5ab-4a75-8edd-a3000f63d001 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:25.103318 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb71f8-a5ab-4a75-8edd-a3000f63d001 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:25.112113 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb71f8-a5ab-4a75-8edd-a3000f63d001 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:25.114212 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb71f8-a5ab-4a75-8edd-a3000f63d001 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:25.128328 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-c2fb71f8-a5ab-4a75-8edd-a3000f63d001 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 24 04:47:25.133899 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 301/599] 10.222.0.43 () {56 vars in 1117 bytes} [Fri Dec 24 04:47:25 2021] GET /identity/v3/users/swift => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:25.136121 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9015d43-2846-4608-93d9-5c675c1f62e2 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:25.149559 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9015d43-2846-4608-93d9-5c675c1f62e2 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:25.154926 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7331703-7887-4492-bb60-63b59588e0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:25.155636 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7331703-7887-4492-bb60-63b59588e0e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:25.155914 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7331703-7887-4492-bb60-63b59588e0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:25.156181 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7331703-7887-4492-bb60-63b59588e0e6 admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:25.157086 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7331703-7887-4492-bb60-63b59588e0e6 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:25.157433 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7331703-7887-4492-bb60-63b59588e0e6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:25.159384 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7331703-7887-4492-bb60-63b59588e0e6 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:25.181430 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 299/600] 10.222.0.43 () {56 vars in 1156 bytes} [Fri Dec 24 04:47:25 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:25.187862 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb71f8-a5ab-4a75-8edd-a3000f63d001 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:25.197954 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb71f8-a5ab-4a75-8edd-a3000f63d001 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:25.202700 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94777bdd-87f4-47c6-9c63-6d6271c97ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:25.203360 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94777bdd-87f4-47c6-9c63-6d6271c97ddb admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:25.203637 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94777bdd-87f4-47c6-9c63-6d6271c97ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:25.203959 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94777bdd-87f4-47c6-9c63-6d6271c97ddb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:25.213702 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94777bdd-87f4-47c6-9c63-6d6271c97ddb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:25.215495 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94777bdd-87f4-47c6-9c63-6d6271c97ddb admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:25.230905 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 302/601] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:47:25 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 24 04:47:25.232408 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7331703-7887-4492-bb60-63b59588e0e6 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:25.242386 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7331703-7887-4492-bb60-63b59588e0e6 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:25.246841 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215226b-f6a2-41a8-acf9-8397b7673e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:25.247932 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215226b-f6a2-41a8-acf9-8397b7673e8f admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:25.248112 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215226b-f6a2-41a8-acf9-8397b7673e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:25.248274 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215226b-f6a2-41a8-acf9-8397b7673e8f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:25.259142 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d215226b-f6a2-41a8-acf9-8397b7673e8f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:25.261072 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d215226b-f6a2-41a8-acf9-8397b7673e8f admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:25.286025 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-d215226b-f6a2-41a8-acf9-8397b7673e8f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:47:25.287233 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 300/602] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:25.293475 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94777bdd-87f4-47c6-9c63-6d6271c97ddb admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:25.302671 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94777bdd-87f4-47c6-9c63-6d6271c97ddb admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:25.316158 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aa53b5-3948-4ea5-a7ed-35e57bd9003b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:25.316910 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa53b5-3948-4ea5-a7ed-35e57bd9003b admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:25.317703 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa53b5-3948-4ea5-a7ed-35e57bd9003b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:25.317703 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa53b5-3948-4ea5-a7ed-35e57bd9003b admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:25.318226 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aa53b5-3948-4ea5-a7ed-35e57bd9003b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:25.318529 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aa53b5-3948-4ea5-a7ed-35e57bd9003b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:25.320303 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aa53b5-3948-4ea5-a7ed-35e57bd9003b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:25.334152 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 303/603] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:47:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:25.340312 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215226b-f6a2-41a8-acf9-8397b7673e8f admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:25.350221 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215226b-f6a2-41a8-acf9-8397b7673e8f admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:25.354659 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7c2d7-ca4a-4593-a4b6-cebb995f1858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:25.355494 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7c2d7-ca4a-4593-a4b6-cebb995f1858 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:25.355767 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7c2d7-ca4a-4593-a4b6-cebb995f1858 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:25.356042 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7c2d7-ca4a-4593-a4b6-cebb995f1858 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:25.363370 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc7c2d7-ca4a-4593-a4b6-cebb995f1858 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:25.365359 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc7c2d7-ca4a-4593-a4b6-cebb995f1858 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:25.378813 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-0cc7c2d7-ca4a-4593-a4b6-cebb995f1858 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 24 04:47:25.380066 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 301/604] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Dec 24 04:47:25 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:25.386479 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aa53b5-3948-4ea5-a7ed-35e57bd9003b admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:25.396741 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aa53b5-3948-4ea5-a7ed-35e57bd9003b admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:25.401188 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2379438f-d81f-4fe0-a20b-30c6f3205113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:25.401883 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379438f-d81f-4fe0-a20b-30c6f3205113 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:25.402158 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379438f-d81f-4fe0-a20b-30c6f3205113 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:25.402425 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379438f-d81f-4fe0-a20b-30c6f3205113 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:25.403257 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2379438f-d81f-4fe0-a20b-30c6f3205113 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:25.403932 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2379438f-d81f-4fe0-a20b-30c6f3205113 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:25.405650 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2379438f-d81f-4fe0-a20b-30c6f3205113 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:25.422030 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 304/605] 10.222.0.43 () {56 vars in 1169 bytes} [Fri Dec 24 04:47:25 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:25.424394 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7c2d7-ca4a-4593-a4b6-cebb995f1858 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:25.436701 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7c2d7-ca4a-4593-a4b6-cebb995f1858 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:25.441586 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d4d444-181d-4c9b-bd12-4a2bddad3151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:25.442231 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4d444-181d-4c9b-bd12-4a2bddad3151 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:25.442506 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4d444-181d-4c9b-bd12-4a2bddad3151 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:25.442775 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4d444-181d-4c9b-bd12-4a2bddad3151 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:25.443725 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d4d444-181d-4c9b-bd12-4a2bddad3151 admin admin] RBAC: Adding query filter params (role.id=81b14dd0538e44b4bfa9bb906718914a, scope.project.id=c19ba4a2c0224c079c5a8a6a56569fd6, user.id=218ae7d29b71487d86b11aeb380788ef) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:25.444034 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d4d444-181d-4c9b-bd12-4a2bddad3151 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:25.445911 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d4d444-181d-4c9b-bd12-4a2bddad3151 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:25.451946 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 302/606] 10.222.0.43 () {56 vars in 1395 bytes} [Fri Dec 24 04:47:25 2021] GET /identity/v3/role_assignments?user.id=218ae7d29b71487d86b11aeb380788ef&scope.project.id=c19ba4a2c0224c079c5a8a6a56569fd6&role.id=81b14dd0538e44b4bfa9bb906718914a => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:26.651391 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468ed9f-c4e1-4188-87a1-8deb08b43fae None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:26.651391 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468ed9f-c4e1-4188-87a1-8deb08b43fae None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:26.651391 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468ed9f-c4e1-4188-87a1-8deb08b43fae None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:26.651391 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 305/607] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:26.659780 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bfcf06-9605-4f71-aee0-f5a8e7b0ce46 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:26.659780 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bfcf06-9605-4f71-aee0-f5a8e7b0ce46 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:26.659780 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bfcf06-9605-4f71-aee0-f5a8e7b0ce46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:26.685965 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-e5bfcf06-9605-4f71-aee0-f5a8e7b0ce46 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:26.687494 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-e5bfcf06-9605-4f71-aee0-f5a8e7b0ce46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:26.698954 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 303/608] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:26 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 24 04:47:26.724103 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a468ed9f-c4e1-4188-87a1-8deb08b43fae None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:26.742549 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a468ed9f-c4e1-4188-87a1-8deb08b43fae None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:26.750452 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b0055-a9d9-4d4f-bf92-65dcef8a808a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:26.751497 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b0055-a9d9-4d4f-bf92-65dcef8a808a admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:26.752013 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b0055-a9d9-4d4f-bf92-65dcef8a808a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:26.752578 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b0055-a9d9-4d4f-bf92-65dcef8a808a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:26.767449 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b0055-a9d9-4d4f-bf92-65dcef8a808a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:47:26.774794 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-561b0055-a9d9-4d4f-bf92-65dcef8a808a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 24 04:47:26.776207 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 306/609] 10.222.0.43 () {56 vars in 1123 bytes} [Fri Dec 24 04:47:26 2021] GET /identity/v3/roles/service => generated 85 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:26.783294 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bfcf06-9605-4f71-aee0-f5a8e7b0ce46 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:26.792617 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bfcf06-9605-4f71-aee0-f5a8e7b0ce46 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:26.800648 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871c6a1-2277-4894-bb2f-e12020abedeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:26.801586 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871c6a1-2277-4894-bb2f-e12020abedeb admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:26.802095 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871c6a1-2277-4894-bb2f-e12020abedeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:26.802554 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871c6a1-2277-4894-bb2f-e12020abedeb admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:26.803517 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3871c6a1-2277-4894-bb2f-e12020abedeb admin admin] RBAC: Adding query filter params (name=service) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:26.804014 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3871c6a1-2277-4894-bb2f-e12020abedeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:26.805848 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3871c6a1-2277-4894-bb2f-e12020abedeb admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:26.816511 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c550c-1a1e-45e6-9ae2-e4980af685a2 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:26.817164 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c550c-1a1e-45e6-9ae2-e4980af685a2 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:26.817633 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c550c-1a1e-45e6-9ae2-e4980af685a2 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:26.819601 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 307/610] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:26.826109 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e3e2a-e3c0-4846-a317-dfb7e1f53684 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:26.826281 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e3e2a-e3c0-4846-a317-dfb7e1f53684 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:26.826535 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e3e2a-e3c0-4846-a317-dfb7e1f53684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:26.828204 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 304/611] 10.222.0.43 () {56 vars in 1124 bytes} [Fri Dec 24 04:47:26 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:26.834276 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871c6a1-2277-4894-bb2f-e12020abedeb admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:26.844285 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871c6a1-2277-4894-bb2f-e12020abedeb admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:26.853506 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-a83e3e2a-e3c0-4846-a317-dfb7e1f53684 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:26.854703 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-a83e3e2a-e3c0-4846-a317-dfb7e1f53684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:26.861501 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4459dd-aa72-4d97-bfa9-48546743ef26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:26.862307 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4459dd-aa72-4d97-bfa9-48546743ef26 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:26.862586 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4459dd-aa72-4d97-bfa9-48546743ef26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:26.862859 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4459dd-aa72-4d97-bfa9-48546743ef26 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:26.874539 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 308/612] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:26 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:47:26.882524 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4459dd-aa72-4d97-bfa9-48546743ef26 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:26.884428 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4459dd-aa72-4d97-bfa9-48546743ef26 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:26.901058 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e3e2a-e3c0-4846-a317-dfb7e1f53684 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:26.910567 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e3e2a-e3c0-4846-a317-dfb7e1f53684 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:26.917658 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-ba4459dd-aa72-4d97-bfa9-48546743ef26 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:47:26.919851 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 305/613] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:47:26.926199 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4459dd-aa72-4d97-bfa9-48546743ef26 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:26.934074 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee125f5-a821-47b1-b069-c04e4f86473d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:26.935127 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee125f5-a821-47b1-b069-c04e4f86473d admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:26.935655 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee125f5-a821-47b1-b069-c04e4f86473d admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:26.935655 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee125f5-a821-47b1-b069-c04e4f86473d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:26.937679 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4459dd-aa72-4d97-bfa9-48546743ef26 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:26.942466 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c59dd01-dd28-43a7-b54d-b9ce13ebc1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:26.943366 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59dd01-dd28-43a7-b54d-b9ce13ebc1de admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:26.943839 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59dd01-dd28-43a7-b54d-b9ce13ebc1de admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:26.944299 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59dd01-dd28-43a7-b54d-b9ce13ebc1de admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:26.945262 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c59dd01-dd28-43a7-b54d-b9ce13ebc1de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:26.945773 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c59dd01-dd28-43a7-b54d-b9ce13ebc1de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:26.947567 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c59dd01-dd28-43a7-b54d-b9ce13ebc1de admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:26.952650 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee125f5-a821-47b1-b069-c04e4f86473d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:47:26.959926 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-aee125f5-a821-47b1-b069-c04e4f86473d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 24 04:47:26.961537 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 306/614] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:47:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:26.967814 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 309/615] 10.222.0.43 () {56 vars in 1123 bytes} [Fri Dec 24 04:47:26 2021] GET /identity/v3/roles/service => generated 85 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:26.968291 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c59dd01-dd28-43a7-b54d-b9ce13ebc1de admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:26.973491 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee125f5-a821-47b1-b069-c04e4f86473d admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:26.983047 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c59dd01-dd28-43a7-b54d-b9ce13ebc1de admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:26.983288 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee125f5-a821-47b1-b069-c04e4f86473d admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:26.994707 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4099f5-4287-48e4-a1ca-7e954c4acaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:26.995554 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e4580-6aed-4b9d-967a-a2996a95513d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:26.996755 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e4580-6aed-4b9d-967a-a2996a95513d admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:26.997447 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e4580-6aed-4b9d-967a-a2996a95513d admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:26.997968 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e4580-6aed-4b9d-967a-a2996a95513d admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:26.998963 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e4580-6aed-4b9d-967a-a2996a95513d admin admin] RBAC: Adding query filter params (name=service) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:26.999475 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e4580-6aed-4b9d-967a-a2996a95513d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:27.001185 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4099f5-4287-48e4-a1ca-7e954c4acaed admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:27.001471 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4099f5-4287-48e4-a1ca-7e954c4acaed admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:27.001746 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4099f5-4287-48e4-a1ca-7e954c4acaed admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:27.001961 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e4580-6aed-4b9d-967a-a2996a95513d admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:27.014712 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4099f5-4287-48e4-a1ca-7e954c4acaed admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:27.017641 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4099f5-4287-48e4-a1ca-7e954c4acaed admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:27.020418 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 310/616] 10.222.0.43 () {56 vars in 1124 bytes} [Fri Dec 24 04:47:26 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:27.026887 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e4580-6aed-4b9d-967a-a2996a95513d admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:27.044083 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e4580-6aed-4b9d-967a-a2996a95513d admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:27.051285 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-ff4099f5-4287-48e4-a1ca-7e954c4acaed admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Dec 24 04:47:27.054361 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cefadc-4e92-4ed0-833b-d93280f930e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:27.056389 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cefadc-4e92-4ed0-833b-d93280f930e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:27.061060 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 307/617] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:47:26 2021] GET /identity/v3/users/glance => generated 84 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:47:27.061794 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cefadc-4e92-4ed0-833b-d93280f930e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:27.062348 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cefadc-4e92-4ed0-833b-d93280f930e5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:27.067996 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4099f5-4287-48e4-a1ca-7e954c4acaed admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:27.082709 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4099f5-4287-48e4-a1ca-7e954c4acaed admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:27.088309 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cefadc-4e92-4ed0-833b-d93280f930e5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:27.093068 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cefadc-4e92-4ed0-833b-d93280f930e5 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:27.095449 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff75a4e-9025-4f58-a9ea-c73911ea4d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:27.096766 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff75a4e-9025-4f58-a9ea-c73911ea4d3c admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:27.098086 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff75a4e-9025-4f58-a9ea-c73911ea4d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:27.098882 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff75a4e-9025-4f58-a9ea-c73911ea4d3c admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:27.102153 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff75a4e-9025-4f58-a9ea-c73911ea4d3c admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:27.102706 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff75a4e-9025-4f58-a9ea-c73911ea4d3c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:27.107963 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff75a4e-9025-4f58-a9ea-c73911ea4d3c admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:27.127802 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-51cefadc-4e92-4ed0-833b-d93280f930e5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:47:27.134023 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 311/618] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 107 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:47:27.137734 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 308/619] 10.222.0.43 () {56 vars in 1158 bytes} [Fri Dec 24 04:47:27 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:27.144106 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cefadc-4e92-4ed0-833b-d93280f930e5 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:27.146069 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff75a4e-9025-4f58-a9ea-c73911ea4d3c admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:27.161062 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cefadc-4e92-4ed0-833b-d93280f930e5 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:27.166268 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff75a4e-9025-4f58-a9ea-c73911ea4d3c admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:27.170510 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c06e0-fddf-46f2-a043-3a260cfcd28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:27.171441 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c06e0-fddf-46f2-a043-3a260cfcd28b admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:27.172267 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c06e0-fddf-46f2-a043-3a260cfcd28b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:27.173157 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c06e0-fddf-46f2-a043-3a260cfcd28b admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:27.174460 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309c06e0-fddf-46f2-a043-3a260cfcd28b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:27.175937 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309c06e0-fddf-46f2-a043-3a260cfcd28b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:27.177795 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309c06e0-fddf-46f2-a043-3a260cfcd28b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:27.179829 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a827e30-28ab-4118-af15-08c28a203541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:27.182196 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a827e30-28ab-4118-af15-08c28a203541 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:27.182677 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a827e30-28ab-4118-af15-08c28a203541 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:27.183144 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a827e30-28ab-4118-af15-08c28a203541 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:27.198598 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a827e30-28ab-4118-af15-08c28a203541 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:27.201241 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 312/620] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:47:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:27.203265 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a827e30-28ab-4118-af15-08c28a203541 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:27.207315 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c06e0-fddf-46f2-a043-3a260cfcd28b admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:27.221236 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 309/621] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:47:27 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 24 04:47:27.226256 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c06e0-fddf-46f2-a043-3a260cfcd28b admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:27.227428 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a827e30-28ab-4118-af15-08c28a203541 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:27.234862 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b3e70-dd11-4305-a2a8-11b35e68a62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:27.235935 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b3e70-dd11-4305-a2a8-11b35e68a62e admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:27.236222 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b3e70-dd11-4305-a2a8-11b35e68a62e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:27.236495 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b3e70-dd11-4305-a2a8-11b35e68a62e admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:27.238509 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a827e30-28ab-4118-af15-08c28a203541 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:27.243395 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9df3e2-f05c-4e99-b976-51f7a557bfab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:27.244432 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9df3e2-f05c-4e99-b976-51f7a557bfab admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:27.244950 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9df3e2-f05c-4e99-b976-51f7a557bfab admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:27.245517 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9df3e2-f05c-4e99-b976-51f7a557bfab admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:27.253679 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b3e70-dd11-4305-a2a8-11b35e68a62e admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:27.255715 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b3e70-dd11-4305-a2a8-11b35e68a62e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:27.260395 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9df3e2-f05c-4e99-b976-51f7a557bfab admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:27.262620 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9df3e2-f05c-4e99-b976-51f7a557bfab admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:27.280191 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-a77b3e70-dd11-4305-a2a8-11b35e68a62e admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 24 04:47:27.281645 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-0a9df3e2-f05c-4e99-b976-51f7a557bfab admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:47:27.283312 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 310/622] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:27.288224 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 313/623] 10.222.0.43 () {56 vars in 1114 bytes} [Fri Dec 24 04:47:27 2021] GET /identity/v3/users/nova => generated 82 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:47:27.289283 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9df3e2-f05c-4e99-b976-51f7a557bfab admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:27.290377 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b3e70-dd11-4305-a2a8-11b35e68a62e admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:27.300618 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9df3e2-f05c-4e99-b976-51f7a557bfab admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:27.305341 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc595cb-421c-48ab-b550-9fb6cbfa56ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:27.306204 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc595cb-421c-48ab-b550-9fb6cbfa56ba admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:27.306718 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc595cb-421c-48ab-b550-9fb6cbfa56ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:27.307209 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc595cb-421c-48ab-b550-9fb6cbfa56ba admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:27.308191 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc595cb-421c-48ab-b550-9fb6cbfa56ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:27.308779 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc595cb-421c-48ab-b550-9fb6cbfa56ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:27.311355 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc595cb-421c-48ab-b550-9fb6cbfa56ba admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:27.318888 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b3e70-dd11-4305-a2a8-11b35e68a62e admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:27.329264 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 311/624] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:47:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:27.336067 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc595cb-421c-48ab-b550-9fb6cbfa56ba admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:27.345068 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb07b1-9b47-46bb-aeef-78ddda88f953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:27.346202 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb07b1-9b47-46bb-aeef-78ddda88f953 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:27.346404 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc595cb-421c-48ab-b550-9fb6cbfa56ba admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:27.346872 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb07b1-9b47-46bb-aeef-78ddda88f953 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:27.347345 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb07b1-9b47-46bb-aeef-78ddda88f953 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:27.348480 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeb07b1-9b47-46bb-aeef-78ddda88f953 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:27.349010 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeb07b1-9b47-46bb-aeef-78ddda88f953 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:27.350675 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d31565-eb64-4d01-b249-e58c841c0f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:27.351433 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeb07b1-9b47-46bb-aeef-78ddda88f953 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:27.351536 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d31565-eb64-4d01-b249-e58c841c0f8e admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:27.351739 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d31565-eb64-4d01-b249-e58c841c0f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:27.352003 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d31565-eb64-4d01-b249-e58c841c0f8e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:27.363648 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d31565-eb64-4d01-b249-e58c841c0f8e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:27.365715 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d31565-eb64-4d01-b249-e58c841c0f8e admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:27.381397 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-56d31565-eb64-4d01-b249-e58c841c0f8e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 24 04:47:27.382530 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 314/625] 10.222.0.43 () {56 vars in 1154 bytes} [Fri Dec 24 04:47:27 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:27.382816 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 312/626] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Dec 24 04:47:27 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:47:27.388900 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb07b1-9b47-46bb-aeef-78ddda88f953 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:27.389295 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d31565-eb64-4d01-b249-e58c841c0f8e admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:27.399065 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d31565-eb64-4d01-b249-e58c841c0f8e admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:27.404191 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bdf0ee-f366-4b27-b1dc-3fe0cfdcab3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:27.404873 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bdf0ee-f366-4b27-b1dc-3fe0cfdcab3e admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:27.405153 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bdf0ee-f366-4b27-b1dc-3fe0cfdcab3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:27.405425 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bdf0ee-f366-4b27-b1dc-3fe0cfdcab3e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:27.407610 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb07b1-9b47-46bb-aeef-78ddda88f953 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:27.419629 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae72b837-db40-438f-81ae-339d7d917d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:27.420627 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72b837-db40-438f-81ae-339d7d917d35 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:27.421120 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72b837-db40-438f-81ae-339d7d917d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:27.421640 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72b837-db40-438f-81ae-339d7d917d35 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:27.422716 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae72b837-db40-438f-81ae-339d7d917d35 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:27.423211 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae72b837-db40-438f-81ae-339d7d917d35 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:27.424891 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bdf0ee-f366-4b27-b1dc-3fe0cfdcab3e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:27.427760 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae72b837-db40-438f-81ae-339d7d917d35 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:27.430038 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bdf0ee-f366-4b27-b1dc-3fe0cfdcab3e admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:27.454565 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 315/628] 10.222.0.43 () {56 vars in 1169 bytes} [Fri Dec 24 04:47:27 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:27.454891 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 313/628] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:47:27 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 24 04:47:27.457259 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bdf0ee-f366-4b27-b1dc-3fe0cfdcab3e admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:27.461174 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae72b837-db40-438f-81ae-339d7d917d35 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:27.472923 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bdf0ee-f366-4b27-b1dc-3fe0cfdcab3e admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:27.478840 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae72b837-db40-438f-81ae-339d7d917d35 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:27.484343 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d18d03a-5836-4cd0-9c4d-ae56cd278e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:27.485633 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d18d03a-5836-4cd0-9c4d-ae56cd278e75 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:27.486162 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d18d03a-5836-4cd0-9c4d-ae56cd278e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:27.486623 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d18d03a-5836-4cd0-9c4d-ae56cd278e75 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:27.487996 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa24c18-1ae3-4004-a8a6-89a8ff93a40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:27.488692 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa24c18-1ae3-4004-a8a6-89a8ff93a40e admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:27.488976 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa24c18-1ae3-4004-a8a6-89a8ff93a40e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:27.489236 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa24c18-1ae3-4004-a8a6-89a8ff93a40e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:27.490084 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa24c18-1ae3-4004-a8a6-89a8ff93a40e admin admin] RBAC: Adding query filter params (role.id=81b14dd0538e44b4bfa9bb906718914a, scope.project.id=c19ba4a2c0224c079c5a8a6a56569fd6, user.id=c1782324ce854868bd11b32bd24b435c) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:27.490392 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa24c18-1ae3-4004-a8a6-89a8ff93a40e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:27.492251 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa24c18-1ae3-4004-a8a6-89a8ff93a40e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:27.498776 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 316/629] 10.222.0.43 () {56 vars in 1395 bytes} [Fri Dec 24 04:47:27 2021] GET /identity/v3/role_assignments?user.id=c1782324ce854868bd11b32bd24b435c&scope.project.id=c19ba4a2c0224c079c5a8a6a56569fd6&role.id=81b14dd0538e44b4bfa9bb906718914a => generated 608 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:27.500031 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d18d03a-5836-4cd0-9c4d-ae56cd278e75 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:27.500139 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d7e6c-d5d3-4e6a-ad60-6248d992eeb1 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:27.500404 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d7e6c-d5d3-4e6a-ad60-6248d992eeb1 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:27.500708 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d7e6c-d5d3-4e6a-ad60-6248d992eeb1 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:27.502370 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 317/630] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:27.502839 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d18d03a-5836-4cd0-9c4d-ae56cd278e75 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:27.508954 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7cc55-73ea-4831-930e-821c5cbe234e None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:27.509305 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7cc55-73ea-4831-930e-821c5cbe234e None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:27.509643 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7cc55-73ea-4831-930e-821c5cbe234e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:27.522997 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-5d18d03a-5836-4cd0-9c4d-ae56cd278e75 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:47:27.527929 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-8cc7cc55-73ea-4831-930e-821c5cbe234e None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:27.528545 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 314/631] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:47:27.529491 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-8cc7cc55-73ea-4831-930e-821c5cbe234e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:27.531589 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d18d03a-5836-4cd0-9c4d-ae56cd278e75 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:27.542561 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d18d03a-5836-4cd0-9c4d-ae56cd278e75 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:27.544601 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 318/632] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:27 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:47:27.548080 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d3840-4a54-4619-b51f-e355e3d5d655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:27.549103 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d3840-4a54-4619-b51f-e355e3d5d655 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:27.549619 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d3840-4a54-4619-b51f-e355e3d5d655 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:27.550133 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d3840-4a54-4619-b51f-e355e3d5d655 admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:27.551159 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6d3840-4a54-4619-b51f-e355e3d5d655 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:27.551732 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6d3840-4a54-4619-b51f-e355e3d5d655 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:27.553714 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6d3840-4a54-4619-b51f-e355e3d5d655 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:27.562631 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc7cc55-73ea-4831-930e-821c5cbe234e None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:27.572168 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc7cc55-73ea-4831-930e-821c5cbe234e None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:27.572791 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 315/633] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:47:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:27.575947 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d3840-4a54-4619-b51f-e355e3d5d655 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:27.577951 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7daf479-2e0c-40ac-b97f-45f95e649568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:27.578785 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7daf479-2e0c-40ac-b97f-45f95e649568 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:27.579061 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7daf479-2e0c-40ac-b97f-45f95e649568 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:27.579337 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7daf479-2e0c-40ac-b97f-45f95e649568 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:27.588102 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d3840-4a54-4619-b51f-e355e3d5d655 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:27.592777 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7daf479-2e0c-40ac-b97f-45f95e649568 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:47:27.604582 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-e7daf479-2e0c-40ac-b97f-45f95e649568 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 24 04:47:27.604582 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 319/634] 10.222.0.43 () {56 vars in 1123 bytes} [Fri Dec 24 04:47:27 2021] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:47:27.608057 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7daf479-2e0c-40ac-b97f-45f95e649568 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:27.609310 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc0d4ed-b040-4b73-bc04-641b7df401a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:27.610447 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0d4ed-b040-4b73-bc04-641b7df401a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:27.610938 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0d4ed-b040-4b73-bc04-641b7df401a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:27.611413 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0d4ed-b040-4b73-bc04-641b7df401a0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:27.629878 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc0d4ed-b040-4b73-bc04-641b7df401a0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:27.634404 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc0d4ed-b040-4b73-bc04-641b7df401a0 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:27.635248 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7daf479-2e0c-40ac-b97f-45f95e649568 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:27.650423 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e545f-6fb2-450a-ab5e-80a7349f0018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:27.651538 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e545f-6fb2-450a-ab5e-80a7349f0018 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:27.652492 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e545f-6fb2-450a-ab5e-80a7349f0018 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:27.652979 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e545f-6fb2-450a-ab5e-80a7349f0018 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:27.654088 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e545f-6fb2-450a-ab5e-80a7349f0018 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:27.654636 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e545f-6fb2-450a-ab5e-80a7349f0018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:27.658883 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e545f-6fb2-450a-ab5e-80a7349f0018 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:27.670436 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-3dc0d4ed-b040-4b73-bc04-641b7df401a0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 24 04:47:27.675746 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 316/635] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Dec 24 04:47:27 2021] GET /identity/v3/projects/service => generated 88 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:47:27.683905 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 320/636] 10.222.0.43 () {56 vars in 1124 bytes} [Fri Dec 24 04:47:27 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:27.686524 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc0d4ed-b040-4b73-bc04-641b7df401a0 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:27.690237 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e545f-6fb2-450a-ab5e-80a7349f0018 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:27.704560 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc0d4ed-b040-4b73-bc04-641b7df401a0 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:27.704761 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e545f-6fb2-450a-ab5e-80a7349f0018 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:27.711838 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba8325-78c3-4151-afe2-ff9b0e142229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:27.712671 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba8325-78c3-4151-afe2-ff9b0e142229 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:27.712948 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba8325-78c3-4151-afe2-ff9b0e142229 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:27.713213 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba8325-78c3-4151-afe2-ff9b0e142229 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:27.715377 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd977a-3915-4e5d-8b9a-f1b356d4fe0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:27.716096 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd977a-3915-4e5d-8b9a-f1b356d4fe0f admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:27.716396 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd977a-3915-4e5d-8b9a-f1b356d4fe0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:27.716832 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd977a-3915-4e5d-8b9a-f1b356d4fe0f admin admin] PATH_INFO: `/v3/projects` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:27.717654 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacd977a-3915-4e5d-8b9a-f1b356d4fe0f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:27.717979 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacd977a-3915-4e5d-8b9a-f1b356d4fe0f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:27.719868 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacd977a-3915-4e5d-8b9a-f1b356d4fe0f admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:27.738207 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ba8325-78c3-4151-afe2-ff9b0e142229 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:27.740062 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ba8325-78c3-4151-afe2-ff9b0e142229 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:27.750329 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 317/637] 10.222.0.43 () {56 vars in 1169 bytes} [Fri Dec 24 04:47:27 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:27.756719 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd977a-3915-4e5d-8b9a-f1b356d4fe0f admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:27.768779 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-e5ba8325-78c3-4151-afe2-ff9b0e142229 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:47:27.770048 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 321/638] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:47:27.776519 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba8325-78c3-4151-afe2-ff9b0e142229 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:27.779313 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd977a-3915-4e5d-8b9a-f1b356d4fe0f admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:27.787527 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba8325-78c3-4151-afe2-ff9b0e142229 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:27.792769 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15892aac-ddad-498f-8ecc-d2edb90be33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:27.793833 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15892aac-ddad-498f-8ecc-d2edb90be33f admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:27.794344 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15892aac-ddad-498f-8ecc-d2edb90be33f admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:27.794796 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15892aac-ddad-498f-8ecc-d2edb90be33f admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:27.795740 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15892aac-ddad-498f-8ecc-d2edb90be33f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:27.796180 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15892aac-ddad-498f-8ecc-d2edb90be33f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:27.798128 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15892aac-ddad-498f-8ecc-d2edb90be33f admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:27.801489 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e174f4-3275-4e7a-9151-569a8775850d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:27.801924 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e174f4-3275-4e7a-9151-569a8775850d admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:27.802209 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e174f4-3275-4e7a-9151-569a8775850d admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:27.802488 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e174f4-3275-4e7a-9151-569a8775850d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:27.803370 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e174f4-3275-4e7a-9151-569a8775850d admin admin] RBAC: Adding query filter params (role.id=81b14dd0538e44b4bfa9bb906718914a, scope.project.id=c19ba4a2c0224c079c5a8a6a56569fd6, user.id=6f9ad1e8f8f74edcb44aabe17eb59648) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:27.803682 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e174f4-3275-4e7a-9151-569a8775850d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:27.805596 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e174f4-3275-4e7a-9151-569a8775850d admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:27.816651 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 322/639] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:47:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:27.819210 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15892aac-ddad-498f-8ecc-d2edb90be33f admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:27.822801 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 318/640] 10.222.0.43 () {56 vars in 1395 bytes} [Fri Dec 24 04:47:27 2021] GET /identity/v3/role_assignments?user.id=6f9ad1e8f8f74edcb44aabe17eb59648&scope.project.id=c19ba4a2c0224c079c5a8a6a56569fd6&role.id=81b14dd0538e44b4bfa9bb906718914a => generated 608 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:27.830009 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15892aac-ddad-498f-8ecc-d2edb90be33f admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:27.835320 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f9e35f-e3e6-4cf4-a4ef-e4fdb608c230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:27.836395 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9e35f-e3e6-4cf4-a4ef-e4fdb608c230 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:27.836830 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9e35f-e3e6-4cf4-a4ef-e4fdb608c230 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:27.837246 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9e35f-e3e6-4cf4-a4ef-e4fdb608c230 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:27.846797 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f9e35f-e3e6-4cf4-a4ef-e4fdb608c230 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:27.849305 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f9e35f-e3e6-4cf4-a4ef-e4fdb608c230 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:27.864711 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-d0f9e35f-e3e6-4cf4-a4ef-e4fdb608c230 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Dec 24 04:47:27.871480 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 323/641] 10.222.0.43 () {56 vars in 1123 bytes} [Fri Dec 24 04:47:27 2021] GET /identity/v3/users/neutron => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:27.873724 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e174f4-3275-4e7a-9151-569a8775850d admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:27.884682 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e174f4-3275-4e7a-9151-569a8775850d admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:27.889941 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35facbc3-a55c-405e-ab7c-d4d8a6e46641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:27.890856 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35facbc3-a55c-405e-ab7c-d4d8a6e46641 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:27.891301 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35facbc3-a55c-405e-ab7c-d4d8a6e46641 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:27.891710 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35facbc3-a55c-405e-ab7c-d4d8a6e46641 admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:27.892763 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35facbc3-a55c-405e-ab7c-d4d8a6e46641 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:27.893214 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35facbc3-a55c-405e-ab7c-d4d8a6e46641 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:27.895262 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35facbc3-a55c-405e-ab7c-d4d8a6e46641 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:27.920650 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 319/642] 10.222.0.43 () {56 vars in 1160 bytes} [Fri Dec 24 04:47:27 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:27.922287 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f9e35f-e3e6-4cf4-a4ef-e4fdb608c230 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:27.932719 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f9e35f-e3e6-4cf4-a4ef-e4fdb608c230 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:27.938337 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2149ab2e-84ef-4501-ae1e-034a94a06980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:27.939326 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149ab2e-84ef-4501-ae1e-034a94a06980 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:27.939757 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149ab2e-84ef-4501-ae1e-034a94a06980 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:27.940166 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149ab2e-84ef-4501-ae1e-034a94a06980 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:27.949759 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2149ab2e-84ef-4501-ae1e-034a94a06980 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:27.951890 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2149ab2e-84ef-4501-ae1e-034a94a06980 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:27.967933 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 324/643] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:47:27 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 24 04:47:27.969659 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35facbc3-a55c-405e-ab7c-d4d8a6e46641 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:27.980013 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35facbc3-a55c-405e-ab7c-d4d8a6e46641 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:27.985482 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d352450-d57c-468a-9885-13ac0851bc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:27.986517 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d352450-d57c-468a-9885-13ac0851bc35 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:27.986955 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d352450-d57c-468a-9885-13ac0851bc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:27.987358 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d352450-d57c-468a-9885-13ac0851bc35 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:28.005834 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d352450-d57c-468a-9885-13ac0851bc35 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:28.007763 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d352450-d57c-468a-9885-13ac0851bc35 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:28.009880 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a18218-c62c-4660-9647-0047c12e475e None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:28.010371 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a18218-c62c-4660-9647-0047c12e475e None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:28.010781 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a18218-c62c-4660-9647-0047c12e475e None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:28.013148 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 325/644] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:28.027092 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d609670-2f39-4fe6-8d4f-6e130c70d5f6 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:28.027608 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d609670-2f39-4fe6-8d4f-6e130c70d5f6 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:28.028020 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d609670-2f39-4fe6-8d4f-6e130c70d5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:28.032152 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-9d352450-d57c-468a-9885-13ac0851bc35 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:47:28.035045 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 320/645] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:28.039941 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d352450-d57c-468a-9885-13ac0851bc35 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:28.054502 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d352450-d57c-468a-9885-13ac0851bc35 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:28.057861 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-0d609670-2f39-4fe6-8d4f-6e130c70d5f6 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:28.059076 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-0d609670-2f39-4fe6-8d4f-6e130c70d5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:28.060877 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc23eb7d-caf4-4097-bd2a-fa4729ed9167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:28.061845 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23eb7d-caf4-4097-bd2a-fa4729ed9167 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:28.062264 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23eb7d-caf4-4097-bd2a-fa4729ed9167 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:28.062776 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23eb7d-caf4-4097-bd2a-fa4729ed9167 admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:28.063845 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc23eb7d-caf4-4097-bd2a-fa4729ed9167 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:28.064288 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc23eb7d-caf4-4097-bd2a-fa4729ed9167 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:28.066103 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc23eb7d-caf4-4097-bd2a-fa4729ed9167 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:28.072563 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 326/646] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:28 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 24 04:47:28.085628 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 321/647] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:47:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:28.092739 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d609670-2f39-4fe6-8d4f-6e130c70d5f6 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:28.102402 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc23eb7d-caf4-4097-bd2a-fa4729ed9167 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:28.103760 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d609670-2f39-4fe6-8d4f-6e130c70d5f6 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:28.112448 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd4096-21df-47f4-9e3c-e5840e0a604a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:28.113570 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd4096-21df-47f4-9e3c-e5840e0a604a admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:28.113859 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc23eb7d-caf4-4097-bd2a-fa4729ed9167 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:28.114146 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd4096-21df-47f4-9e3c-e5840e0a604a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:28.114549 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd4096-21df-47f4-9e3c-e5840e0a604a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:28.118736 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d02720-55d5-4a24-8fe4-4487f5649499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:28.119645 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d02720-55d5-4a24-8fe4-4487f5649499 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:28.119994 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d02720-55d5-4a24-8fe4-4487f5649499 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:28.120336 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d02720-55d5-4a24-8fe4-4487f5649499 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:28.123852 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdd4096-21df-47f4-9e3c-e5840e0a604a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:28.126125 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdd4096-21df-47f4-9e3c-e5840e0a604a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:28.135270 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d02720-55d5-4a24-8fe4-4487f5649499 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:47:28.147297 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-86d02720-55d5-4a24-8fe4-4487f5649499 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 24 04:47:28.148144 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-1fdd4096-21df-47f4-9e3c-e5840e0a604a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 24 04:47:28.149127 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 322/648] 10.222.0.43 () {56 vars in 1123 bytes} [Fri Dec 24 04:47:28 2021] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:28.153502 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 327/649] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Dec 24 04:47:28 2021] GET /identity/v3/projects/service => generated 88 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:28.158095 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d02720-55d5-4a24-8fe4-4487f5649499 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:28.160295 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd4096-21df-47f4-9e3c-e5840e0a604a admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:28.169862 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d02720-55d5-4a24-8fe4-4487f5649499 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:28.175754 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b628586-4a27-479a-bc0f-29865f2e6068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:28.176109 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd4096-21df-47f4-9e3c-e5840e0a604a admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:28.177095 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b628586-4a27-479a-bc0f-29865f2e6068 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:28.177652 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b628586-4a27-479a-bc0f-29865f2e6068 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:28.178156 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b628586-4a27-479a-bc0f-29865f2e6068 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:28.179166 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b628586-4a27-479a-bc0f-29865f2e6068 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:28.179664 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b628586-4a27-479a-bc0f-29865f2e6068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:28.180765 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2407eff-c6b4-45eb-9b33-70d8eb3f037e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:28.181523 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2407eff-c6b4-45eb-9b33-70d8eb3f037e admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:28.181864 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2407eff-c6b4-45eb-9b33-70d8eb3f037e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:28.182230 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2407eff-c6b4-45eb-9b33-70d8eb3f037e admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:28.182351 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b628586-4a27-479a-bc0f-29865f2e6068 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:28.183196 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2407eff-c6b4-45eb-9b33-70d8eb3f037e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:28.183593 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2407eff-c6b4-45eb-9b33-70d8eb3f037e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:28.186382 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2407eff-c6b4-45eb-9b33-70d8eb3f037e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:28.196656 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 323/650] 10.222.0.43 () {56 vars in 1124 bytes} [Fri Dec 24 04:47:28 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:28.202937 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b628586-4a27-479a-bc0f-29865f2e6068 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:28.203891 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 328/651] 10.222.0.43 () {56 vars in 1169 bytes} [Fri Dec 24 04:47:28 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:28.211234 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2407eff-c6b4-45eb-9b33-70d8eb3f037e admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:28.214454 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b628586-4a27-479a-bc0f-29865f2e6068 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:28.220173 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb9f17c-51bc-4ded-a927-92a62ae88a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:28.221267 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9f17c-51bc-4ded-a927-92a62ae88a15 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:28.221834 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9f17c-51bc-4ded-a927-92a62ae88a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:28.222366 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9f17c-51bc-4ded-a927-92a62ae88a15 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:28.222520 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2407eff-c6b4-45eb-9b33-70d8eb3f037e admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:28.227671 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39038a9-fc7d-49a5-876b-4f35a89924c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:28.228394 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39038a9-fc7d-49a5-876b-4f35a89924c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:28.228765 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39038a9-fc7d-49a5-876b-4f35a89924c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:28.229103 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39038a9-fc7d-49a5-876b-4f35a89924c1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:28.230005 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39038a9-fc7d-49a5-876b-4f35a89924c1 admin admin] RBAC: Adding query filter params (role.id=81b14dd0538e44b4bfa9bb906718914a, scope.project.id=c19ba4a2c0224c079c5a8a6a56569fd6, user.id=b36f253fbce04e9ea028f02ff57fb272) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:28.230375 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39038a9-fc7d-49a5-876b-4f35a89924c1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:28.232850 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39038a9-fc7d-49a5-876b-4f35a89924c1 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:28.235518 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb9f17c-51bc-4ded-a927-92a62ae88a15 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:28.237756 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb9f17c-51bc-4ded-a927-92a62ae88a15 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:28.244605 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 329/652] 10.222.0.43 () {56 vars in 1395 bytes} [Fri Dec 24 04:47:28 2021] GET /identity/v3/role_assignments?user.id=b36f253fbce04e9ea028f02ff57fb272&scope.project.id=c19ba4a2c0224c079c5a8a6a56569fd6&role.id=81b14dd0538e44b4bfa9bb906718914a => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:28.261073 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-2cb9f17c-51bc-4ded-a927-92a62ae88a15 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:47:28.263266 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 324/653] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:28.269771 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39038a9-fc7d-49a5-876b-4f35a89924c1 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:28.281640 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39038a9-fc7d-49a5-876b-4f35a89924c1 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:28.287516 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81fbeb4-2022-425f-9d98-f1ac688487d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:28.288618 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81fbeb4-2022-425f-9d98-f1ac688487d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:28.289128 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81fbeb4-2022-425f-9d98-f1ac688487d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:28.289606 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81fbeb4-2022-425f-9d98-f1ac688487d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:28.290549 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81fbeb4-2022-425f-9d98-f1ac688487d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:28.291047 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81fbeb4-2022-425f-9d98-f1ac688487d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:28.292984 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81fbeb4-2022-425f-9d98-f1ac688487d0 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:28.307331 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 330/654] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:47:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:28.313899 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb9f17c-51bc-4ded-a927-92a62ae88a15 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:28.327799 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb9f17c-51bc-4ded-a927-92a62ae88a15 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:28.333145 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2c16a-e803-4745-9e0e-40c281df5419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:28.334554 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2c16a-e803-4745-9e0e-40c281df5419 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:28.335035 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2c16a-e803-4745-9e0e-40c281df5419 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:28.335481 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2c16a-e803-4745-9e0e-40c281df5419 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:28.344136 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b2c16a-e803-4745-9e0e-40c281df5419 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:28.346603 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b2c16a-e803-4745-9e0e-40c281df5419 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:28.362428 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-24b2c16a-e803-4745-9e0e-40c281df5419 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 24 04:47:28.364388 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 325/655] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:47:28 2021] GET /identity/v3/users/cinder => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:28.374896 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81fbeb4-2022-425f-9d98-f1ac688487d0 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:28.385581 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81fbeb4-2022-425f-9d98-f1ac688487d0 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:28.397243 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aad8fb-9eba-486c-82ce-1cb4eb54cfee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:28.397934 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aad8fb-9eba-486c-82ce-1cb4eb54cfee admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:28.398213 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aad8fb-9eba-486c-82ce-1cb4eb54cfee admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:28.398480 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aad8fb-9eba-486c-82ce-1cb4eb54cfee admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:28.399140 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ac3ef-c39c-45d8-b7dc-cf65950a88d0 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:28.399353 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aad8fb-9eba-486c-82ce-1cb4eb54cfee admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:28.399656 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aad8fb-9eba-486c-82ce-1cb4eb54cfee admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:28.399877 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ac3ef-c39c-45d8-b7dc-cf65950a88d0 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:28.400289 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ac3ef-c39c-45d8-b7dc-cf65950a88d0 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:28.401567 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aad8fb-9eba-486c-82ce-1cb4eb54cfee admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:28.402854 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 326/656] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:28 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 24 04:47:28.409189 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5b6eb-7fa0-4073-bf5f-1c5968c949ba None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:28.409830 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5b6eb-7fa0-4073-bf5f-1c5968c949ba None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:28.410302 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5b6eb-7fa0-4073-bf5f-1c5968c949ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:28.428120 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 331/657] 10.222.0.43 () {56 vars in 1158 bytes} [Fri Dec 24 04:47:28 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:28.439325 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aad8fb-9eba-486c-82ce-1cb4eb54cfee admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:28.444948 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-acd5b6eb-7fa0-4073-bf5f-1c5968c949ba None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:28.446174 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-acd5b6eb-7fa0-4073-bf5f-1c5968c949ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:28.453825 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aad8fb-9eba-486c-82ce-1cb4eb54cfee admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:28.457345 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 327/658] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:28 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 24 04:47:28.468237 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ae3e9-699b-4d47-b8eb-2acb425824f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:28.468964 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ae3e9-699b-4d47-b8eb-2acb425824f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:28.469291 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ae3e9-699b-4d47-b8eb-2acb425824f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:28.469566 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ae3e9-699b-4d47-b8eb-2acb425824f9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:28.479242 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9ae3e9-699b-4d47-b8eb-2acb425824f9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:28.481125 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd5b6eb-7fa0-4073-bf5f-1c5968c949ba None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:28.492030 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9ae3e9-699b-4d47-b8eb-2acb425824f9 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:28.492985 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd5b6eb-7fa0-4073-bf5f-1c5968c949ba None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:28.503385 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823404b-0436-4457-b902-1346c5736f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:28.504259 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823404b-0436-4457-b902-1346c5736f24 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:28.505640 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823404b-0436-4457-b902-1346c5736f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:28.505969 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823404b-0436-4457-b902-1346c5736f24 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:28.510456 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 332/659] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:47:28 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 24 04:47:28.517353 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ae3e9-699b-4d47-b8eb-2acb425824f9 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:28.525053 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7823404b-0436-4457-b902-1346c5736f24 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:47:28.527530 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ae3e9-699b-4d47-b8eb-2acb425824f9 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:28.533047 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558357b5-4631-4d96-ade1-f2499ec7e178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:28.533656 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-7823404b-0436-4457-b902-1346c5736f24 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 24 04:47:28.533880 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558357b5-4631-4d96-ade1-f2499ec7e178 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:28.534161 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558357b5-4631-4d96-ade1-f2499ec7e178 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:28.534434 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558357b5-4631-4d96-ade1-f2499ec7e178 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:28.536362 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 328/660] 10.222.0.43 () {56 vars in 1123 bytes} [Fri Dec 24 04:47:28 2021] GET /identity/v3/roles/service => generated 85 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:47:28.541834 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823404b-0436-4457-b902-1346c5736f24 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:28.547957 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558357b5-4631-4d96-ade1-f2499ec7e178 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:28.550004 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558357b5-4631-4d96-ade1-f2499ec7e178 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:28.553275 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823404b-0436-4457-b902-1346c5736f24 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:28.558215 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a876aa20-2acc-4686-9863-ea575f5508ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:28.558944 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876aa20-2acc-4686-9863-ea575f5508ec admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:28.559333 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876aa20-2acc-4686-9863-ea575f5508ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:28.559809 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876aa20-2acc-4686-9863-ea575f5508ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:28.560777 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a876aa20-2acc-4686-9863-ea575f5508ec admin admin] RBAC: Adding query filter params (name=service) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:28.561153 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a876aa20-2acc-4686-9863-ea575f5508ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:28.563021 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a876aa20-2acc-4686-9863-ea575f5508ec admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:28.569928 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-558357b5-4631-4d96-ade1-f2499ec7e178 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:47:28.571364 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 333/661] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:28.577312 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 329/662] 10.222.0.43 () {56 vars in 1124 bytes} [Fri Dec 24 04:47:28 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:28.577574 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558357b5-4631-4d96-ade1-f2499ec7e178 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:28.582774 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a876aa20-2acc-4686-9863-ea575f5508ec admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:28.588181 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558357b5-4631-4d96-ade1-f2499ec7e178 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:28.593215 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce73a8-c4d7-4348-bd6b-a62215635786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:28.594056 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce73a8-c4d7-4348-bd6b-a62215635786 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:28.594484 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce73a8-c4d7-4348-bd6b-a62215635786 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:28.594822 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a876aa20-2acc-4686-9863-ea575f5508ec admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:28.595076 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce73a8-c4d7-4348-bd6b-a62215635786 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:28.595955 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ce73a8-c4d7-4348-bd6b-a62215635786 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:28.596408 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ce73a8-c4d7-4348-bd6b-a62215635786 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:28.598184 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ce73a8-c4d7-4348-bd6b-a62215635786 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:28.599995 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af97e791-d942-475c-afda-85e096d7d117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:28.601310 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97e791-d942-475c-afda-85e096d7d117 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:28.601310 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97e791-d942-475c-afda-85e096d7d117 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:28.601663 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97e791-d942-475c-afda-85e096d7d117 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:28.611080 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 334/663] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:47:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:28.616158 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af97e791-d942-475c-afda-85e096d7d117 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:28.616158 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af97e791-d942-475c-afda-85e096d7d117 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:28.617350 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce73a8-c4d7-4348-bd6b-a62215635786 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:28.627616 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce73a8-c4d7-4348-bd6b-a62215635786 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:28.632595 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec71ca-27e6-4e48-bdf0-da5caca7c80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:28.633675 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec71ca-27e6-4e48-bdf0-da5caca7c80b admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:28.634180 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec71ca-27e6-4e48-bdf0-da5caca7c80b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:28.634652 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec71ca-27e6-4e48-bdf0-da5caca7c80b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:28.639045 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-af97e791-d942-475c-afda-85e096d7d117 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:47:28.640350 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 330/664] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:47:28.643826 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dec71ca-27e6-4e48-bdf0-da5caca7c80b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:28.646533 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dec71ca-27e6-4e48-bdf0-da5caca7c80b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:28.646643 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af97e791-d942-475c-afda-85e096d7d117 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:28.657098 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af97e791-d942-475c-afda-85e096d7d117 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:28.661710 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8eb9f2-552d-4c8c-bbb2-39a15ef19053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:28.661860 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-4dec71ca-27e6-4e48-bdf0-da5caca7c80b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 24 04:47:28.662390 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8eb9f2-552d-4c8c-bbb2-39a15ef19053 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:28.662644 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8eb9f2-552d-4c8c-bbb2-39a15ef19053 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:28.662970 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8eb9f2-552d-4c8c-bbb2-39a15ef19053 admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:28.663717 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8eb9f2-552d-4c8c-bbb2-39a15ef19053 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:28.664115 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8eb9f2-552d-4c8c-bbb2-39a15ef19053 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:28.665494 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 335/665] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Dec 24 04:47:28 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:28.672147 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8eb9f2-552d-4c8c-bbb2-39a15ef19053 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:28.673788 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec71ca-27e6-4e48-bdf0-da5caca7c80b admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:28.681232 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 331/666] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:47:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:28.685730 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec71ca-27e6-4e48-bdf0-da5caca7c80b admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:28.687607 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8eb9f2-552d-4c8c-bbb2-39a15ef19053 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:28.691940 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee537cd1-0134-4bf0-9455-512dcab1adb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:28.692885 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee537cd1-0134-4bf0-9455-512dcab1adb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:28.693387 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee537cd1-0134-4bf0-9455-512dcab1adb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:28.693860 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee537cd1-0134-4bf0-9455-512dcab1adb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:28.694865 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee537cd1-0134-4bf0-9455-512dcab1adb8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:28.695372 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee537cd1-0134-4bf0-9455-512dcab1adb8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:28.697485 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee537cd1-0134-4bf0-9455-512dcab1adb8 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:28.698667 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8eb9f2-552d-4c8c-bbb2-39a15ef19053 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:28.703359 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e79ee5-fb07-4c8f-a734-3fc9e814732c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:28.704162 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e79ee5-fb07-4c8f-a734-3fc9e814732c admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:28.704494 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e79ee5-fb07-4c8f-a734-3fc9e814732c admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:28.704804 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e79ee5-fb07-4c8f-a734-3fc9e814732c admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:28.712886 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 336/667] 10.222.0.43 () {56 vars in 1169 bytes} [Fri Dec 24 04:47:28 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:28.716668 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e79ee5-fb07-4c8f-a734-3fc9e814732c admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:28.716668 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e79ee5-fb07-4c8f-a734-3fc9e814732c admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:28.720047 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee537cd1-0134-4bf0-9455-512dcab1adb8 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:28.730906 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee537cd1-0134-4bf0-9455-512dcab1adb8 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:28.731066 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-94e79ee5-fb07-4c8f-a734-3fc9e814732c admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 24 04:47:28.733401 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 332/668] 10.222.0.43 () {56 vars in 1117 bytes} [Fri Dec 24 04:47:28 2021] GET /identity/v3/users/swift => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:28.739117 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6bb6c9-652c-4176-83d4-1ef6292ef520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:28.739616 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e79ee5-fb07-4c8f-a734-3fc9e814732c admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:28.740469 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bb6c9-652c-4176-83d4-1ef6292ef520 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:28.741104 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bb6c9-652c-4176-83d4-1ef6292ef520 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:28.741593 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bb6c9-652c-4176-83d4-1ef6292ef520 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:28.742744 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6bb6c9-652c-4176-83d4-1ef6292ef520 admin admin] RBAC: Adding query filter params (role.id=81b14dd0538e44b4bfa9bb906718914a, scope.project.id=c19ba4a2c0224c079c5a8a6a56569fd6, user.id=38517ab5a29c438e89634209652d9963) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:28.743254 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6bb6c9-652c-4176-83d4-1ef6292ef520 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:28.745480 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6bb6c9-652c-4176-83d4-1ef6292ef520 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:28.750591 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e79ee5-fb07-4c8f-a734-3fc9e814732c admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:28.753218 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 337/669] 10.222.0.43 () {56 vars in 1395 bytes} [Fri Dec 24 04:47:28 2021] GET /identity/v3/role_assignments?user.id=38517ab5a29c438e89634209652d9963&scope.project.id=c19ba4a2c0224c079c5a8a6a56569fd6&role.id=81b14dd0538e44b4bfa9bb906718914a => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:28.758146 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e718ff-7631-4f95-9b00-591b798e7bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:28.758893 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e718ff-7631-4f95-9b00-591b798e7bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:28.759266 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e718ff-7631-4f95-9b00-591b798e7bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:28.759540 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e718ff-7631-4f95-9b00-591b798e7bf5 admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:28.760414 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e718ff-7631-4f95-9b00-591b798e7bf5 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:28.760788 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e718ff-7631-4f95-9b00-591b798e7bf5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:28.763126 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e718ff-7631-4f95-9b00-591b798e7bf5 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:28.789928 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 333/670] 10.222.0.43 () {56 vars in 1156 bytes} [Fri Dec 24 04:47:28 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:28.792121 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6bb6c9-652c-4176-83d4-1ef6292ef520 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:28.803755 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6bb6c9-652c-4176-83d4-1ef6292ef520 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:28.808486 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738ba730-d1ae-4609-8084-4bbad1831806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:28.809326 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ba730-d1ae-4609-8084-4bbad1831806 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:28.809722 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ba730-d1ae-4609-8084-4bbad1831806 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:28.810118 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ba730-d1ae-4609-8084-4bbad1831806 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:28.822439 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738ba730-d1ae-4609-8084-4bbad1831806 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:28.824366 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738ba730-d1ae-4609-8084-4bbad1831806 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:28.843163 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-738ba730-d1ae-4609-8084-4bbad1831806 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:47:28.848687 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 338/671] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:28.851177 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e718ff-7631-4f95-9b00-591b798e7bf5 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:28.861778 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e718ff-7631-4f95-9b00-591b798e7bf5 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:28.866477 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c25941-28e2-4e9d-87af-529d8dcd4d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:28.867155 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c25941-28e2-4e9d-87af-529d8dcd4d1c admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:28.867433 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c25941-28e2-4e9d-87af-529d8dcd4d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:28.867812 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c25941-28e2-4e9d-87af-529d8dcd4d1c admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:28.868633 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c25941-28e2-4e9d-87af-529d8dcd4d1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:28.868945 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c25941-28e2-4e9d-87af-529d8dcd4d1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:28.870579 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c25941-28e2-4e9d-87af-529d8dcd4d1c admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:28.886568 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 334/672] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:47:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:28.890808 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738ba730-d1ae-4609-8084-4bbad1831806 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:28.901045 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738ba730-d1ae-4609-8084-4bbad1831806 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:28.905858 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac0e2c-0740-4bd4-b4dd-0bd9c9029d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:28.906728 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac0e2c-0740-4bd4-b4dd-0bd9c9029d62 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:28.907008 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac0e2c-0740-4bd4-b4dd-0bd9c9029d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:28.907286 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac0e2c-0740-4bd4-b4dd-0bd9c9029d62 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:28.915309 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ac0e2c-0740-4bd4-b4dd-0bd9c9029d62 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:28.917407 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ac0e2c-0740-4bd4-b4dd-0bd9c9029d62 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:28.932993 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-b0ac0e2c-0740-4bd4-b4dd-0bd9c9029d62 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 24 04:47:28.939541 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 339/673] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Dec 24 04:47:28 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:28.941119 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c25941-28e2-4e9d-87af-529d8dcd4d1c admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:28.951743 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c25941-28e2-4e9d-87af-529d8dcd4d1c admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:28.956277 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd05849d-a8be-46e4-951e-6748ffb749c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:28.957044 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd05849d-a8be-46e4-951e-6748ffb749c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:28.957376 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd05849d-a8be-46e4-951e-6748ffb749c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:28.957655 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd05849d-a8be-46e4-951e-6748ffb749c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:28.958476 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd05849d-a8be-46e4-951e-6748ffb749c4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:28.958783 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd05849d-a8be-46e4-951e-6748ffb749c4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:28.961005 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd05849d-a8be-46e4-951e-6748ffb749c4 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:28.975238 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 335/674] 10.222.0.43 () {56 vars in 1169 bytes} [Fri Dec 24 04:47:28 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:28.982086 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac0e2c-0740-4bd4-b4dd-0bd9c9029d62 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:28.996341 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac0e2c-0740-4bd4-b4dd-0bd9c9029d62 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:29.003374 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88339c36-b6fa-4d48-828d-019b46fb3ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:29.004281 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88339c36-b6fa-4d48-828d-019b46fb3ea9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:29.004576 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88339c36-b6fa-4d48-828d-019b46fb3ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:29.004853 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88339c36-b6fa-4d48-828d-019b46fb3ea9 admin admin] PATH_INFO: `/v3/projects/c19ba4a2c0224c079c5a8a6a56569fd6/users/218ae7d29b71487d86b11aeb380788ef/roles/81b14dd0538e44b4bfa9bb906718914a` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:29.020900 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88339c36-b6fa-4d48-828d-019b46fb3ea9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c19ba4a2c0224c079c5a8a6a56569fd6, user_id=218ae7d29b71487d86b11aeb380788ef, role_id=81b14dd0538e44b4bfa9bb906718914a)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:29.023567 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88339c36-b6fa-4d48-828d-019b46fb3ea9 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:29.040625 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 340/675] 10.222.0.43 () {58 vars in 1460 bytes} [Fri Dec 24 04:47:28 2021] PUT /identity/v3/projects/c19ba4a2c0224c079c5a8a6a56569fd6/users/218ae7d29b71487d86b11aeb380788ef/roles/81b14dd0538e44b4bfa9bb906718914a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:47:30.468366 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4302f7-2ee4-4217-8915-a8327e7b298e None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:30.469416 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4302f7-2ee4-4217-8915-a8327e7b298e None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:30.469890 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4302f7-2ee4-4217-8915-a8327e7b298e None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:30.472079 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 336/676] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:30 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:30.478211 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f8d38-ee9e-4af7-b9bb-b019fb4b930f None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:30.479007 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f8d38-ee9e-4af7-b9bb-b019fb4b930f None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:30.479476 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f8d38-ee9e-4af7-b9bb-b019fb4b930f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:30.504747 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-d94f8d38-ee9e-4af7-b9bb-b019fb4b930f None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:30.506301 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-d94f8d38-ee9e-4af7-b9bb-b019fb4b930f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:30.588240 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 341/677] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:30 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:47:30.625188 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4302f7-2ee4-4217-8915-a8327e7b298e None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:30.642420 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4302f7-2ee4-4217-8915-a8327e7b298e None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:30.651146 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd60ef-abf8-4305-a0b5-050093d7e6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:30.652341 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd60ef-abf8-4305-a0b5-050093d7e6da admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:30.652836 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd60ef-abf8-4305-a0b5-050093d7e6da admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:30.653355 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd60ef-abf8-4305-a0b5-050093d7e6da admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:30.670498 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd60ef-abf8-4305-a0b5-050093d7e6da admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:30.672821 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd60ef-abf8-4305-a0b5-050093d7e6da admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:30.694517 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-c1bd60ef-abf8-4305-a0b5-050093d7e6da admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:47:30.696397 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 337/678] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:30.703148 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f8d38-ee9e-4af7-b9bb-b019fb4b930f None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:30.712728 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f8d38-ee9e-4af7-b9bb-b019fb4b930f None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:30.725691 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355101d2-8624-4c79-8619-a46d07894918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:30.726726 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355101d2-8624-4c79-8619-a46d07894918 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:30.727248 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355101d2-8624-4c79-8619-a46d07894918 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:30.727708 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355101d2-8624-4c79-8619-a46d07894918 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:30.728722 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355101d2-8624-4c79-8619-a46d07894918 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:30.729237 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355101d2-8624-4c79-8619-a46d07894918 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:30.731039 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355101d2-8624-4c79-8619-a46d07894918 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:30.745467 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 342/679] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:47:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:30.752568 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd60ef-abf8-4305-a0b5-050093d7e6da admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:30.765754 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd60ef-abf8-4305-a0b5-050093d7e6da admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:30.775846 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafea409-b01f-457b-b9b3-34bc5661134d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:30.776519 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafea409-b01f-457b-b9b3-34bc5661134d admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:30.776816 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafea409-b01f-457b-b9b3-34bc5661134d admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:30.777085 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafea409-b01f-457b-b9b3-34bc5661134d admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:30.777811 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafea409-b01f-457b-b9b3-34bc5661134d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:30.780096 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafea409-b01f-457b-b9b3-34bc5661134d admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:30.817465 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 338/680] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Dec 24 04:47:30 2021] POST /identity/v3/users => generated 254 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:47:31.159603 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93c50e-6035-4588-b470-e0f08d51e7cb None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:31.159950 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93c50e-6035-4588-b470-e0f08d51e7cb None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:31.160159 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93c50e-6035-4588-b470-e0f08d51e7cb None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:31.162304 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 343/681] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:31.168206 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f246ad-7f80-44f7-9871-387c0f989223 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:31.168497 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f246ad-7f80-44f7-9871-387c0f989223 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:31.169212 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f246ad-7f80-44f7-9871-387c0f989223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:31.190942 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-62f246ad-7f80-44f7-9871-387c0f989223 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:31.192148 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-62f246ad-7f80-44f7-9871-387c0f989223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:31.202543 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 339/682] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:31 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:47:31.227970 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f93c50e-6035-4588-b470-e0f08d51e7cb None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:31.242655 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f93c50e-6035-4588-b470-e0f08d51e7cb None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:31.248216 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da37b0ac-ae85-4968-9bc4-b92d008c95e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:31.249089 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37b0ac-ae85-4968-9bc4-b92d008c95e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:31.249368 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37b0ac-ae85-4968-9bc4-b92d008c95e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:31.249642 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37b0ac-ae85-4968-9bc4-b92d008c95e7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:31.262804 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da37b0ac-ae85-4968-9bc4-b92d008c95e7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:47:31.269675 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-da37b0ac-ae85-4968-9bc4-b92d008c95e7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 24 04:47:31.271173 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 344/683] 10.222.0.43 () {56 vars in 1117 bytes} [Fri Dec 24 04:47:31 2021] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:31.277236 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f246ad-7f80-44f7-9871-387c0f989223 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:31.286648 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f246ad-7f80-44f7-9871-387c0f989223 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:31.291184 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c8f87-74e7-45cd-bf45-53056413120b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:31.291914 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c8f87-74e7-45cd-bf45-53056413120b admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:31.292256 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c8f87-74e7-45cd-bf45-53056413120b admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:31.292618 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c8f87-74e7-45cd-bf45-53056413120b admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:31.293458 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c8f87-74e7-45cd-bf45-53056413120b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:31.293881 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c8f87-74e7-45cd-bf45-53056413120b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:31.295537 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c8f87-74e7-45cd-bf45-53056413120b admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:31.304486 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 340/684] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:47:31 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:31.310340 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da37b0ac-ae85-4968-9bc4-b92d008c95e7 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:31.324628 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da37b0ac-ae85-4968-9bc4-b92d008c95e7 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:31.331634 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24357f85-a856-4407-8698-eaf10caa1a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:31.332499 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24357f85-a856-4407-8698-eaf10caa1a20 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:31.333080 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24357f85-a856-4407-8698-eaf10caa1a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:31.333193 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24357f85-a856-4407-8698-eaf10caa1a20 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:31.341566 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d90281-70ab-4420-89c0-88a2bcad32fe None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:31.341829 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d90281-70ab-4420-89c0-88a2bcad32fe None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:31.342086 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d90281-70ab-4420-89c0-88a2bcad32fe None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:31.344191 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 341/685] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 24 04:47:31.352513 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24357f85-a856-4407-8698-eaf10caa1a20 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:31.355085 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24357f85-a856-4407-8698-eaf10caa1a20 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:31.355818 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cca571-769c-4c1a-87cb-513947de4461 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:31.356109 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cca571-769c-4c1a-87cb-513947de4461 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:31.356444 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cca571-769c-4c1a-87cb-513947de4461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:31.377160 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-24357f85-a856-4407-8698-eaf10caa1a20 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:47:31.378688 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 345/686] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:31.379937 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-50cca571-769c-4c1a-87cb-513947de4461 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:31.381158 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-50cca571-769c-4c1a-87cb-513947de4461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:31.384830 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24357f85-a856-4407-8698-eaf10caa1a20 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:31.395736 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24357f85-a856-4407-8698-eaf10caa1a20 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:31.396637 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 342/687] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:31 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 24 04:47:31.401116 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f6594-2bc7-475f-bed3-c782538e2b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:31.401841 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f6594-2bc7-475f-bed3-c782538e2b0b admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:31.402186 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f6594-2bc7-475f-bed3-c782538e2b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:31.402554 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f6594-2bc7-475f-bed3-c782538e2b0b admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:31.403485 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77f6594-2bc7-475f-bed3-c782538e2b0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:31.403846 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77f6594-2bc7-475f-bed3-c782538e2b0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:31.405655 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77f6594-2bc7-475f-bed3-c782538e2b0b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:31.414980 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cca571-769c-4c1a-87cb-513947de4461 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:31.418171 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 346/688] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:47:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:31.423950 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f6594-2bc7-475f-bed3-c782538e2b0b admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:31.426248 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cca571-769c-4c1a-87cb-513947de4461 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:31.431990 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe23b8b-d969-4fdb-b5d8-b66a8c790db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:31.432823 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe23b8b-d969-4fdb-b5d8-b66a8c790db2 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:31.433101 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe23b8b-d969-4fdb-b5d8-b66a8c790db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:31.433374 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe23b8b-d969-4fdb-b5d8-b66a8c790db2 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:31.433774 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f6594-2bc7-475f-bed3-c782538e2b0b admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:31.434055 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe23b8b-d969-4fdb-b5d8-b66a8c790db2 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:31.436139 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING py.warnings [None req-0fe23b8b-d969-4fdb-b5d8-b66a8c790db2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:47:31.436139 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: warnings.warn(msg) Dec 24 04:47:31.436139 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: Dec 24 04:47:31.437798 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe23b8b-d969-4fdb-b5d8-b66a8c790db2 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:31.441100 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57458c-82eb-4014-8397-5a7425945937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:31.441940 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57458c-82eb-4014-8397-5a7425945937 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:31.442218 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57458c-82eb-4014-8397-5a7425945937 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:31.442493 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57458c-82eb-4014-8397-5a7425945937 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:31.451284 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-0fe23b8b-d969-4fdb-b5d8-b66a8c790db2 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Dec 24 04:47:31.452931 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 343/689] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Dec 24 04:47:31 2021] GET /identity/v3/services/network => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:47:31.453156 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57458c-82eb-4014-8397-5a7425945937 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:31.455494 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57458c-82eb-4014-8397-5a7425945937 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:31.461837 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe23b8b-d969-4fdb-b5d8-b66a8c790db2 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:31.471143 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-5a57458c-82eb-4014-8397-5a7425945937 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 24 04:47:31.472708 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 347/690] 10.222.0.43 () {56 vars in 1114 bytes} [Fri Dec 24 04:47:31 2021] GET /identity/v3/users/nova => generated 82 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:31.477025 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe23b8b-d969-4fdb-b5d8-b66a8c790db2 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:31.478752 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57458c-82eb-4014-8397-5a7425945937 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:31.482427 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e5efd-8600-493f-b202-6bd73408b23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:31.483149 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e5efd-8600-493f-b202-6bd73408b23c admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:31.483432 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e5efd-8600-493f-b202-6bd73408b23c admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:31.483742 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e5efd-8600-493f-b202-6bd73408b23c admin admin] PATH_INFO: `/v3/services` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:31.484553 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90e5efd-8600-493f-b202-6bd73408b23c admin admin] RBAC: Adding query filter params (name=network) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:31.489141 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90e5efd-8600-493f-b202-6bd73408b23c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:31.489321 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57458c-82eb-4014-8397-5a7425945937 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:31.490334 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING py.warnings [None req-d90e5efd-8600-493f-b202-6bd73408b23c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:47:31.490334 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: warnings.warn(msg) Dec 24 04:47:31.490334 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: Dec 24 04:47:31.491471 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90e5efd-8600-493f-b202-6bd73408b23c admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:31.493945 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef004b-35dd-4401-ad1f-514a30fb5980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:31.494611 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef004b-35dd-4401-ad1f-514a30fb5980 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:31.494885 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef004b-35dd-4401-ad1f-514a30fb5980 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:31.495152 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef004b-35dd-4401-ad1f-514a30fb5980 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:31.496011 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef004b-35dd-4401-ad1f-514a30fb5980 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:31.496311 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef004b-35dd-4401-ad1f-514a30fb5980 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:31.498485 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef004b-35dd-4401-ad1f-514a30fb5980 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:31.502932 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 344/691] 10.222.0.43 () {56 vars in 1133 bytes} [Fri Dec 24 04:47:31 2021] GET /identity/v3/services?name=network => generated 124 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:31.504119 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e5efd-8600-493f-b202-6bd73408b23c admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:31.514423 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e5efd-8600-493f-b202-6bd73408b23c admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:31.517447 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 348/692] 10.222.0.43 () {56 vars in 1154 bytes} [Fri Dec 24 04:47:31 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:31.523460 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef004b-35dd-4401-ad1f-514a30fb5980 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:31.525444 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a23156-6359-42a9-8c0e-fc8de411f464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:31.526180 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a23156-6359-42a9-8c0e-fc8de411f464 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:31.526511 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a23156-6359-42a9-8c0e-fc8de411f464 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:31.526783 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a23156-6359-42a9-8c0e-fc8de411f464 admin admin] PATH_INFO: `/v3/services` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:31.527569 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a23156-6359-42a9-8c0e-fc8de411f464 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:31.527878 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a23156-6359-42a9-8c0e-fc8de411f464 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:31.529876 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a23156-6359-42a9-8c0e-fc8de411f464 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:31.533601 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef004b-35dd-4401-ad1f-514a30fb5980 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:31.540721 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 345/693] 10.222.0.43 () {56 vars in 1133 bytes} [Fri Dec 24 04:47:31 2021] GET /identity/v3/services?type=network => generated 124 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:31.542564 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1250cc-72eb-46f8-ba44-055dec0b7106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:31.543297 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1250cc-72eb-46f8-ba44-055dec0b7106 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:31.543575 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1250cc-72eb-46f8-ba44-055dec0b7106 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:31.544048 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1250cc-72eb-46f8-ba44-055dec0b7106 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:31.554375 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1250cc-72eb-46f8-ba44-055dec0b7106 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:31.556259 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1250cc-72eb-46f8-ba44-055dec0b7106 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:31.566550 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 349/694] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:47:31 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 24 04:47:31.572684 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a23156-6359-42a9-8c0e-fc8de411f464 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:31.583477 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a23156-6359-42a9-8c0e-fc8de411f464 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:31.588398 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16119e7-46ff-4a10-8a33-fb2330788964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:31.589248 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16119e7-46ff-4a10-8a33-fb2330788964 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:31.589585 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16119e7-46ff-4a10-8a33-fb2330788964 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:31.589892 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16119e7-46ff-4a10-8a33-fb2330788964 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:31.601891 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16119e7-46ff-4a10-8a33-fb2330788964 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:31.603813 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16119e7-46ff-4a10-8a33-fb2330788964 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:31.621265 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-b16119e7-46ff-4a10-8a33-fb2330788964 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:47:31.623293 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 346/695] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:31.629636 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1250cc-72eb-46f8-ba44-055dec0b7106 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:31.639395 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1250cc-72eb-46f8-ba44-055dec0b7106 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:31.644130 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448291ef-8dd9-4934-9088-6c311968a409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:31.644944 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448291ef-8dd9-4934-9088-6c311968a409 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:31.645219 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448291ef-8dd9-4934-9088-6c311968a409 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:31.645535 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448291ef-8dd9-4934-9088-6c311968a409 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:31.646281 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448291ef-8dd9-4934-9088-6c311968a409 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:31.646582 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448291ef-8dd9-4934-9088-6c311968a409 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:31.648287 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448291ef-8dd9-4934-9088-6c311968a409 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:31.662479 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 350/696] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:47:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:31.668428 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16119e7-46ff-4a10-8a33-fb2330788964 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:31.684411 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16119e7-46ff-4a10-8a33-fb2330788964 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:31.690929 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5894fdfc-d37e-48a3-8782-b91125e45401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:31.691744 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894fdfc-d37e-48a3-8782-b91125e45401 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:31.692025 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894fdfc-d37e-48a3-8782-b91125e45401 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:31.692296 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894fdfc-d37e-48a3-8782-b91125e45401 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:31.702474 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5894fdfc-d37e-48a3-8782-b91125e45401 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:31.704546 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5894fdfc-d37e-48a3-8782-b91125e45401 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:31.719455 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-5894fdfc-d37e-48a3-8782-b91125e45401 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 24 04:47:31.721087 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 347/697] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Dec 24 04:47:31 2021] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:31.727314 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448291ef-8dd9-4934-9088-6c311968a409 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:31.738082 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448291ef-8dd9-4934-9088-6c311968a409 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:31.743339 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadacc1c-edef-4235-a0db-a69df330ed86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:31.744065 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadacc1c-edef-4235-a0db-a69df330ed86 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:31.744346 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadacc1c-edef-4235-a0db-a69df330ed86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:31.744774 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadacc1c-edef-4235-a0db-a69df330ed86 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:31.745596 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadacc1c-edef-4235-a0db-a69df330ed86 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:31.745908 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadacc1c-edef-4235-a0db-a69df330ed86 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:31.748468 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadacc1c-edef-4235-a0db-a69df330ed86 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:31.763831 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 351/698] 10.222.0.43 () {56 vars in 1169 bytes} [Fri Dec 24 04:47:31 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:31.770224 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5894fdfc-d37e-48a3-8782-b91125e45401 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:31.781789 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5894fdfc-d37e-48a3-8782-b91125e45401 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:31.786919 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93fc54-5712-46c5-99f8-12bfdbcfdec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:31.787696 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93fc54-5712-46c5-99f8-12bfdbcfdec3 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:31.788046 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93fc54-5712-46c5-99f8-12bfdbcfdec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:31.788325 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93fc54-5712-46c5-99f8-12bfdbcfdec3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:31.789311 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93fc54-5712-46c5-99f8-12bfdbcfdec3 admin admin] RBAC: Adding query filter params (role.id=d5e6fc257d8541d5a5ed1988eacd5be7, scope.project.id=c19ba4a2c0224c079c5a8a6a56569fd6, user.id=6f9ad1e8f8f74edcb44aabe17eb59648) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:31.789620 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93fc54-5712-46c5-99f8-12bfdbcfdec3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:31.791731 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93fc54-5712-46c5-99f8-12bfdbcfdec3 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:31.798717 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 348/699] 10.222.0.43 () {56 vars in 1395 bytes} [Fri Dec 24 04:47:31 2021] GET /identity/v3/role_assignments?user.id=6f9ad1e8f8f74edcb44aabe17eb59648&scope.project.id=c19ba4a2c0224c079c5a8a6a56569fd6&role.id=d5e6fc257d8541d5a5ed1988eacd5be7 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:32.059008 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee718e65-9404-442d-87f9-9aef19efec19 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:32.059410 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee718e65-9404-442d-87f9-9aef19efec19 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:32.059573 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee718e65-9404-442d-87f9-9aef19efec19 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:32.061652 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 352/700] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:32.067506 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220802e-beb7-49b9-95ad-91057c02cde3 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:32.067794 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220802e-beb7-49b9-95ad-91057c02cde3 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:32.068067 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220802e-beb7-49b9-95ad-91057c02cde3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:32.094103 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-c220802e-beb7-49b9-95ad-91057c02cde3 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:32.095284 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-c220802e-beb7-49b9-95ad-91057c02cde3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:32.107873 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 349/701] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:32 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 24 04:47:32.142983 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee718e65-9404-442d-87f9-9aef19efec19 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:32.157665 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee718e65-9404-442d-87f9-9aef19efec19 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:32.163217 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c4f4ca-ee59-4e6c-abbe-004e493c5693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:32.164072 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4f4ca-ee59-4e6c-abbe-004e493c5693 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:32.164352 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4f4ca-ee59-4e6c-abbe-004e493c5693 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:32.164656 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4f4ca-ee59-4e6c-abbe-004e493c5693 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:32.165378 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c4f4ca-ee59-4e6c-abbe-004e493c5693 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:32.166392 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING py.warnings [None req-75c4f4ca-ee59-4e6c-abbe-004e493c5693 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:47:32.166392 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: warnings.warn(msg) Dec 24 04:47:32.166392 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: Dec 24 04:47:32.167319 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c4f4ca-ee59-4e6c-abbe-004e493c5693 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:32.187611 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-75c4f4ca-ee59-4e6c-abbe-004e493c5693 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Dec 24 04:47:32.189181 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 353/702] 10.222.0.43 () {56 vars in 1150 bytes} [Fri Dec 24 04:47:32 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:32.195360 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c220802e-beb7-49b9-95ad-91057c02cde3 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:32.206051 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c220802e-beb7-49b9-95ad-91057c02cde3 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:32.214139 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e769d29-cabb-4d99-8416-d945cc05aab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:32.214798 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e769d29-cabb-4d99-8416-d945cc05aab7 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:32.215078 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e769d29-cabb-4d99-8416-d945cc05aab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:32.215352 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e769d29-cabb-4d99-8416-d945cc05aab7 admin admin] PATH_INFO: `/v3/services` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:32.216117 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e769d29-cabb-4d99-8416-d945cc05aab7 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:32.216418 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e769d29-cabb-4d99-8416-d945cc05aab7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:32.218051 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e769d29-cabb-4d99-8416-d945cc05aab7 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:32.228313 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 350/703] 10.222.0.43 () {56 vars in 1145 bytes} [Fri Dec 24 04:47:32 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:32.234772 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c4f4ca-ee59-4e6c-abbe-004e493c5693 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:32.243967 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d0e98-6e8c-42e1-a1d2-61d61f4d867d None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:32.245219 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d0e98-6e8c-42e1-a1d2-61d61f4d867d None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:32.245219 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d0e98-6e8c-42e1-a1d2-61d61f4d867d None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:32.246528 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 351/704] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:32.248358 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c4f4ca-ee59-4e6c-abbe-004e493c5693 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:32.256668 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63238867-ec65-4da4-96d4-0b03dd2c1e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:32.257563 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63238867-ec65-4da4-96d4-0b03dd2c1e8a admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:32.258020 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63238867-ec65-4da4-96d4-0b03dd2c1e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:32.258495 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63238867-ec65-4da4-96d4-0b03dd2c1e8a admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:32.259404 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63238867-ec65-4da4-96d4-0b03dd2c1e8a admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:32.259879 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63238867-ec65-4da4-96d4-0b03dd2c1e8a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:32.261094 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING py.warnings [None req-63238867-ec65-4da4-96d4-0b03dd2c1e8a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:47:32.261094 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: warnings.warn(msg) Dec 24 04:47:32.261094 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: Dec 24 04:47:32.262287 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63238867-ec65-4da4-96d4-0b03dd2c1e8a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:32.266607 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2908e-db0d-42dc-bf77-f9adc6ba0c24 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:32.266890 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2908e-db0d-42dc-bf77-f9adc6ba0c24 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:32.267162 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2908e-db0d-42dc-bf77-f9adc6ba0c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:32.274499 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 354/705] 10.222.0.43 () {56 vars in 1145 bytes} [Fri Dec 24 04:47:32 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:32.297658 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-79a2908e-db0d-42dc-bf77-f9adc6ba0c24 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:32.298883 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-79a2908e-db0d-42dc-bf77-f9adc6ba0c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:32.313077 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 352/706] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:32 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 24 04:47:32.355214 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63238867-ec65-4da4-96d4-0b03dd2c1e8a admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:32.370098 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63238867-ec65-4da4-96d4-0b03dd2c1e8a admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:32.379351 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3eec3-6c8c-4514-9a44-f3b8b21a6abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:32.380164 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3eec3-6c8c-4514-9a44-f3b8b21a6abd admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:32.380443 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3eec3-6c8c-4514-9a44-f3b8b21a6abd admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:32.380742 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3eec3-6c8c-4514-9a44-f3b8b21a6abd admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:32.401564 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb3eec3-6c8c-4514-9a44-f3b8b21a6abd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:47:32.408873 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-ddb3eec3-6c8c-4514-9a44-f3b8b21a6abd admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 24 04:47:32.410326 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 355/707] 10.222.0.43 () {56 vars in 1123 bytes} [Fri Dec 24 04:47:32 2021] GET /identity/v3/roles/service => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:32.416952 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2908e-db0d-42dc-bf77-f9adc6ba0c24 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:32.430030 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2908e-db0d-42dc-bf77-f9adc6ba0c24 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:32.438709 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f40af-e658-4ef4-8f16-a4a68e479925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:32.439393 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f40af-e658-4ef4-8f16-a4a68e479925 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:32.439669 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f40af-e658-4ef4-8f16-a4a68e479925 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:32.439939 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f40af-e658-4ef4-8f16-a4a68e479925 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:32.440773 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2f40af-e658-4ef4-8f16-a4a68e479925 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:32.441076 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2f40af-e658-4ef4-8f16-a4a68e479925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:32.442724 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2f40af-e658-4ef4-8f16-a4a68e479925 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:32.458437 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 353/708] 10.222.0.43 () {56 vars in 1124 bytes} [Fri Dec 24 04:47:32 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:32.465241 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3eec3-6c8c-4514-9a44-f3b8b21a6abd admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:32.477883 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3eec3-6c8c-4514-9a44-f3b8b21a6abd admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:32.483768 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf53d1-f2b5-4f84-8189-a5410434fb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:32.484592 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf53d1-f2b5-4f84-8189-a5410434fb7f admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:32.484874 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf53d1-f2b5-4f84-8189-a5410434fb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:32.485150 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf53d1-f2b5-4f84-8189-a5410434fb7f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:32.500066 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daf53d1-f2b5-4f84-8189-a5410434fb7f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:32.501943 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daf53d1-f2b5-4f84-8189-a5410434fb7f admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:32.521166 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-0daf53d1-f2b5-4f84-8189-a5410434fb7f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:47:32.522710 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 356/709] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:32.528873 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f40af-e658-4ef4-8f16-a4a68e479925 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:32.539181 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f40af-e658-4ef4-8f16-a4a68e479925 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:32.543835 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499647d-302e-461a-aa9d-a41da112251f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:32.544517 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499647d-302e-461a-aa9d-a41da112251f admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:32.544856 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499647d-302e-461a-aa9d-a41da112251f admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:32.545130 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499647d-302e-461a-aa9d-a41da112251f admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:32.545892 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8499647d-302e-461a-aa9d-a41da112251f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:32.546196 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8499647d-302e-461a-aa9d-a41da112251f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:32.547917 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8499647d-302e-461a-aa9d-a41da112251f admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:32.561245 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 354/710] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:47:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:32.567196 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf53d1-f2b5-4f84-8189-a5410434fb7f admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:32.577435 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf53d1-f2b5-4f84-8189-a5410434fb7f admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:32.582051 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45209ce6-7a68-421d-b324-33186922a4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:32.582900 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45209ce6-7a68-421d-b324-33186922a4e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:32.583179 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45209ce6-7a68-421d-b324-33186922a4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:32.583445 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45209ce6-7a68-421d-b324-33186922a4e5 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:32.592206 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45209ce6-7a68-421d-b324-33186922a4e5 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:32.594339 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45209ce6-7a68-421d-b324-33186922a4e5 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:32.609795 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-45209ce6-7a68-421d-b324-33186922a4e5 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 24 04:47:32.611315 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 357/711] 10.222.0.43 () {56 vars in 1117 bytes} [Fri Dec 24 04:47:32 2021] GET /identity/v3/users/swift => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:32.617409 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499647d-302e-461a-aa9d-a41da112251f admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:32.630347 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499647d-302e-461a-aa9d-a41da112251f admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:32.640853 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5969b4d-eb63-4482-a7c3-dc197848136f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:32.641528 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5969b4d-eb63-4482-a7c3-dc197848136f admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:32.641810 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5969b4d-eb63-4482-a7c3-dc197848136f admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:32.642084 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5969b4d-eb63-4482-a7c3-dc197848136f admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:32.642947 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5969b4d-eb63-4482-a7c3-dc197848136f admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:32.643258 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5969b4d-eb63-4482-a7c3-dc197848136f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:32.645163 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5969b4d-eb63-4482-a7c3-dc197848136f admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:32.670364 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 355/712] 10.222.0.43 () {56 vars in 1156 bytes} [Fri Dec 24 04:47:32 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:32.676088 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45209ce6-7a68-421d-b324-33186922a4e5 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:32.693692 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45209ce6-7a68-421d-b324-33186922a4e5 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:32.701963 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0115d-9ef2-4329-a85b-e1d8417b4abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:32.702945 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0115d-9ef2-4329-a85b-e1d8417b4abf admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:32.703457 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0115d-9ef2-4329-a85b-e1d8417b4abf admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:32.703920 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0115d-9ef2-4329-a85b-e1d8417b4abf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:32.717388 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e0115d-9ef2-4329-a85b-e1d8417b4abf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:32.719427 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e0115d-9ef2-4329-a85b-e1d8417b4abf admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:32.734576 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 358/713] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:47:32 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 24 04:47:32.740418 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5969b4d-eb63-4482-a7c3-dc197848136f admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:32.754426 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5969b4d-eb63-4482-a7c3-dc197848136f admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:32.763003 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa4c8f-0663-4f56-8243-e1323551128b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:32.763801 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa4c8f-0663-4f56-8243-e1323551128b admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:32.764083 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa4c8f-0663-4f56-8243-e1323551128b admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:32.764358 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa4c8f-0663-4f56-8243-e1323551128b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:32.775215 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa4c8f-0663-4f56-8243-e1323551128b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:32.781371 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa4c8f-0663-4f56-8243-e1323551128b admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:32.808190 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-73aa4c8f-0663-4f56-8243-e1323551128b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:47:32.809693 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 356/714] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:32.815491 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0115d-9ef2-4329-a85b-e1d8417b4abf admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:32.825733 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0115d-9ef2-4329-a85b-e1d8417b4abf admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:32.834474 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7395c7e2-3931-4a45-a576-7f8218f89651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:32.835150 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395c7e2-3931-4a45-a576-7f8218f89651 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:32.835429 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395c7e2-3931-4a45-a576-7f8218f89651 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:32.835699 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395c7e2-3931-4a45-a576-7f8218f89651 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:32.836439 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7395c7e2-3931-4a45-a576-7f8218f89651 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:32.836772 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7395c7e2-3931-4a45-a576-7f8218f89651 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:32.838376 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7395c7e2-3931-4a45-a576-7f8218f89651 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:32.851339 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 359/715] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:47:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:32.857527 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa4c8f-0663-4f56-8243-e1323551128b admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:32.867580 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa4c8f-0663-4f56-8243-e1323551128b admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:32.882191 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c9e35a-3e74-4bd2-a124-836fe4416a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:32.883001 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c9e35a-3e74-4bd2-a124-836fe4416a2e admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:32.883286 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c9e35a-3e74-4bd2-a124-836fe4416a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:32.883557 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c9e35a-3e74-4bd2-a124-836fe4416a2e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:32.891077 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c9e35a-3e74-4bd2-a124-836fe4416a2e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:32.893081 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c9e35a-3e74-4bd2-a124-836fe4416a2e admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:32.914523 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-58c9e35a-3e74-4bd2-a124-836fe4416a2e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 24 04:47:32.916086 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 357/716] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Dec 24 04:47:32 2021] GET /identity/v3/projects/service => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:32.922115 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7395c7e2-3931-4a45-a576-7f8218f89651 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:32.937510 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7395c7e2-3931-4a45-a576-7f8218f89651 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:32.946690 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c1c98e-f502-4643-9e95-e68b4ef863e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:32.947355 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1c98e-f502-4643-9e95-e68b4ef863e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:32.947687 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1c98e-f502-4643-9e95-e68b4ef863e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:32.947964 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1c98e-f502-4643-9e95-e68b4ef863e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:32.948832 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c1c98e-f502-4643-9e95-e68b4ef863e4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:32.949137 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c1c98e-f502-4643-9e95-e68b4ef863e4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:32.951352 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c1c98e-f502-4643-9e95-e68b4ef863e4 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:32.964003 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 360/717] 10.222.0.43 () {56 vars in 1169 bytes} [Fri Dec 24 04:47:32 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:32.970369 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c9e35a-3e74-4bd2-a124-836fe4416a2e admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:32.980790 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c9e35a-3e74-4bd2-a124-836fe4416a2e admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:32.985449 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93596eb3-2f4d-4f06-aa98-d30aa1649e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:32.986088 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93596eb3-2f4d-4f06-aa98-d30aa1649e27 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:32.986361 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93596eb3-2f4d-4f06-aa98-d30aa1649e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:32.986623 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93596eb3-2f4d-4f06-aa98-d30aa1649e27 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:32.987461 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93596eb3-2f4d-4f06-aa98-d30aa1649e27 admin admin] RBAC: Adding query filter params (role.id=81b14dd0538e44b4bfa9bb906718914a, scope.project.id=c19ba4a2c0224c079c5a8a6a56569fd6, user.id=218ae7d29b71487d86b11aeb380788ef) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:32.987766 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93596eb3-2f4d-4f06-aa98-d30aa1649e27 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:32.989678 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93596eb3-2f4d-4f06-aa98-d30aa1649e27 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:32.995592 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 358/718] 10.222.0.43 () {56 vars in 1395 bytes} [Fri Dec 24 04:47:32 2021] GET /identity/v3/role_assignments?user.id=218ae7d29b71487d86b11aeb380788ef&scope.project.id=c19ba4a2c0224c079c5a8a6a56569fd6&role.id=81b14dd0538e44b4bfa9bb906718914a => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:33.988283 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18d077-7641-452c-8348-e2be17eee991 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:33.989360 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18d077-7641-452c-8348-e2be17eee991 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:33.989836 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18d077-7641-452c-8348-e2be17eee991 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:33.992201 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 361/719] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:33 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:34.001059 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4585479-f5ed-4d5b-af87-5e5c9a48307e None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:34.001558 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4585479-f5ed-4d5b-af87-5e5c9a48307e None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:34.001661 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4585479-f5ed-4d5b-af87-5e5c9a48307e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:34.021615 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-e4585479-f5ed-4d5b-af87-5e5c9a48307e None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:34.022832 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-e4585479-f5ed-4d5b-af87-5e5c9a48307e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:34.039225 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 359/720] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:33 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 24 04:47:34.090062 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18d077-7641-452c-8348-e2be17eee991 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:34.106533 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18d077-7641-452c-8348-e2be17eee991 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:34.116318 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0320e5b6-8f4f-4f35-ae78-4031e601a6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:34.117144 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320e5b6-8f4f-4f35-ae78-4031e601a6b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:34.117424 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320e5b6-8f4f-4f35-ae78-4031e601a6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:34.117699 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320e5b6-8f4f-4f35-ae78-4031e601a6b7 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:34.135223 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0320e5b6-8f4f-4f35-ae78-4031e601a6b7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:47:34.142910 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-0320e5b6-8f4f-4f35-ae78-4031e601a6b7 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 24 04:47:34.144176 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 362/721] 10.222.0.43 () {56 vars in 1123 bytes} [Fri Dec 24 04:47:34 2021] GET /identity/v3/roles/service => generated 85 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:34.150854 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4585479-f5ed-4d5b-af87-5e5c9a48307e None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:34.160536 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4585479-f5ed-4d5b-af87-5e5c9a48307e None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:34.170212 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76963e74-a02a-4a3f-a350-8764316bc7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:34.170894 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76963e74-a02a-4a3f-a350-8764316bc7c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:34.171177 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76963e74-a02a-4a3f-a350-8764316bc7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:34.171451 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76963e74-a02a-4a3f-a350-8764316bc7c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:34.172231 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76963e74-a02a-4a3f-a350-8764316bc7c9 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:34.172552 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76963e74-a02a-4a3f-a350-8764316bc7c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:34.174173 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76963e74-a02a-4a3f-a350-8764316bc7c9 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:34.183468 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 360/722] 10.222.0.43 () {56 vars in 1124 bytes} [Fri Dec 24 04:47:34 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:34.193836 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0320e5b6-8f4f-4f35-ae78-4031e601a6b7 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:34.204160 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0320e5b6-8f4f-4f35-ae78-4031e601a6b7 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:34.225202 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a5de94-14cb-4df2-aa7c-20512b8fc22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:34.226007 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5de94-14cb-4df2-aa7c-20512b8fc22d admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:34.226290 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5de94-14cb-4df2-aa7c-20512b8fc22d admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:34.226566 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5de94-14cb-4df2-aa7c-20512b8fc22d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:34.237990 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a5de94-14cb-4df2-aa7c-20512b8fc22d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:34.239884 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a5de94-14cb-4df2-aa7c-20512b8fc22d admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:34.274958 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-30a5de94-14cb-4df2-aa7c-20512b8fc22d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:47:34.276347 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 363/723] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:34.282532 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76963e74-a02a-4a3f-a350-8764316bc7c9 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:34.292476 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76963e74-a02a-4a3f-a350-8764316bc7c9 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:34.303879 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd4ef4-6a8b-4bc7-a430-7fa24376d8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:34.304565 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd4ef4-6a8b-4bc7-a430-7fa24376d8d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:34.304856 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd4ef4-6a8b-4bc7-a430-7fa24376d8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:34.305135 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd4ef4-6a8b-4bc7-a430-7fa24376d8d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:34.305888 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfd4ef4-6a8b-4bc7-a430-7fa24376d8d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:34.306194 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfd4ef4-6a8b-4bc7-a430-7fa24376d8d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:34.307804 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfd4ef4-6a8b-4bc7-a430-7fa24376d8d4 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:34.325589 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 361/724] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:47:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:34.331922 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a5de94-14cb-4df2-aa7c-20512b8fc22d admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:34.342740 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a5de94-14cb-4df2-aa7c-20512b8fc22d admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:34.352691 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955699e-699e-455a-b8f5-4df1b19e956f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:34.353532 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955699e-699e-455a-b8f5-4df1b19e956f admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:34.353811 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955699e-699e-455a-b8f5-4df1b19e956f admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:34.354085 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955699e-699e-455a-b8f5-4df1b19e956f admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:34.368630 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4955699e-699e-455a-b8f5-4df1b19e956f admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:34.370665 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4955699e-699e-455a-b8f5-4df1b19e956f admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:34.392929 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-4955699e-699e-455a-b8f5-4df1b19e956f admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 24 04:47:34.394443 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 364/725] 10.222.0.43 () {56 vars in 1138 bytes} [Fri Dec 24 04:47:34 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:34.400326 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd4ef4-6a8b-4bc7-a430-7fa24376d8d4 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:34.414236 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd4ef4-6a8b-4bc7-a430-7fa24376d8d4 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:34.425832 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2177f-6c40-4496-b281-f80ea0e07d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:34.426556 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2177f-6c40-4496-b281-f80ea0e07d51 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:34.426878 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2177f-6c40-4496-b281-f80ea0e07d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:34.427146 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2177f-6c40-4496-b281-f80ea0e07d51 admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:34.428018 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d2177f-6c40-4496-b281-f80ea0e07d51 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:34.428366 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d2177f-6c40-4496-b281-f80ea0e07d51 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:34.434584 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d2177f-6c40-4496-b281-f80ea0e07d51 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:34.462749 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 362/726] 10.222.0.43 () {56 vars in 1170 bytes} [Fri Dec 24 04:47:34 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:34.468983 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955699e-699e-455a-b8f5-4df1b19e956f admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:34.481906 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955699e-699e-455a-b8f5-4df1b19e956f admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:34.497863 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820391f0-3f98-4cc6-a8c1-5e01d3d69013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:34.498455 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820391f0-3f98-4cc6-a8c1-5e01d3d69013 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:34.498733 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820391f0-3f98-4cc6-a8c1-5e01d3d69013 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:34.499001 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820391f0-3f98-4cc6-a8c1-5e01d3d69013 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:34.516208 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820391f0-3f98-4cc6-a8c1-5e01d3d69013 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:34.517999 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820391f0-3f98-4cc6-a8c1-5e01d3d69013 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:34.530362 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 365/727] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:47:34 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 24 04:47:34.536141 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2177f-6c40-4496-b281-f80ea0e07d51 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:34.549606 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2177f-6c40-4496-b281-f80ea0e07d51 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:34.555366 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e183d-ee1b-4947-b23e-d2c65465666f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:34.556179 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e183d-ee1b-4947-b23e-d2c65465666f admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:34.556463 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e183d-ee1b-4947-b23e-d2c65465666f admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:34.556779 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e183d-ee1b-4947-b23e-d2c65465666f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:34.575153 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e183d-ee1b-4947-b23e-d2c65465666f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:34.577145 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e183d-ee1b-4947-b23e-d2c65465666f admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:34.593990 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a592fd0-e37e-4d85-85ac-50f56e41bfd6 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:34.594303 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a592fd0-e37e-4d85-85ac-50f56e41bfd6 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:34.594536 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a592fd0-e37e-4d85-85ac-50f56e41bfd6 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:34.596442 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 366/728] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 24 04:47:34.599317 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-551e183d-ee1b-4947-b23e-d2c65465666f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:47:34.604877 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 363/729] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:34.606640 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a592fd0-e37e-4d85-85ac-50f56e41bfd6 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:34.612570 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab807e-e755-4c5f-8d29-2abff2e130a0 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:34.612869 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab807e-e755-4c5f-8d29-2abff2e130a0 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:34.613149 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab807e-e755-4c5f-8d29-2abff2e130a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:34.632219 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-4eab807e-e755-4c5f-8d29-2abff2e130a0 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:34.634108 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-4eab807e-e755-4c5f-8d29-2abff2e130a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:34.641748 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a592fd0-e37e-4d85-85ac-50f56e41bfd6 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:34.650413 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 364/730] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:34 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 24 04:47:34.652755 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7cceb3-95d8-4b41-9797-6ac99f7ffc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:34.653476 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7cceb3-95d8-4b41-9797-6ac99f7ffc2c admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:34.653763 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7cceb3-95d8-4b41-9797-6ac99f7ffc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:34.654034 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7cceb3-95d8-4b41-9797-6ac99f7ffc2c admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:34.654786 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7cceb3-95d8-4b41-9797-6ac99f7ffc2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:34.655090 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7cceb3-95d8-4b41-9797-6ac99f7ffc2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:34.656714 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7cceb3-95d8-4b41-9797-6ac99f7ffc2c admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:34.674576 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 367/731] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:47:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:34.679904 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab807e-e755-4c5f-8d29-2abff2e130a0 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:34.690507 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab807e-e755-4c5f-8d29-2abff2e130a0 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:34.695231 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96fc6c-fca8-41f7-bad5-264487f43da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:34.696029 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96fc6c-fca8-41f7-bad5-264487f43da5 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:34.696311 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96fc6c-fca8-41f7-bad5-264487f43da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:34.700740 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96fc6c-fca8-41f7-bad5-264487f43da5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:34.709460 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f96fc6c-fca8-41f7-bad5-264487f43da5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:34.711550 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f96fc6c-fca8-41f7-bad5-264487f43da5 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:34.729695 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-8f96fc6c-fca8-41f7-bad5-264487f43da5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 24 04:47:34.731168 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 365/732] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Dec 24 04:47:34 2021] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:34.737394 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7cceb3-95d8-4b41-9797-6ac99f7ffc2c admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:34.747453 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7cceb3-95d8-4b41-9797-6ac99f7ffc2c admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:34.756834 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522a1422-89c8-40a0-bc51-6be8b12c11c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:34.757440 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a1422-89c8-40a0-bc51-6be8b12c11c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:34.757724 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a1422-89c8-40a0-bc51-6be8b12c11c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:34.758000 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a1422-89c8-40a0-bc51-6be8b12c11c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:34.758812 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522a1422-89c8-40a0-bc51-6be8b12c11c0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:34.759122 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522a1422-89c8-40a0-bc51-6be8b12c11c0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:34.761022 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522a1422-89c8-40a0-bc51-6be8b12c11c0 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:34.772248 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96fc6c-fca8-41f7-bad5-264487f43da5 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:34.782883 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96fc6c-fca8-41f7-bad5-264487f43da5 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:34.790490 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 368/733] 10.222.0.43 () {56 vars in 1169 bytes} [Fri Dec 24 04:47:34 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:34.791883 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce5d08-5f02-4f93-a830-3c43dbb9beac None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:34.792207 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce5d08-5f02-4f93-a830-3c43dbb9beac None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:34.792486 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce5d08-5f02-4f93-a830-3c43dbb9beac None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:34.794908 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 369/734] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:34.796160 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c0b8a3-195d-481d-9056-d55125e15200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:34.797004 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0b8a3-195d-481d-9056-d55125e15200 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:34.797284 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0b8a3-195d-481d-9056-d55125e15200 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:34.797557 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0b8a3-195d-481d-9056-d55125e15200 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:34.800729 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a7c930-35ce-4991-aa98-3c44bcb05cdd None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:34.801058 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a7c930-35ce-4991-aa98-3c44bcb05cdd None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:34.801335 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a7c930-35ce-4991-aa98-3c44bcb05cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:34.811780 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c0b8a3-195d-481d-9056-d55125e15200 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:47:34.819717 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-78c0b8a3-195d-481d-9056-d55125e15200 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 24 04:47:34.820278 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-d6a7c930-35ce-4991-aa98-3c44bcb05cdd None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:34.821133 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 366/735] 10.222.0.43 () {56 vars in 1117 bytes} [Fri Dec 24 04:47:34 2021] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:47:34.821543 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-d6a7c930-35ce-4991-aa98-3c44bcb05cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:34.825321 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c0b8a3-195d-481d-9056-d55125e15200 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:34.834267 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 370/736] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:34 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 24 04:47:34.837820 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c0b8a3-195d-481d-9056-d55125e15200 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:34.840952 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a7c930-35ce-4991-aa98-3c44bcb05cdd None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:34.842394 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bdeea8-671d-4c16-b998-a9b8ebf77d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:34.843046 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdeea8-671d-4c16-b998-a9b8ebf77d17 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:34.843332 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdeea8-671d-4c16-b998-a9b8ebf77d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:34.843607 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdeea8-671d-4c16-b998-a9b8ebf77d17 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:34.844467 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bdeea8-671d-4c16-b998-a9b8ebf77d17 admin admin] RBAC: Adding query filter params (role.id=81b14dd0538e44b4bfa9bb906718914a, scope.project.id=c19ba4a2c0224c079c5a8a6a56569fd6, user.id=3d0ee2c830754741b0f9eedabf6bded8) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:34.844814 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bdeea8-671d-4c16-b998-a9b8ebf77d17 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:34.846933 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bdeea8-671d-4c16-b998-a9b8ebf77d17 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:34.861370 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 367/737] 10.222.0.43 () {56 vars in 1395 bytes} [Fri Dec 24 04:47:34 2021] GET /identity/v3/role_assignments?user.id=3d0ee2c830754741b0f9eedabf6bded8&scope.project.id=c19ba4a2c0224c079c5a8a6a56569fd6&role.id=81b14dd0538e44b4bfa9bb906718914a => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:34.867477 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a7c930-35ce-4991-aa98-3c44bcb05cdd None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:34.870807 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bdeea8-671d-4c16-b998-a9b8ebf77d17 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:34.873435 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb397b-1f06-48f1-a4d4-29cad5c22892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:34.874185 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb397b-1f06-48f1-a4d4-29cad5c22892 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:34.874463 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb397b-1f06-48f1-a4d4-29cad5c22892 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:34.874733 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb397b-1f06-48f1-a4d4-29cad5c22892 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:34.875604 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb397b-1f06-48f1-a4d4-29cad5c22892 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:34.875947 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb397b-1f06-48f1-a4d4-29cad5c22892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:34.877701 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb397b-1f06-48f1-a4d4-29cad5c22892 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:34.885832 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bdeea8-671d-4c16-b998-a9b8ebf77d17 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:34.887237 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 371/738] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:47:34 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:34.896123 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78de2f37-30bc-40b7-8099-e56aefb6b928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:34.896795 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de2f37-30bc-40b7-8099-e56aefb6b928 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:34.897085 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de2f37-30bc-40b7-8099-e56aefb6b928 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:34.897445 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de2f37-30bc-40b7-8099-e56aefb6b928 admin admin] PATH_INFO: `/v3/services` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:34.898336 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78de2f37-30bc-40b7-8099-e56aefb6b928 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:34.899432 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING py.warnings [None req-78de2f37-30bc-40b7-8099-e56aefb6b928 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:47:34.899432 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: warnings.warn(msg) Dec 24 04:47:34.899432 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: Dec 24 04:47:34.900346 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78de2f37-30bc-40b7-8099-e56aefb6b928 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:34.904802 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb397b-1f06-48f1-a4d4-29cad5c22892 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:34.923061 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 368/739] 10.222.0.43 () {60 vars in 1162 bytes} [Fri Dec 24 04:47:34 2021] POST /identity/v3/services => generated 240 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 04:47:34.938985 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb397b-1f06-48f1-a4d4-29cad5c22892 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:34.983935 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0635e1c-50eb-49a7-b2eb-0b18aeb74cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:34.984774 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0635e1c-50eb-49a7-b2eb-0b18aeb74cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:34.985054 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0635e1c-50eb-49a7-b2eb-0b18aeb74cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:34.985323 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0635e1c-50eb-49a7-b2eb-0b18aeb74cc0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:35.004981 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0635e1c-50eb-49a7-b2eb-0b18aeb74cc0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:35.006916 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0635e1c-50eb-49a7-b2eb-0b18aeb74cc0 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:35.031665 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-c0635e1c-50eb-49a7-b2eb-0b18aeb74cc0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:47:35.037577 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 372/740] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 133 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:35.043957 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78de2f37-30bc-40b7-8099-e56aefb6b928 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:35.055239 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78de2f37-30bc-40b7-8099-e56aefb6b928 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:35.065630 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa8a56-fd74-4e5f-bf78-c6c63c6d1382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:35.066313 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa8a56-fd74-4e5f-bf78-c6c63c6d1382 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:35.066724 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa8a56-fd74-4e5f-bf78-c6c63c6d1382 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:35.069373 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa8a56-fd74-4e5f-bf78-c6c63c6d1382 admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:35.069373 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fa8a56-fd74-4e5f-bf78-c6c63c6d1382 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:35.069820 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fa8a56-fd74-4e5f-bf78-c6c63c6d1382 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:35.071607 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fa8a56-fd74-4e5f-bf78-c6c63c6d1382 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:35.092218 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 369/741] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:47:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:35.098484 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0635e1c-50eb-49a7-b2eb-0b18aeb74cc0 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:35.123511 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0635e1c-50eb-49a7-b2eb-0b18aeb74cc0 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:35.137989 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220b5bf-bf9d-4675-92dd-4e06c183dcf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:35.138823 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220b5bf-bf9d-4675-92dd-4e06c183dcf9 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:35.139105 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220b5bf-bf9d-4675-92dd-4e06c183dcf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:35.139381 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220b5bf-bf9d-4675-92dd-4e06c183dcf9 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:35.143359 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be684b-9f67-4d38-9605-2cb16749bd7e None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:35.144446 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be684b-9f67-4d38-9605-2cb16749bd7e None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:35.144446 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be684b-9f67-4d38-9605-2cb16749bd7e None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:35.148485 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 370/742] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:35.153741 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2220b5bf-bf9d-4675-92dd-4e06c183dcf9 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:35.156301 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2220b5bf-bf9d-4675-92dd-4e06c183dcf9 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:35.162107 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c991226-8504-43a9-bc3e-08087b14435e None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:35.162439 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c991226-8504-43a9-bc3e-08087b14435e None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:35.162680 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c991226-8504-43a9-bc3e-08087b14435e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:35.174160 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-2220b5bf-bf9d-4675-92dd-4e06c183dcf9 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 24 04:47:35.175806 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 373/743] 10.222.0.43 () {56 vars in 1114 bytes} [Fri Dec 24 04:47:35 2021] GET /identity/v3/users/nova => generated 82 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:35.183808 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220b5bf-bf9d-4675-92dd-4e06c183dcf9 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:35.198922 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220b5bf-bf9d-4675-92dd-4e06c183dcf9 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:35.203289 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-9c991226-8504-43a9-bc3e-08087b14435e None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:35.204973 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-9c991226-8504-43a9-bc3e-08087b14435e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:35.205669 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2153e-ca3d-4f66-9383-6e2db9c3db90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:35.206508 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2153e-ca3d-4f66-9383-6e2db9c3db90 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:35.206795 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2153e-ca3d-4f66-9383-6e2db9c3db90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:35.207123 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2153e-ca3d-4f66-9383-6e2db9c3db90 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:35.208117 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb2153e-ca3d-4f66-9383-6e2db9c3db90 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:35.208589 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb2153e-ca3d-4f66-9383-6e2db9c3db90 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:35.211708 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb2153e-ca3d-4f66-9383-6e2db9c3db90 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:35.217701 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 371/744] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:35 2021] POST /identity/v3/auth/tokens => generated 1013 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:47:35.236066 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 374/745] 10.222.0.43 () {56 vars in 1154 bytes} [Fri Dec 24 04:47:35 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:35.237496 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c991226-8504-43a9-bc3e-08087b14435e None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:35.243432 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2153e-ca3d-4f66-9383-6e2db9c3db90 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:35.248147 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c991226-8504-43a9-bc3e-08087b14435e None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:35.252789 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb3bac-453e-473d-b1f2-24f5b120fe97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:35.253666 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb3bac-453e-473d-b1f2-24f5b120fe97 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:35.254010 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb3bac-453e-473d-b1f2-24f5b120fe97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:35.254358 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb3bac-453e-473d-b1f2-24f5b120fe97 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:35.255679 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2153e-ca3d-4f66-9383-6e2db9c3db90 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:35.260616 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be21c6d-767e-4ce2-b0e0-14bf50f1fcb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:35.261544 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be21c6d-767e-4ce2-b0e0-14bf50f1fcb9 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:35.262092 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be21c6d-767e-4ce2-b0e0-14bf50f1fcb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:35.262604 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be21c6d-767e-4ce2-b0e0-14bf50f1fcb9 admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:35.263619 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be21c6d-767e-4ce2-b0e0-14bf50f1fcb9 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:35.264920 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING py.warnings [None req-0be21c6d-767e-4ce2-b0e0-14bf50f1fcb9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:47:35.264920 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: warnings.warn(msg) Dec 24 04:47:35.264920 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: Dec 24 04:47:35.266207 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be21c6d-767e-4ce2-b0e0-14bf50f1fcb9 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:35.267071 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fb3bac-453e-473d-b1f2-24f5b120fe97 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:35.269174 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fb3bac-453e-473d-b1f2-24f5b120fe97 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:35.290361 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-37fb3bac-453e-473d-b1f2-24f5b120fe97 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:47:35.295009 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 375/747] 10.222.0.43 () {60 vars in 1162 bytes} [Fri Dec 24 04:47:35 2021] POST /identity/v3/services => generated 251 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 04:47:35.300623 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 372/747] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:35.302714 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be21c6d-767e-4ce2-b0e0-14bf50f1fcb9 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:35.329208 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be21c6d-767e-4ce2-b0e0-14bf50f1fcb9 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:35.334946 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05079bb-b716-4db8-bef4-870174b97e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:35.335639 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05079bb-b716-4db8-bef4-870174b97e07 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:35.335919 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05079bb-b716-4db8-bef4-870174b97e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:35.336194 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05079bb-b716-4db8-bef4-870174b97e07 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:35.336997 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05079bb-b716-4db8-bef4-870174b97e07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:35.337306 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05079bb-b716-4db8-bef4-870174b97e07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:35.338940 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05079bb-b716-4db8-bef4-870174b97e07 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:35.352806 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 376/748] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:47:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:35.359150 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb3bac-453e-473d-b1f2-24f5b120fe97 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:35.370166 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb3bac-453e-473d-b1f2-24f5b120fe97 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:35.375226 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01607c7d-fb30-49f4-bc83-de41ed88c45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:35.376054 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01607c7d-fb30-49f4-bc83-de41ed88c45b admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:35.376337 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01607c7d-fb30-49f4-bc83-de41ed88c45b admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:35.376662 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01607c7d-fb30-49f4-bc83-de41ed88c45b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:35.385198 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01607c7d-fb30-49f4-bc83-de41ed88c45b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:35.387221 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01607c7d-fb30-49f4-bc83-de41ed88c45b admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:35.402891 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-01607c7d-fb30-49f4-bc83-de41ed88c45b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 24 04:47:35.406434 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 373/749] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Dec 24 04:47:35 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:35.411164 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05079bb-b716-4db8-bef4-870174b97e07 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:35.422366 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05079bb-b716-4db8-bef4-870174b97e07 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:35.427427 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad90f58-416d-43fb-836f-fe9cc2c882e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:35.428156 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad90f58-416d-43fb-836f-fe9cc2c882e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:35.428448 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad90f58-416d-43fb-836f-fe9cc2c882e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:35.428757 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad90f58-416d-43fb-836f-fe9cc2c882e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:35.429575 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad90f58-416d-43fb-836f-fe9cc2c882e3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:35.429983 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad90f58-416d-43fb-836f-fe9cc2c882e3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:35.431850 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad90f58-416d-43fb-836f-fe9cc2c882e3 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:35.448699 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 377/750] 10.222.0.43 () {56 vars in 1169 bytes} [Fri Dec 24 04:47:35 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:35.452261 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01607c7d-fb30-49f4-bc83-de41ed88c45b admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:35.464901 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01607c7d-fb30-49f4-bc83-de41ed88c45b admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:35.470527 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac5893-cf85-4b19-b0c5-e6d68b83240b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:35.471492 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac5893-cf85-4b19-b0c5-e6d68b83240b admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:35.471809 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac5893-cf85-4b19-b0c5-e6d68b83240b admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:35.472094 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac5893-cf85-4b19-b0c5-e6d68b83240b admin admin] PATH_INFO: `/v3/projects/c19ba4a2c0224c079c5a8a6a56569fd6/users/6f9ad1e8f8f74edcb44aabe17eb59648/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:35.474205 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eac5893-cf85-4b19-b0c5-e6d68b83240b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c19ba4a2c0224c079c5a8a6a56569fd6, user_id=6f9ad1e8f8f74edcb44aabe17eb59648, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:35.477167 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eac5893-cf85-4b19-b0c5-e6d68b83240b admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:35.499269 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 374/751] 10.222.0.43 () {58 vars in 1460 bytes} [Fri Dec 24 04:47:35 2021] PUT /identity/v3/projects/c19ba4a2c0224c079c5a8a6a56569fd6/users/6f9ad1e8f8f74edcb44aabe17eb59648/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:47:36.311149 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55dded9-9f7c-4bf2-a108-73bb3d4f1833 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:36.311857 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55dded9-9f7c-4bf2-a108-73bb3d4f1833 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:36.311857 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55dded9-9f7c-4bf2-a108-73bb3d4f1833 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:36.314868 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 378/752] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:36.321760 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc798a88-4159-45ae-92cb-795c2f32a8f5 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:36.322253 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc798a88-4159-45ae-92cb-795c2f32a8f5 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:36.322427 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc798a88-4159-45ae-92cb-795c2f32a8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:36.356339 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-cc798a88-4159-45ae-92cb-795c2f32a8f5 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:36.357568 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-cc798a88-4159-45ae-92cb-795c2f32a8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:36.460296 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 375/753] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:36 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:47:36.507625 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55dded9-9f7c-4bf2-a108-73bb3d4f1833 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:36.530968 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55dded9-9f7c-4bf2-a108-73bb3d4f1833 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:36.540764 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3badd43-25bb-4199-9109-fdb01881d791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:36.541905 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3badd43-25bb-4199-9109-fdb01881d791 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:36.542404 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3badd43-25bb-4199-9109-fdb01881d791 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:36.542885 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3badd43-25bb-4199-9109-fdb01881d791 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:36.564273 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3badd43-25bb-4199-9109-fdb01881d791 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:47:36.571875 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-e3badd43-25bb-4199-9109-fdb01881d791 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 24 04:47:36.573760 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 379/754] 10.222.0.43 () {56 vars in 1117 bytes} [Fri Dec 24 04:47:36 2021] GET /identity/v3/roles/admin => generated 83 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:36.579830 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc798a88-4159-45ae-92cb-795c2f32a8f5 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:36.593873 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc798a88-4159-45ae-92cb-795c2f32a8f5 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:36.610159 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e822952-c1b1-48a9-8ce1-a2ea06fb7824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:36.610850 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e822952-c1b1-48a9-8ce1-a2ea06fb7824 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:36.611125 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e822952-c1b1-48a9-8ce1-a2ea06fb7824 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:36.611391 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e822952-c1b1-48a9-8ce1-a2ea06fb7824 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:36.612191 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e822952-c1b1-48a9-8ce1-a2ea06fb7824 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:36.612495 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e822952-c1b1-48a9-8ce1-a2ea06fb7824 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:36.614205 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e822952-c1b1-48a9-8ce1-a2ea06fb7824 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:36.631094 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 376/755] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:47:36 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:36.636969 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3badd43-25bb-4199-9109-fdb01881d791 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:36.649518 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3badd43-25bb-4199-9109-fdb01881d791 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:36.660796 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163913c7-5623-4486-8e7f-2c2590a7d05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:36.661899 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163913c7-5623-4486-8e7f-2c2590a7d05b admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:36.662407 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163913c7-5623-4486-8e7f-2c2590a7d05b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:36.662902 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163913c7-5623-4486-8e7f-2c2590a7d05b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:36.684550 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163913c7-5623-4486-8e7f-2c2590a7d05b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:36.686818 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163913c7-5623-4486-8e7f-2c2590a7d05b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:36.714689 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-163913c7-5623-4486-8e7f-2c2590a7d05b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:47:36.716128 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 380/756] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:36 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:36.722488 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e822952-c1b1-48a9-8ce1-a2ea06fb7824 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:36.734049 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e822952-c1b1-48a9-8ce1-a2ea06fb7824 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:36.744956 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c1428-6823-4cea-87bd-c323affefd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:36.746242 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c1428-6823-4cea-87bd-c323affefd15 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:36.746242 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c1428-6823-4cea-87bd-c323affefd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:36.746242 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c1428-6823-4cea-87bd-c323affefd15 admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:36.747029 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4c1428-6823-4cea-87bd-c323affefd15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:36.747334 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4c1428-6823-4cea-87bd-c323affefd15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:36.749174 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4c1428-6823-4cea-87bd-c323affefd15 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:36.767570 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 377/757] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:47:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:36.773424 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163913c7-5623-4486-8e7f-2c2590a7d05b admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:36.789631 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163913c7-5623-4486-8e7f-2c2590a7d05b admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:36.797662 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d9ef7-d864-4213-ac50-729f491a981b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:36.798457 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d9ef7-d864-4213-ac50-729f491a981b admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:36.798746 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d9ef7-d864-4213-ac50-729f491a981b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:36.798998 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d9ef7-d864-4213-ac50-729f491a981b admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:36.809754 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d9ef7-d864-4213-ac50-729f491a981b admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:36.811777 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d9ef7-d864-4213-ac50-729f491a981b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:36.832280 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-6d2d9ef7-d864-4213-ac50-729f491a981b admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 24 04:47:36.833438 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 381/758] 10.222.0.43 () {56 vars in 1117 bytes} [Fri Dec 24 04:47:36 2021] GET /identity/v3/users/swift => generated 83 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:36.839819 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c1428-6823-4cea-87bd-c323affefd15 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:36.853562 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c1428-6823-4cea-87bd-c323affefd15 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:36.861146 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca006902-8775-4680-b96b-dc1cfa26c498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:36.861826 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca006902-8775-4680-b96b-dc1cfa26c498 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:36.862105 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca006902-8775-4680-b96b-dc1cfa26c498 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:36.862379 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca006902-8775-4680-b96b-dc1cfa26c498 admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:36.863239 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca006902-8775-4680-b96b-dc1cfa26c498 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:36.863544 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca006902-8775-4680-b96b-dc1cfa26c498 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:36.865438 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca006902-8775-4680-b96b-dc1cfa26c498 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:36.887922 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 378/759] 10.222.0.43 () {56 vars in 1156 bytes} [Fri Dec 24 04:47:36 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:36.893935 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d9ef7-d864-4213-ac50-729f491a981b admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:36.909394 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d9ef7-d864-4213-ac50-729f491a981b admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:36.917673 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4892c320-6191-4472-9011-85f97dcb6d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:36.918313 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892c320-6191-4472-9011-85f97dcb6d9e admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:36.918621 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892c320-6191-4472-9011-85f97dcb6d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:36.918891 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892c320-6191-4472-9011-85f97dcb6d9e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:36.931990 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4892c320-6191-4472-9011-85f97dcb6d9e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:36.933772 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4892c320-6191-4472-9011-85f97dcb6d9e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:36.945755 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 382/760] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:47:36 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:47:36.951922 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca006902-8775-4680-b96b-dc1cfa26c498 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:36.965419 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca006902-8775-4680-b96b-dc1cfa26c498 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:36.970209 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15af8c-c882-4c0b-ace4-d5c0fba43e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:36.970996 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15af8c-c882-4c0b-ace4-d5c0fba43e5e admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:36.971322 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15af8c-c882-4c0b-ace4-d5c0fba43e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:36.971544 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15af8c-c882-4c0b-ace4-d5c0fba43e5e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:36.986829 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e15af8c-c882-4c0b-ace4-d5c0fba43e5e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:36.988696 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e15af8c-c882-4c0b-ace4-d5c0fba43e5e admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:37.009698 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-2e15af8c-c882-4c0b-ace4-d5c0fba43e5e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:47:37.011197 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 379/761] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:36 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:37.016914 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4892c320-6191-4472-9011-85f97dcb6d9e admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:37.025741 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4892c320-6191-4472-9011-85f97dcb6d9e admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:37.036591 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44699f83-5c62-4e04-bdb0-43c35392dbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:37.037246 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44699f83-5c62-4e04-bdb0-43c35392dbfd admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:37.037523 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44699f83-5c62-4e04-bdb0-43c35392dbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:37.037792 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44699f83-5c62-4e04-bdb0-43c35392dbfd admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:37.038527 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44699f83-5c62-4e04-bdb0-43c35392dbfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:37.038823 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44699f83-5c62-4e04-bdb0-43c35392dbfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:37.040405 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44699f83-5c62-4e04-bdb0-43c35392dbfd admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:37.055874 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 383/762] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:47:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:37.062203 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15af8c-c882-4c0b-ace4-d5c0fba43e5e admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:37.078073 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15af8c-c882-4c0b-ace4-d5c0fba43e5e admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:37.086111 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da31e2-d03f-4d22-8a5d-ea086a7c9cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:37.086842 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da31e2-d03f-4d22-8a5d-ea086a7c9cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:37.087117 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da31e2-d03f-4d22-8a5d-ea086a7c9cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:37.087387 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da31e2-d03f-4d22-8a5d-ea086a7c9cb6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:37.097620 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40da31e2-d03f-4d22-8a5d-ea086a7c9cb6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:37.099581 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40da31e2-d03f-4d22-8a5d-ea086a7c9cb6 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:37.115986 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-40da31e2-d03f-4d22-8a5d-ea086a7c9cb6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 24 04:47:37.117201 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 380/763] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Dec 24 04:47:37 2021] GET /identity/v3/projects/service => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:37.123749 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44699f83-5c62-4e04-bdb0-43c35392dbfd admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:37.137396 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44699f83-5c62-4e04-bdb0-43c35392dbfd admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:37.145265 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071ded5-a456-435a-a7c6-b80ecb1ef63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:37.145932 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071ded5-a456-435a-a7c6-b80ecb1ef63f admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:37.146209 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071ded5-a456-435a-a7c6-b80ecb1ef63f admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:37.146480 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071ded5-a456-435a-a7c6-b80ecb1ef63f admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:37.147282 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8071ded5-a456-435a-a7c6-b80ecb1ef63f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:37.147584 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8071ded5-a456-435a-a7c6-b80ecb1ef63f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:37.149463 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8071ded5-a456-435a-a7c6-b80ecb1ef63f admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:37.167045 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 384/764] 10.222.0.43 () {56 vars in 1169 bytes} [Fri Dec 24 04:47:37 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:37.173163 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da31e2-d03f-4d22-8a5d-ea086a7c9cb6 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:37.189510 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da31e2-d03f-4d22-8a5d-ea086a7c9cb6 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:37.197124 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2314dec-ee7b-499e-993e-4eaa3b5e05c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:37.197769 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2314dec-ee7b-499e-993e-4eaa3b5e05c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:37.198045 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2314dec-ee7b-499e-993e-4eaa3b5e05c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:37.198316 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2314dec-ee7b-499e-993e-4eaa3b5e05c5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:37.199163 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2314dec-ee7b-499e-993e-4eaa3b5e05c5 admin admin] RBAC: Adding query filter params (role.id=d5e6fc257d8541d5a5ed1988eacd5be7, scope.project.id=c19ba4a2c0224c079c5a8a6a56569fd6, user.id=218ae7d29b71487d86b11aeb380788ef) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:37.199468 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2314dec-ee7b-499e-993e-4eaa3b5e05c5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:37.201541 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2314dec-ee7b-499e-993e-4eaa3b5e05c5 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:37.207314 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 381/765] 10.222.0.43 () {56 vars in 1395 bytes} [Fri Dec 24 04:47:37 2021] GET /identity/v3/role_assignments?user.id=218ae7d29b71487d86b11aeb380788ef&scope.project.id=c19ba4a2c0224c079c5a8a6a56569fd6&role.id=d5e6fc257d8541d5a5ed1988eacd5be7 => generated 259 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:37.801435 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c144c9-9187-49b3-a9f4-1ef664403af2 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:37.802184 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c144c9-9187-49b3-a9f4-1ef664403af2 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:37.802184 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c144c9-9187-49b3-a9f4-1ef664403af2 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:37.804064 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 385/766] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:37.809706 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf98c9-3fd3-4d00-ad8e-a30031a7709c None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:37.810209 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf98c9-3fd3-4d00-ad8e-a30031a7709c None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:37.810553 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf98c9-3fd3-4d00-ad8e-a30031a7709c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:37.833248 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-9dcf98c9-3fd3-4d00-ad8e-a30031a7709c None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:37.834773 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-9dcf98c9-3fd3-4d00-ad8e-a30031a7709c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:37.844816 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 382/767] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:37 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:47:37.879999 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c144c9-9187-49b3-a9f4-1ef664403af2 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:37.898500 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c144c9-9187-49b3-a9f4-1ef664403af2 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:37.904839 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a02594-2aab-4710-9fe2-c65c0dcada2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:37.905682 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a02594-2aab-4710-9fe2-c65c0dcada2a admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:37.905967 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a02594-2aab-4710-9fe2-c65c0dcada2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:37.906238 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a02594-2aab-4710-9fe2-c65c0dcada2a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:37.917441 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a02594-2aab-4710-9fe2-c65c0dcada2a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:47:37.924578 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-a9a02594-2aab-4710-9fe2-c65c0dcada2a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 24 04:47:37.926101 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 386/768] 10.222.0.43 () {56 vars in 1123 bytes} [Fri Dec 24 04:47:37 2021] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:37.932580 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf98c9-3fd3-4d00-ad8e-a30031a7709c None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:37.941759 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf98c9-3fd3-4d00-ad8e-a30031a7709c None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:37.946261 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0cabc-f9ce-4f64-a9e5-cfff63698863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:37.946919 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0cabc-f9ce-4f64-a9e5-cfff63698863 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:37.947198 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0cabc-f9ce-4f64-a9e5-cfff63698863 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:37.947469 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0cabc-f9ce-4f64-a9e5-cfff63698863 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:37.948242 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c0cabc-f9ce-4f64-a9e5-cfff63698863 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:37.948557 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c0cabc-f9ce-4f64-a9e5-cfff63698863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:37.950388 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c0cabc-f9ce-4f64-a9e5-cfff63698863 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:37.963655 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 383/769] 10.222.0.43 () {56 vars in 1124 bytes} [Fri Dec 24 04:47:37 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:37.969455 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a02594-2aab-4710-9fe2-c65c0dcada2a admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:37.981612 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a02594-2aab-4710-9fe2-c65c0dcada2a admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:37.990023 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b26c5-963d-4c78-b977-9a7d93621045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:37.990821 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b26c5-963d-4c78-b977-9a7d93621045 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:37.991100 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b26c5-963d-4c78-b977-9a7d93621045 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:37.991372 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b26c5-963d-4c78-b977-9a7d93621045 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:38.012682 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75b26c5-963d-4c78-b977-9a7d93621045 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:38.014543 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75b26c5-963d-4c78-b977-9a7d93621045 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:38.038420 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-a75b26c5-963d-4c78-b977-9a7d93621045 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:47:38.039974 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 387/770] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:38.046994 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0cabc-f9ce-4f64-a9e5-cfff63698863 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:38.066153 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a267b-a0a0-4b2c-9607-806d0660f803 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:38.066489 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a267b-a0a0-4b2c-9607-806d0660f803 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:38.066715 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a267b-a0a0-4b2c-9607-806d0660f803 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:38.067964 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0cabc-f9ce-4f64-a9e5-cfff63698863 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:38.068867 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 388/771] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:38.074597 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2f181-9ab6-4569-86b0-a028f96aa11e None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:38.074984 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2f181-9ab6-4569-86b0-a028f96aa11e None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:38.075217 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2f181-9ab6-4569-86b0-a028f96aa11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:38.080254 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f97f2-85b4-4ff6-8c7b-5c4412e536c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:38.080952 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f97f2-85b4-4ff6-8c7b-5c4412e536c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:38.081231 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f97f2-85b4-4ff6-8c7b-5c4412e536c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:38.081497 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f97f2-85b4-4ff6-8c7b-5c4412e536c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:38.082245 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1f97f2-85b4-4ff6-8c7b-5c4412e536c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:38.082545 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1f97f2-85b4-4ff6-8c7b-5c4412e536c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:38.084466 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1f97f2-85b4-4ff6-8c7b-5c4412e536c5 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:38.103483 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-9ba2f181-9ab6-4569-86b0-a028f96aa11e None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:38.105041 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-9ba2f181-9ab6-4569-86b0-a028f96aa11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:38.108546 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 384/772] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:47:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:38.113127 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f97f2-85b4-4ff6-8c7b-5c4412e536c5 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:38.124181 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 389/773] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:38 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 04:47:38.126025 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f97f2-85b4-4ff6-8c7b-5c4412e536c5 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:38.136602 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bdb210-3a39-4a15-93b6-d5c95f275777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:38.137477 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdb210-3a39-4a15-93b6-d5c95f275777 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:38.137756 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdb210-3a39-4a15-93b6-d5c95f275777 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:38.138022 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdb210-3a39-4a15-93b6-d5c95f275777 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:38.145891 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bdb210-3a39-4a15-93b6-d5c95f275777 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:38.147909 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bdb210-3a39-4a15-93b6-d5c95f275777 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:38.166739 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-d6bdb210-3a39-4a15-93b6-d5c95f275777 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 24 04:47:38.168240 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 385/774] 10.222.0.43 () {56 vars in 1138 bytes} [Fri Dec 24 04:47:38 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:47:38.174426 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2f181-9ab6-4569-86b0-a028f96aa11e None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:38.183851 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2f181-9ab6-4569-86b0-a028f96aa11e None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:38.192624 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6424e34-b287-4ecb-98ff-cd3f109a5b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:38.193295 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6424e34-b287-4ecb-98ff-cd3f109a5b47 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:38.193568 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6424e34-b287-4ecb-98ff-cd3f109a5b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:38.193834 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6424e34-b287-4ecb-98ff-cd3f109a5b47 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:38.194681 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6424e34-b287-4ecb-98ff-cd3f109a5b47 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:38.194982 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6424e34-b287-4ecb-98ff-cd3f109a5b47 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:38.196861 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6424e34-b287-4ecb-98ff-cd3f109a5b47 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:38.202387 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bdb210-3a39-4a15-93b6-d5c95f275777 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:38.211893 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bdb210-3a39-4a15-93b6-d5c95f275777 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:38.222240 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 390/775] 10.222.0.43 () {56 vars in 1170 bytes} [Fri Dec 24 04:47:38 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:38.225236 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43767bf1-2776-451f-9e2a-743a05e4fb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:38.226333 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43767bf1-2776-451f-9e2a-743a05e4fb83 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:38.226863 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43767bf1-2776-451f-9e2a-743a05e4fb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:38.227429 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43767bf1-2776-451f-9e2a-743a05e4fb83 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:38.228321 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43767bf1-2776-451f-9e2a-743a05e4fb83 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:38.228622 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6424e34-b287-4ecb-98ff-cd3f109a5b47 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:38.230387 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43767bf1-2776-451f-9e2a-743a05e4fb83 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:38.241279 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6424e34-b287-4ecb-98ff-cd3f109a5b47 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:38.251989 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa218a-8631-409f-a96b-67e81d1f8301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:38.254087 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa218a-8631-409f-a96b-67e81d1f8301 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:38.254368 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa218a-8631-409f-a96b-67e81d1f8301 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:38.254637 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa218a-8631-409f-a96b-67e81d1f8301 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:38.257481 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-43767bf1-2776-451f-9e2a-743a05e4fb83 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Dec 24 04:47:38.258778 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 386/776] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Dec 24 04:47:38 2021] GET /identity/v3/services/network => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:47:38.264877 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43767bf1-2776-451f-9e2a-743a05e4fb83 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:38.274548 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fa218a-8631-409f-a96b-67e81d1f8301 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:38.276391 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fa218a-8631-409f-a96b-67e81d1f8301 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:38.281492 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43767bf1-2776-451f-9e2a-743a05e4fb83 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:38.289462 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176e1a5-9ef3-4c19-976b-b107bb37d8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:38.291044 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176e1a5-9ef3-4c19-976b-b107bb37d8af admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:38.291325 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176e1a5-9ef3-4c19-976b-b107bb37d8af admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:38.291601 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176e1a5-9ef3-4c19-976b-b107bb37d8af admin admin] PATH_INFO: `/v3/services` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:38.293829 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e176e1a5-9ef3-4c19-976b-b107bb37d8af admin admin] RBAC: Adding query filter params (name=network) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:38.294816 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e176e1a5-9ef3-4c19-976b-b107bb37d8af admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:38.297374 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e176e1a5-9ef3-4c19-976b-b107bb37d8af admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:38.311685 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 387/777] 10.222.0.43 () {56 vars in 1133 bytes} [Fri Dec 24 04:47:38 2021] GET /identity/v3/services?name=network => generated 124 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:38.311858 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-a6fa218a-8631-409f-a96b-67e81d1f8301 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:47:38.312164 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 391/778] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:47:38.316448 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176e1a5-9ef3-4c19-976b-b107bb37d8af admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:38.323973 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa218a-8631-409f-a96b-67e81d1f8301 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:38.333225 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176e1a5-9ef3-4c19-976b-b107bb37d8af admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:38.342508 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa218a-8631-409f-a96b-67e81d1f8301 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:38.343623 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5d469-0ac3-4d6b-9842-d6bf445cceba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:38.344475 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5d469-0ac3-4d6b-9842-d6bf445cceba admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:38.344779 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5d469-0ac3-4d6b-9842-d6bf445cceba admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:38.345055 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5d469-0ac3-4d6b-9842-d6bf445cceba admin admin] PATH_INFO: `/v3/services` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:38.346195 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5d469-0ac3-4d6b-9842-d6bf445cceba admin admin] RBAC: Adding query filter params (type=network) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:38.347026 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5d469-0ac3-4d6b-9842-d6bf445cceba admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:38.350849 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5d469-0ac3-4d6b-9842-d6bf445cceba admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:38.352140 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5606111-ebe5-4af3-96df-d1e3b70ce5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:38.353988 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5606111-ebe5-4af3-96df-d1e3b70ce5b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:38.354266 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5606111-ebe5-4af3-96df-d1e3b70ce5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:38.354539 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5606111-ebe5-4af3-96df-d1e3b70ce5b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:38.356188 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5606111-ebe5-4af3-96df-d1e3b70ce5b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:38.356630 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5606111-ebe5-4af3-96df-d1e3b70ce5b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:38.359337 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5606111-ebe5-4af3-96df-d1e3b70ce5b1 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:38.362988 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 388/779] 10.222.0.43 () {56 vars in 1133 bytes} [Fri Dec 24 04:47:38 2021] GET /identity/v3/services?type=network => generated 350 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:38.368906 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5d469-0ac3-4d6b-9842-d6bf445cceba admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:38.382156 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5d469-0ac3-4d6b-9842-d6bf445cceba admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:38.382870 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 392/780] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:47:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:38.392321 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5606111-ebe5-4af3-96df-d1e3b70ce5b1 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:38.396297 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be559e2-9f22-4904-ba8f-1cb4e5c1b411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:38.397712 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be559e2-9f22-4904-ba8f-1cb4e5c1b411 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:38.398040 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be559e2-9f22-4904-ba8f-1cb4e5c1b411 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:38.398312 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be559e2-9f22-4904-ba8f-1cb4e5c1b411 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:38.399145 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be559e2-9f22-4904-ba8f-1cb4e5c1b411 admin admin] RBAC: Adding query filter params (interface=public, service_id=d2a6ea17ae8246bdaa77987a1773f028, region_id=RegionOne) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:38.399452 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be559e2-9f22-4904-ba8f-1cb4e5c1b411 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:38.402582 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING py.warnings [None req-6be559e2-9f22-4904-ba8f-1cb4e5c1b411 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:47:38.402582 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: warnings.warn(msg) Dec 24 04:47:38.402582 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: Dec 24 04:47:38.406891 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be559e2-9f22-4904-ba8f-1cb4e5c1b411 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:38.411559 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5606111-ebe5-4af3-96df-d1e3b70ce5b1 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:38.423499 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef8b7f-b09f-4cd9-8891-55103e4c6240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:38.424368 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 389/781] 10.222.0.43 () {56 vars in 1272 bytes} [Fri Dec 24 04:47:38 2021] GET /identity/v3/endpoints?service_id=d2a6ea17ae8246bdaa77987a1773f028&interface=public®ion_id=RegionOne => generated 194 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:38.424481 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef8b7f-b09f-4cd9-8891-55103e4c6240 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:38.424774 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef8b7f-b09f-4cd9-8891-55103e4c6240 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:38.425203 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef8b7f-b09f-4cd9-8891-55103e4c6240 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:38.432574 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be559e2-9f22-4904-ba8f-1cb4e5c1b411 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:38.437020 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fef8b7f-b09f-4cd9-8891-55103e4c6240 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:38.439269 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fef8b7f-b09f-4cd9-8891-55103e4c6240 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:38.451250 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be559e2-9f22-4904-ba8f-1cb4e5c1b411 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:38.463006 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-6fef8b7f-b09f-4cd9-8891-55103e4c6240 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 24 04:47:38.464706 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c63b211-84e4-431a-ac90-b2c08a3dc64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:38.465480 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c63b211-84e4-431a-ac90-b2c08a3dc64a admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:38.465770 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c63b211-84e4-431a-ac90-b2c08a3dc64a admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:38.466095 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c63b211-84e4-431a-ac90-b2c08a3dc64a admin admin] PATH_INFO: `/v3/services` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:38.466900 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c63b211-84e4-431a-ac90-b2c08a3dc64a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:38.468418 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 393/782] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Dec 24 04:47:38 2021] GET /identity/v3/projects/service => generated 88 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:38.469525 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c63b211-84e4-431a-ac90-b2c08a3dc64a admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:38.470720 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851de94d-b57a-4fa0-94f2-0924919f0873 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:38.471013 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851de94d-b57a-4fa0-94f2-0924919f0873 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:38.471292 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851de94d-b57a-4fa0-94f2-0924919f0873 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:38.475600 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 394/784] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:38.475732 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 390/784] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Dec 24 04:47:38 2021] GET /identity/v3/services => generated 772 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:38.477371 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851de94d-b57a-4fa0-94f2-0924919f0873 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:38.481256 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b389c568-e4ae-428a-97e2-ddb17cb9519a None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:38.481539 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b389c568-e4ae-428a-97e2-ddb17cb9519a None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:38.481818 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b389c568-e4ae-428a-97e2-ddb17cb9519a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:38.492656 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851de94d-b57a-4fa0-94f2-0924919f0873 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:38.497829 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b52ca4-b63e-4041-9970-21052ad14bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:38.498540 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b52ca4-b63e-4041-9970-21052ad14bdb admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:38.498821 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b52ca4-b63e-4041-9970-21052ad14bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:38.499098 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b52ca4-b63e-4041-9970-21052ad14bdb admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:38.500007 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b52ca4-b63e-4041-9970-21052ad14bdb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:38.500323 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b52ca4-b63e-4041-9970-21052ad14bdb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:38.502372 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b52ca4-b63e-4041-9970-21052ad14bdb admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:38.515706 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 395/785] 10.222.0.43 () {56 vars in 1169 bytes} [Fri Dec 24 04:47:38 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:38.517003 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-b389c568-e4ae-428a-97e2-ddb17cb9519a None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:38.518233 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-b389c568-e4ae-428a-97e2-ddb17cb9519a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:38.522385 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b52ca4-b63e-4041-9970-21052ad14bdb admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:38.534717 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b52ca4-b63e-4041-9970-21052ad14bdb admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:38.548697 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 391/786] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:38 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:47:38.551107 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9333d9-72d1-4528-a9e4-110df83b70f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:38.552119 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9333d9-72d1-4528-a9e4-110df83b70f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:38.552454 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9333d9-72d1-4528-a9e4-110df83b70f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:38.552755 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9333d9-72d1-4528-a9e4-110df83b70f0 admin admin] PATH_INFO: `/v3/projects/c19ba4a2c0224c079c5a8a6a56569fd6/users/3d0ee2c830754741b0f9eedabf6bded8/roles/81b14dd0538e44b4bfa9bb906718914a` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:38.576717 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9333d9-72d1-4528-a9e4-110df83b70f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c19ba4a2c0224c079c5a8a6a56569fd6, user_id=3d0ee2c830754741b0f9eedabf6bded8, role_id=81b14dd0538e44b4bfa9bb906718914a)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:38.579416 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9333d9-72d1-4528-a9e4-110df83b70f0 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:38.589654 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b389c568-e4ae-428a-97e2-ddb17cb9519a None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:38.601019 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b389c568-e4ae-428a-97e2-ddb17cb9519a None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:38.616177 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 396/787] 10.222.0.43 () {58 vars in 1460 bytes} [Fri Dec 24 04:47:38 2021] PUT /identity/v3/projects/c19ba4a2c0224c079c5a8a6a56569fd6/users/3d0ee2c830754741b0f9eedabf6bded8/roles/81b14dd0538e44b4bfa9bb906718914a => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 04:47:38.683910 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1236d5e8-d8cb-4bb9-bf7a-0a657bf94429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:38.684918 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236d5e8-d8cb-4bb9-bf7a-0a657bf94429 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:38.685319 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236d5e8-d8cb-4bb9-bf7a-0a657bf94429 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:38.685615 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236d5e8-d8cb-4bb9-bf7a-0a657bf94429 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:38.707192 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1236d5e8-d8cb-4bb9-bf7a-0a657bf94429 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:47:38.714881 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-1236d5e8-d8cb-4bb9-bf7a-0a657bf94429 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 24 04:47:38.716291 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 392/788] 10.222.0.43 () {56 vars in 1117 bytes} [Fri Dec 24 04:47:38 2021] GET /identity/v3/roles/admin => generated 83 bytes in 127 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:47:38.723214 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9333d9-72d1-4528-a9e4-110df83b70f0 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:38.734336 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9333d9-72d1-4528-a9e4-110df83b70f0 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:38.745064 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7371530-0587-4dc2-933d-d978ff900214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:38.746427 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7371530-0587-4dc2-933d-d978ff900214 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:38.746427 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7371530-0587-4dc2-933d-d978ff900214 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:38.746427 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7371530-0587-4dc2-933d-d978ff900214 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:38.747288 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7371530-0587-4dc2-933d-d978ff900214 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:38.747618 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7371530-0587-4dc2-933d-d978ff900214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:38.749420 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7371530-0587-4dc2-933d-d978ff900214 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:38.761541 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 397/789] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:47:38 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:38.768078 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1236d5e8-d8cb-4bb9-bf7a-0a657bf94429 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:38.781963 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1236d5e8-d8cb-4bb9-bf7a-0a657bf94429 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:38.786708 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62431f6-600e-46b4-9ebb-9053047acce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:38.787528 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62431f6-600e-46b4-9ebb-9053047acce9 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:38.787811 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62431f6-600e-46b4-9ebb-9053047acce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:38.788087 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62431f6-600e-46b4-9ebb-9053047acce9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:38.800860 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62431f6-600e-46b4-9ebb-9053047acce9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:38.802764 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62431f6-600e-46b4-9ebb-9053047acce9 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:38.820956 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-a62431f6-600e-46b4-9ebb-9053047acce9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:47:38.822657 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 393/790] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:38.828959 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7371530-0587-4dc2-933d-d978ff900214 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:38.839490 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7371530-0587-4dc2-933d-d978ff900214 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:38.840450 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87015c-e761-4a4e-9d0e-d5dd3441c2e4 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:38.840874 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87015c-e761-4a4e-9d0e-d5dd3441c2e4 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:38.841151 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87015c-e761-4a4e-9d0e-d5dd3441c2e4 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:38.843093 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 394/791] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:38.845116 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c886a3-88dc-45f6-909b-82b763966dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:38.845877 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c886a3-88dc-45f6-909b-82b763966dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:38.846164 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c886a3-88dc-45f6-909b-82b763966dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:38.846437 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c886a3-88dc-45f6-909b-82b763966dc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:38.847332 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c886a3-88dc-45f6-909b-82b763966dc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:38.847654 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c886a3-88dc-45f6-909b-82b763966dc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:38.848939 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b61a6-b404-48cb-a801-e39c1900ca15 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:38.849224 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b61a6-b404-48cb-a801-e39c1900ca15 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:38.849337 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c886a3-88dc-45f6-909b-82b763966dc1 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:38.849486 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b61a6-b404-48cb-a801-e39c1900ca15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:38.864498 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 398/792] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:47:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:38.871352 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c886a3-88dc-45f6-909b-82b763966dc1 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:38.882225 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c886a3-88dc-45f6-909b-82b763966dc1 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:38.882608 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-4d1b61a6-b404-48cb-a801-e39c1900ca15 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:38.884060 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-4d1b61a6-b404-48cb-a801-e39c1900ca15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:38.889626 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff61d68-2ad5-44dc-a91f-7b38b283b859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:38.890458 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff61d68-2ad5-44dc-a91f-7b38b283b859 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:38.890728 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff61d68-2ad5-44dc-a91f-7b38b283b859 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:38.890997 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff61d68-2ad5-44dc-a91f-7b38b283b859 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:38.895667 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 395/793] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:38 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 04:47:38.903638 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff61d68-2ad5-44dc-a91f-7b38b283b859 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:38.905796 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff61d68-2ad5-44dc-a91f-7b38b283b859 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:38.922370 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-2ff61d68-2ad5-44dc-a91f-7b38b283b859 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 24 04:47:38.923059 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b61a6-b404-48cb-a801-e39c1900ca15 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:38.923781 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 399/794] 10.222.0.43 () {56 vars in 1114 bytes} [Fri Dec 24 04:47:38 2021] GET /identity/v3/users/nova => generated 82 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:38.930966 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff61d68-2ad5-44dc-a91f-7b38b283b859 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:38.932900 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b61a6-b404-48cb-a801-e39c1900ca15 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:38.937579 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108b0cf-e6d9-4b26-ad63-23ee95fe8541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:38.938408 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108b0cf-e6d9-4b26-ad63-23ee95fe8541 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:38.938691 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108b0cf-e6d9-4b26-ad63-23ee95fe8541 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:38.938966 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108b0cf-e6d9-4b26-ad63-23ee95fe8541 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:38.939657 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108b0cf-e6d9-4b26-ad63-23ee95fe8541 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:38.941365 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108b0cf-e6d9-4b26-ad63-23ee95fe8541 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:38.941872 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff61d68-2ad5-44dc-a91f-7b38b283b859 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:38.950141 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951fe5dd-f93b-4b8e-b024-a8a62644f5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:38.950854 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951fe5dd-f93b-4b8e-b024-a8a62644f5be admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:38.951186 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951fe5dd-f93b-4b8e-b024-a8a62644f5be admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:38.951460 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951fe5dd-f93b-4b8e-b024-a8a62644f5be admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:38.952382 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951fe5dd-f93b-4b8e-b024-a8a62644f5be admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:38.952729 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951fe5dd-f93b-4b8e-b024-a8a62644f5be admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:38.954733 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951fe5dd-f93b-4b8e-b024-a8a62644f5be admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:38.956867 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-5108b0cf-e6d9-4b26-ad63-23ee95fe8541 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Dec 24 04:47:38.958306 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 396/795] 10.222.0.43 () {56 vars in 1150 bytes} [Fri Dec 24 04:47:38 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:47:38.964778 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108b0cf-e6d9-4b26-ad63-23ee95fe8541 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:38.975441 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108b0cf-e6d9-4b26-ad63-23ee95fe8541 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:38.986351 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 400/796] 10.222.0.43 () {56 vars in 1154 bytes} [Fri Dec 24 04:47:38 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:38.987011 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db432e4-b889-4aa7-9532-2f594ed98379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:38.987684 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db432e4-b889-4aa7-9532-2f594ed98379 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:38.987966 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db432e4-b889-4aa7-9532-2f594ed98379 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:38.988242 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db432e4-b889-4aa7-9532-2f594ed98379 admin admin] PATH_INFO: `/v3/services` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:38.989011 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db432e4-b889-4aa7-9532-2f594ed98379 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:38.989325 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db432e4-b889-4aa7-9532-2f594ed98379 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:38.990960 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db432e4-b889-4aa7-9532-2f594ed98379 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:38.993288 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951fe5dd-f93b-4b8e-b024-a8a62644f5be admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:38.997092 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 397/797] 10.222.0.43 () {56 vars in 1145 bytes} [Fri Dec 24 04:47:38 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:39.005768 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db432e4-b889-4aa7-9532-2f594ed98379 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:39.009098 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951fe5dd-f93b-4b8e-b024-a8a62644f5be admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:39.015657 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a37407-6879-4883-a301-5860c52b7035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:39.016315 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a37407-6879-4883-a301-5860c52b7035 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:39.016625 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a37407-6879-4883-a301-5860c52b7035 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:39.016904 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a37407-6879-4883-a301-5860c52b7035 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:39.017678 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db432e4-b889-4aa7-9532-2f594ed98379 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:39.022411 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb4ce97-4ddc-45dd-8fe4-4cb956f7bdc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:39.023327 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4ce97-4ddc-45dd-8fe4-4cb956f7bdc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:39.023614 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4ce97-4ddc-45dd-8fe4-4cb956f7bdc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:39.023943 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4ce97-4ddc-45dd-8fe4-4cb956f7bdc6 admin admin] PATH_INFO: `/v3/services` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:39.025308 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb4ce97-4ddc-45dd-8fe4-4cb956f7bdc6 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:39.025941 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb4ce97-4ddc-45dd-8fe4-4cb956f7bdc6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:39.026522 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a37407-6879-4883-a301-5860c52b7035 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:39.027714 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb4ce97-4ddc-45dd-8fe4-4cb956f7bdc6 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:39.028554 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a37407-6879-4883-a301-5860c52b7035 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:39.033802 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 398/798] 10.222.0.43 () {56 vars in 1145 bytes} [Fri Dec 24 04:47:39 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:39.039987 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb4ce97-4ddc-45dd-8fe4-4cb956f7bdc6 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:39.048913 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 401/799] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:47:38 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:47:39.054758 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a37407-6879-4883-a301-5860c52b7035 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:39.056969 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb4ce97-4ddc-45dd-8fe4-4cb956f7bdc6 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:39.062812 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c8f1e6-43ac-4aff-89d7-30ac46379d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:39.063809 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8f1e6-43ac-4aff-89d7-30ac46379d15 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:39.064144 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8f1e6-43ac-4aff-89d7-30ac46379d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:39.064477 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8f1e6-43ac-4aff-89d7-30ac46379d15 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:39.065358 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c8f1e6-43ac-4aff-89d7-30ac46379d15 admin admin] RBAC: Adding query filter params (interface=public, service_id=37fe5f3c1df44d229de163a2604a13ad, region_id=RegionOne) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:39.065528 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a37407-6879-4883-a301-5860c52b7035 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:39.065678 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c8f1e6-43ac-4aff-89d7-30ac46379d15 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:39.067653 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c8f1e6-43ac-4aff-89d7-30ac46379d15 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:39.070823 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26450cc1-f277-4566-9e59-0b2cb96096f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:39.071883 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26450cc1-f277-4566-9e59-0b2cb96096f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:39.072175 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26450cc1-f277-4566-9e59-0b2cb96096f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:39.072452 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26450cc1-f277-4566-9e59-0b2cb96096f1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:39.073656 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 399/800] 10.222.0.43 () {56 vars in 1272 bytes} [Fri Dec 24 04:47:39 2021] GET /identity/v3/endpoints?service_id=37fe5f3c1df44d229de163a2604a13ad&interface=public®ion_id=RegionOne => generated 194 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:39.079501 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c8f1e6-43ac-4aff-89d7-30ac46379d15 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:39.086567 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26450cc1-f277-4566-9e59-0b2cb96096f1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:39.088698 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26450cc1-f277-4566-9e59-0b2cb96096f1 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:39.089461 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c8f1e6-43ac-4aff-89d7-30ac46379d15 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:39.094526 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebde49d-5b31-445e-b786-b5435969a475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:39.095243 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebde49d-5b31-445e-b786-b5435969a475 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:39.095528 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebde49d-5b31-445e-b786-b5435969a475 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:39.097131 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebde49d-5b31-445e-b786-b5435969a475 admin admin] PATH_INFO: `/v3/services` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:39.097978 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebde49d-5b31-445e-b786-b5435969a475 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:39.100275 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebde49d-5b31-445e-b786-b5435969a475 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:39.110702 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-26450cc1-f277-4566-9e59-0b2cb96096f1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:47:39.112185 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 402/802] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:39.113187 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 400/802] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Dec 24 04:47:39 2021] GET /identity/v3/services => generated 772 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:39.118371 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26450cc1-f277-4566-9e59-0b2cb96096f1 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:39.129408 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26450cc1-f277-4566-9e59-0b2cb96096f1 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:39.134457 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f8569-c625-44d1-95c7-ac3e3abf7306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:39.135135 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f8569-c625-44d1-95c7-ac3e3abf7306 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:39.135415 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f8569-c625-44d1-95c7-ac3e3abf7306 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:39.135687 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f8569-c625-44d1-95c7-ac3e3abf7306 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:39.136446 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605f8569-c625-44d1-95c7-ac3e3abf7306 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:39.136796 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605f8569-c625-44d1-95c7-ac3e3abf7306 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:39.138488 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605f8569-c625-44d1-95c7-ac3e3abf7306 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:39.151755 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 403/803] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:47:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:39.157896 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebde49d-5b31-445e-b786-b5435969a475 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:39.177751 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebde49d-5b31-445e-b786-b5435969a475 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:39.194477 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be60604-6257-4880-bbeb-795bbdfeadf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:39.195285 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be60604-6257-4880-bbeb-795bbdfeadf1 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:39.195568 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be60604-6257-4880-bbeb-795bbdfeadf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:39.195842 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be60604-6257-4880-bbeb-795bbdfeadf1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:39.212082 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be60604-6257-4880-bbeb-795bbdfeadf1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:39.214126 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be60604-6257-4880-bbeb-795bbdfeadf1 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:39.231799 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-0be60604-6257-4880-bbeb-795bbdfeadf1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 24 04:47:39.236650 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 401/804] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Dec 24 04:47:39 2021] GET /identity/v3/projects/service => generated 88 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:39.239791 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f8569-c625-44d1-95c7-ac3e3abf7306 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:39.254356 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f8569-c625-44d1-95c7-ac3e3abf7306 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:39.269998 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e26ad-28f1-455b-9021-396d5bec5779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:39.271034 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e26ad-28f1-455b-9021-396d5bec5779 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:39.271521 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e26ad-28f1-455b-9021-396d5bec5779 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:39.271962 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e26ad-28f1-455b-9021-396d5bec5779 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:39.272976 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e26ad-28f1-455b-9021-396d5bec5779 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:39.273458 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e26ad-28f1-455b-9021-396d5bec5779 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:39.275631 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e26ad-28f1-455b-9021-396d5bec5779 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:39.294047 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 404/805] 10.222.0.43 () {56 vars in 1169 bytes} [Fri Dec 24 04:47:39 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:39.301170 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be60604-6257-4880-bbeb-795bbdfeadf1 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:39.318837 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be60604-6257-4880-bbeb-795bbdfeadf1 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:39.334657 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b5772b-c190-47dc-b225-b9d1d3585db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:39.335251 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5772b-c190-47dc-b225-b9d1d3585db1 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:39.335535 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5772b-c190-47dc-b225-b9d1d3585db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:39.335809 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5772b-c190-47dc-b225-b9d1d3585db1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:39.336705 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b5772b-c190-47dc-b225-b9d1d3585db1 admin admin] RBAC: Adding query filter params (role.id=d5e6fc257d8541d5a5ed1988eacd5be7, scope.project.id=c19ba4a2c0224c079c5a8a6a56569fd6, user.id=6f9ad1e8f8f74edcb44aabe17eb59648) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:39.337020 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b5772b-c190-47dc-b225-b9d1d3585db1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:39.338892 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b5772b-c190-47dc-b225-b9d1d3585db1 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:39.349803 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 402/806] 10.222.0.43 () {56 vars in 1395 bytes} [Fri Dec 24 04:47:39 2021] GET /identity/v3/role_assignments?user.id=6f9ad1e8f8f74edcb44aabe17eb59648&scope.project.id=c19ba4a2c0224c079c5a8a6a56569fd6&role.id=d5e6fc257d8541d5a5ed1988eacd5be7 => generated 608 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:40.014120 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41d7af-cee6-4022-81ad-6ce790ed70da None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:40.015047 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41d7af-cee6-4022-81ad-6ce790ed70da None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:40.015670 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41d7af-cee6-4022-81ad-6ce790ed70da None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:40.017698 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 405/807] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:40 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:40.023915 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f8e2b-db36-4d98-b38d-40b90c6b898a None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:40.024754 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f8e2b-db36-4d98-b38d-40b90c6b898a None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:40.025205 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f8e2b-db36-4d98-b38d-40b90c6b898a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:40.049809 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-c29f8e2b-db36-4d98-b38d-40b90c6b898a None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:40.051415 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-c29f8e2b-db36-4d98-b38d-40b90c6b898a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:40.065856 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 403/808] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:40 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 04:47:40.102071 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f41d7af-cee6-4022-81ad-6ce790ed70da None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:40.117216 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f41d7af-cee6-4022-81ad-6ce790ed70da None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:40.126063 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a77001-586b-423c-b476-3170dc981b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:40.127118 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a77001-586b-423c-b476-3170dc981b23 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:40.127583 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a77001-586b-423c-b476-3170dc981b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:40.128044 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a77001-586b-423c-b476-3170dc981b23 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:40.139506 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a77001-586b-423c-b476-3170dc981b23 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:47:40.153211 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-c7a77001-586b-423c-b476-3170dc981b23 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 24 04:47:40.154711 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 406/809] 10.222.0.43 () {56 vars in 1117 bytes} [Fri Dec 24 04:47:40 2021] GET /identity/v3/roles/admin => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:40.161061 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29f8e2b-db36-4d98-b38d-40b90c6b898a None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:40.170685 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29f8e2b-db36-4d98-b38d-40b90c6b898a None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:40.179509 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330001b9-1fc1-45d4-9c90-c85f0bc9eaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:40.180398 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330001b9-1fc1-45d4-9c90-c85f0bc9eaca admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:40.180916 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330001b9-1fc1-45d4-9c90-c85f0bc9eaca admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:40.181403 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330001b9-1fc1-45d4-9c90-c85f0bc9eaca admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:40.182392 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330001b9-1fc1-45d4-9c90-c85f0bc9eaca admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:40.182869 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330001b9-1fc1-45d4-9c90-c85f0bc9eaca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:40.184863 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330001b9-1fc1-45d4-9c90-c85f0bc9eaca admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:40.194475 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 404/810] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:47:40 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:40.200296 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a77001-586b-423c-b476-3170dc981b23 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:40.211125 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a77001-586b-423c-b476-3170dc981b23 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:40.219063 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac41b9-20eb-4382-b7d4-8eba9ba9cba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:40.220120 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac41b9-20eb-4382-b7d4-8eba9ba9cba2 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:40.220736 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac41b9-20eb-4382-b7d4-8eba9ba9cba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:40.221205 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac41b9-20eb-4382-b7d4-8eba9ba9cba2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:40.240549 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac41b9-20eb-4382-b7d4-8eba9ba9cba2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:40.242870 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac41b9-20eb-4382-b7d4-8eba9ba9cba2 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:40.260941 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-bdac41b9-20eb-4382-b7d4-8eba9ba9cba2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:47:40.263004 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 407/811] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:40 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:40.269042 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330001b9-1fc1-45d4-9c90-c85f0bc9eaca admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:40.279261 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330001b9-1fc1-45d4-9c90-c85f0bc9eaca admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:40.287530 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85759c2a-5c22-4eba-83a6-e099a13638d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:40.288493 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85759c2a-5c22-4eba-83a6-e099a13638d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:40.289035 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85759c2a-5c22-4eba-83a6-e099a13638d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:40.289509 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85759c2a-5c22-4eba-83a6-e099a13638d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:40.290551 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85759c2a-5c22-4eba-83a6-e099a13638d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:40.291049 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85759c2a-5c22-4eba-83a6-e099a13638d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:40.292959 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85759c2a-5c22-4eba-83a6-e099a13638d7 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:40.310371 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 405/812] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:47:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:40.324329 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac41b9-20eb-4382-b7d4-8eba9ba9cba2 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:40.335460 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac41b9-20eb-4382-b7d4-8eba9ba9cba2 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:40.344642 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce63aa2-20a8-4039-83bc-fdd8e0722922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:40.345954 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce63aa2-20a8-4039-83bc-fdd8e0722922 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:40.346446 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce63aa2-20a8-4039-83bc-fdd8e0722922 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:40.346914 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce63aa2-20a8-4039-83bc-fdd8e0722922 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:40.357205 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce63aa2-20a8-4039-83bc-fdd8e0722922 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:40.359514 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce63aa2-20a8-4039-83bc-fdd8e0722922 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:40.378917 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-bce63aa2-20a8-4039-83bc-fdd8e0722922 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 24 04:47:40.380392 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 408/813] 10.222.0.43 () {56 vars in 1117 bytes} [Fri Dec 24 04:47:40 2021] GET /identity/v3/users/swift => generated 83 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:40.386822 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85759c2a-5c22-4eba-83a6-e099a13638d7 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:40.397721 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85759c2a-5c22-4eba-83a6-e099a13638d7 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:40.405834 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e213fd-0802-4eb0-8cde-320d61a74caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:40.406721 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e213fd-0802-4eb0-8cde-320d61a74caf admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:40.407206 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e213fd-0802-4eb0-8cde-320d61a74caf admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:40.407650 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e213fd-0802-4eb0-8cde-320d61a74caf admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:40.408705 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e213fd-0802-4eb0-8cde-320d61a74caf admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:40.409184 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e213fd-0802-4eb0-8cde-320d61a74caf admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:40.411221 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e213fd-0802-4eb0-8cde-320d61a74caf admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:40.434517 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 406/814] 10.222.0.43 () {56 vars in 1156 bytes} [Fri Dec 24 04:47:40 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:40.440386 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce63aa2-20a8-4039-83bc-fdd8e0722922 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:40.450693 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce63aa2-20a8-4039-83bc-fdd8e0722922 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:40.460574 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803dd1a1-cf9f-42bc-9890-1ec333d35e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:40.461631 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803dd1a1-cf9f-42bc-9890-1ec333d35e46 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:40.462082 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803dd1a1-cf9f-42bc-9890-1ec333d35e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:40.462533 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803dd1a1-cf9f-42bc-9890-1ec333d35e46 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:40.484792 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803dd1a1-cf9f-42bc-9890-1ec333d35e46 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:40.486645 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803dd1a1-cf9f-42bc-9890-1ec333d35e46 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:40.511339 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-803dd1a1-cf9f-42bc-9890-1ec333d35e46 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:47:40.512954 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 409/815] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:40 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:40.518808 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e213fd-0802-4eb0-8cde-320d61a74caf admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:40.534501 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e213fd-0802-4eb0-8cde-320d61a74caf admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:40.548368 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557655bf-79ed-4532-94e7-6c0eaf4768d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:40.549286 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557655bf-79ed-4532-94e7-6c0eaf4768d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:40.549715 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557655bf-79ed-4532-94e7-6c0eaf4768d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:40.550127 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557655bf-79ed-4532-94e7-6c0eaf4768d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:40.551080 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557655bf-79ed-4532-94e7-6c0eaf4768d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:40.551525 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557655bf-79ed-4532-94e7-6c0eaf4768d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:40.553371 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557655bf-79ed-4532-94e7-6c0eaf4768d5 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:40.569509 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 407/816] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:47:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:40.575870 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803dd1a1-cf9f-42bc-9890-1ec333d35e46 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:40.589826 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803dd1a1-cf9f-42bc-9890-1ec333d35e46 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:40.600148 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d13d227-8a25-4ce2-a700-5b5c34d7bf2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:40.601056 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13d227-8a25-4ce2-a700-5b5c34d7bf2e admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:40.601339 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13d227-8a25-4ce2-a700-5b5c34d7bf2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:40.601642 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13d227-8a25-4ce2-a700-5b5c34d7bf2e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:40.608975 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d13d227-8a25-4ce2-a700-5b5c34d7bf2e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:40.610948 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d13d227-8a25-4ce2-a700-5b5c34d7bf2e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:40.629195 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-9d13d227-8a25-4ce2-a700-5b5c34d7bf2e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 24 04:47:40.635229 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 410/817] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Dec 24 04:47:40 2021] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:40.636488 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557655bf-79ed-4532-94e7-6c0eaf4768d5 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:40.650287 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557655bf-79ed-4532-94e7-6c0eaf4768d5 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:40.660589 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62471893-1b14-48c8-b458-2be2896ba8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:40.661530 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62471893-1b14-48c8-b458-2be2896ba8e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:40.662024 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62471893-1b14-48c8-b458-2be2896ba8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:40.662488 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62471893-1b14-48c8-b458-2be2896ba8e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:40.663498 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62471893-1b14-48c8-b458-2be2896ba8e4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:40.664015 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62471893-1b14-48c8-b458-2be2896ba8e4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:40.666159 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62471893-1b14-48c8-b458-2be2896ba8e4 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:40.685804 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 408/818] 10.222.0.43 () {56 vars in 1169 bytes} [Fri Dec 24 04:47:40 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:40.692221 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d13d227-8a25-4ce2-a700-5b5c34d7bf2e admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:40.706090 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d13d227-8a25-4ce2-a700-5b5c34d7bf2e admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:40.714597 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca3a8dc-c1cb-4ec7-8a15-0079d8d0b8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:40.715567 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3a8dc-c1cb-4ec7-8a15-0079d8d0b8a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:40.715984 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3a8dc-c1cb-4ec7-8a15-0079d8d0b8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:40.716466 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3a8dc-c1cb-4ec7-8a15-0079d8d0b8a5 admin admin] PATH_INFO: `/v3/projects/c19ba4a2c0224c079c5a8a6a56569fd6/users/218ae7d29b71487d86b11aeb380788ef/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:40.718684 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca3a8dc-c1cb-4ec7-8a15-0079d8d0b8a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c19ba4a2c0224c079c5a8a6a56569fd6, user_id=218ae7d29b71487d86b11aeb380788ef, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:40.721378 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca3a8dc-c1cb-4ec7-8a15-0079d8d0b8a5 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:40.749558 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 411/819] 10.222.0.43 () {58 vars in 1460 bytes} [Fri Dec 24 04:47:40 2021] PUT /identity/v3/projects/c19ba4a2c0224c079c5a8a6a56569fd6/users/218ae7d29b71487d86b11aeb380788ef/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:47:41.606122 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc976564-442a-44d6-b773-fee33fd6719d None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:41.607312 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc976564-442a-44d6-b773-fee33fd6719d None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:41.607814 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc976564-442a-44d6-b773-fee33fd6719d None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:41.609854 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 409/820] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:41 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:41.616630 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6277dfb-5377-4871-8e81-f54535fbd5b1 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:41.617471 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6277dfb-5377-4871-8e81-f54535fbd5b1 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:41.618095 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6277dfb-5377-4871-8e81-f54535fbd5b1 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:41.620290 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 412/821] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:41 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:41.621958 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963d305-cb37-4de2-b7b7-635df91a606c None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:41.622458 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963d305-cb37-4de2-b7b7-635df91a606c None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:41.622933 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963d305-cb37-4de2-b7b7-635df91a606c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:41.647010 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-5963d305-cb37-4de2-b7b7-635df91a606c None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:41.647605 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d6fa8-d52a-4a06-866b-4375296646b8 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:41.647898 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d6fa8-d52a-4a06-866b-4375296646b8 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:41.648177 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d6fa8-d52a-4a06-866b-4375296646b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:41.649257 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-5963d305-cb37-4de2-b7b7-635df91a606c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:41.673843 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-d95d6fa8-d52a-4a06-866b-4375296646b8 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:41.673843 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-d95d6fa8-d52a-4a06-866b-4375296646b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:41.756931 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 410/822] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:41 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:47:41.784900 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 413/823] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:41 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:47:41.797071 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963d305-cb37-4de2-b7b7-635df91a606c None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:41.810855 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963d305-cb37-4de2-b7b7-635df91a606c None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:41.813130 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d6fa8-d52a-4a06-866b-4375296646b8 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:41.818014 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b6145-9c64-42d0-88e5-c6cebe605a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:41.818811 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b6145-9c64-42d0-88e5-c6cebe605a0d admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:41.819089 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b6145-9c64-42d0-88e5-c6cebe605a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:41.819358 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b6145-9c64-42d0-88e5-c6cebe605a0d admin admin] PATH_INFO: `/v3/services/network` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:41.820037 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752b6145-9c64-42d0-88e5-c6cebe605a0d admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:41.821677 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752b6145-9c64-42d0-88e5-c6cebe605a0d admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:41.822854 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d6fa8-d52a-4a06-866b-4375296646b8 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:41.832231 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883e6c6-4c2a-4e12-ae7d-31bfcc70b027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:41.833094 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883e6c6-4c2a-4e12-ae7d-31bfcc70b027 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:41.833373 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883e6c6-4c2a-4e12-ae7d-31bfcc70b027 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:41.833648 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883e6c6-4c2a-4e12-ae7d-31bfcc70b027 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:41.846929 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-752b6145-9c64-42d0-88e5-c6cebe605a0d admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Dec 24 04:47:41.848585 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 411/824] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Dec 24 04:47:41 2021] GET /identity/v3/services/network => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:41.853402 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c883e6c6-4c2a-4e12-ae7d-31bfcc70b027 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:47:41.858170 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b6145-9c64-42d0-88e5-c6cebe605a0d admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:41.867628 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-c883e6c6-4c2a-4e12-ae7d-31bfcc70b027 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 24 04:47:41.869814 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 414/825] 10.222.0.43 () {56 vars in 1123 bytes} [Fri Dec 24 04:47:41 2021] GET /identity/v3/roles/service => generated 85 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:41.877391 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b6145-9c64-42d0-88e5-c6cebe605a0d admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:41.880099 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883e6c6-4c2a-4e12-ae7d-31bfcc70b027 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:41.886507 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e346a-7211-48c5-ba3d-b4019c26a762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:41.887974 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e346a-7211-48c5-ba3d-b4019c26a762 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:41.888547 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e346a-7211-48c5-ba3d-b4019c26a762 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:41.888880 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e346a-7211-48c5-ba3d-b4019c26a762 admin admin] PATH_INFO: `/v3/services` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:41.889674 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7e346a-7211-48c5-ba3d-b4019c26a762 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:41.889981 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7e346a-7211-48c5-ba3d-b4019c26a762 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:41.890497 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883e6c6-4c2a-4e12-ae7d-31bfcc70b027 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:41.891651 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7e346a-7211-48c5-ba3d-b4019c26a762 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:41.895006 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4818ecb-adcc-4b53-b394-1b991504d747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:41.895670 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4818ecb-adcc-4b53-b394-1b991504d747 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:41.895955 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4818ecb-adcc-4b53-b394-1b991504d747 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:41.896234 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4818ecb-adcc-4b53-b394-1b991504d747 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:41.897050 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4818ecb-adcc-4b53-b394-1b991504d747 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:41.897359 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4818ecb-adcc-4b53-b394-1b991504d747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:41.898956 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4818ecb-adcc-4b53-b394-1b991504d747 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:41.908125 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 412/826] 10.222.0.43 () {56 vars in 1133 bytes} [Fri Dec 24 04:47:41 2021] GET /identity/v3/services?name=network => generated 124 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:41.911138 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 415/827] 10.222.0.43 () {56 vars in 1124 bytes} [Fri Dec 24 04:47:41 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:41.912984 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e346a-7211-48c5-ba3d-b4019c26a762 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:41.916926 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4818ecb-adcc-4b53-b394-1b991504d747 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:41.929026 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e346a-7211-48c5-ba3d-b4019c26a762 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:41.935675 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4818ecb-adcc-4b53-b394-1b991504d747 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:41.937880 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d30fcc8-8ac5-4f6d-a0fa-2b619ce1c1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:41.938941 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30fcc8-8ac5-4f6d-a0fa-2b619ce1c1e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:41.939226 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30fcc8-8ac5-4f6d-a0fa-2b619ce1c1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:41.939502 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30fcc8-8ac5-4f6d-a0fa-2b619ce1c1e8 admin admin] PATH_INFO: `/v3/services` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:41.942871 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d30fcc8-8ac5-4f6d-a0fa-2b619ce1c1e8 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:41.943201 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d30fcc8-8ac5-4f6d-a0fa-2b619ce1c1e8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:41.944925 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f57a779-5a80-496b-b71d-fb268d9f200f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:41.945705 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57a779-5a80-496b-b71d-fb268d9f200f admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:41.946890 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d30fcc8-8ac5-4f6d-a0fa-2b619ce1c1e8 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:41.947382 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57a779-5a80-496b-b71d-fb268d9f200f admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:41.947663 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57a779-5a80-496b-b71d-fb268d9f200f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:41.958028 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 413/828] 10.222.0.43 () {56 vars in 1133 bytes} [Fri Dec 24 04:47:41 2021] GET /identity/v3/services?type=network => generated 350 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:41.964307 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d30fcc8-8ac5-4f6d-a0fa-2b619ce1c1e8 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:41.970069 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f57a779-5a80-496b-b71d-fb268d9f200f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:41.971927 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f57a779-5a80-496b-b71d-fb268d9f200f admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:41.983622 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d30fcc8-8ac5-4f6d-a0fa-2b619ce1c1e8 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:41.988702 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705c6b5-18be-4c14-afe4-02230edc0296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:41.994879 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705c6b5-18be-4c14-afe4-02230edc0296 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:41.994879 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705c6b5-18be-4c14-afe4-02230edc0296 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:41.994879 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705c6b5-18be-4c14-afe4-02230edc0296 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:41.994879 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8705c6b5-18be-4c14-afe4-02230edc0296 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:41.994879 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING py.warnings [None req-8705c6b5-18be-4c14-afe4-02230edc0296 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:47:41.994879 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: warnings.warn(msg) Dec 24 04:47:41.994879 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: Dec 24 04:47:41.995943 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8705c6b5-18be-4c14-afe4-02230edc0296 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:41.999736 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-8f57a779-5a80-496b-b71d-fb268d9f200f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:47:42.001576 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 416/829] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:42.006940 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f57a779-5a80-496b-b71d-fb268d9f200f admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:42.017838 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f57a779-5a80-496b-b71d-fb268d9f200f admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:42.024435 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6ba8d-b3e2-454a-a306-793fd56efb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:42.026275 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6ba8d-b3e2-454a-a306-793fd56efb13 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:42.026669 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6ba8d-b3e2-454a-a306-793fd56efb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:42.027111 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6ba8d-b3e2-454a-a306-793fd56efb13 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:42.028090 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff6ba8d-b3e2-454a-a306-793fd56efb13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:42.028479 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff6ba8d-b3e2-454a-a306-793fd56efb13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:42.030293 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff6ba8d-b3e2-454a-a306-793fd56efb13 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:42.044468 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 417/830] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:47:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:42.046770 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 414/831] 10.222.0.43 () {60 vars in 1165 bytes} [Fri Dec 24 04:47:41 2021] POST /identity/v3/endpoints => generated 327 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 04:47:42.050446 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6ba8d-b3e2-454a-a306-793fd56efb13 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:42.061619 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6ba8d-b3e2-454a-a306-793fd56efb13 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:42.087024 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf32d2-7ba8-4f76-a679-34fc4f3d49d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:42.087955 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf32d2-7ba8-4f76-a679-34fc4f3d49d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:42.088238 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf32d2-7ba8-4f76-a679-34fc4f3d49d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:42.088513 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf32d2-7ba8-4f76-a679-34fc4f3d49d8 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:42.099586 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cf32d2-7ba8-4f76-a679-34fc4f3d49d8 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:42.101771 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cf32d2-7ba8-4f76-a679-34fc4f3d49d8 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:42.124067 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-d1cf32d2-7ba8-4f76-a679-34fc4f3d49d8 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 24 04:47:42.124258 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceea831-2653-439e-82f8-e1177ed84b1e None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:42.124342 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceea831-2653-439e-82f8-e1177ed84b1e None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:42.124613 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceea831-2653-439e-82f8-e1177ed84b1e None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:42.125793 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 418/832] 10.222.0.43 () {56 vars in 1138 bytes} [Fri Dec 24 04:47:42 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:42.128638 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 415/833] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:42 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:42.131919 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf32d2-7ba8-4f76-a679-34fc4f3d49d8 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:42.133661 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ca281-cff8-4431-888f-042aa99ebedf None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:42.133958 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ca281-cff8-4431-888f-042aa99ebedf None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:42.134240 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ca281-cff8-4431-888f-042aa99ebedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:42.142907 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf32d2-7ba8-4f76-a679-34fc4f3d49d8 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:42.152979 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea2682-ef84-4ace-b60d-e588d007bc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:42.153858 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea2682-ef84-4ace-b60d-e588d007bc0e admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:42.154191 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea2682-ef84-4ace-b60d-e588d007bc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:42.154468 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea2682-ef84-4ace-b60d-e588d007bc0e admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:42.155341 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ea2682-ef84-4ace-b60d-e588d007bc0e admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:42.155649 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ea2682-ef84-4ace-b60d-e588d007bc0e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:42.160419 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ea2682-ef84-4ace-b60d-e588d007bc0e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:42.172124 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-236ca281-cff8-4431-888f-042aa99ebedf None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:42.173392 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-236ca281-cff8-4431-888f-042aa99ebedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:42.190107 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 419/834] 10.222.0.43 () {56 vars in 1170 bytes} [Fri Dec 24 04:47:42 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:42.191777 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 416/835] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:42 2021] POST /identity/v3/auth/tokens => generated 1266 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 04:47:42.196093 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea2682-ef84-4ace-b60d-e588d007bc0e admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:42.206632 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea2682-ef84-4ace-b60d-e588d007bc0e admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:42.217132 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4a618-e9b1-45c9-9c13-82efb0e6e6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:42.217854 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4a618-e9b1-45c9-9c13-82efb0e6e6a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:42.218135 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4a618-e9b1-45c9-9c13-82efb0e6e6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:42.218449 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4a618-e9b1-45c9-9c13-82efb0e6e6a5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:42.227584 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf4a618-e9b1-45c9-9c13-82efb0e6e6a5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:42.229463 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf4a618-e9b1-45c9-9c13-82efb0e6e6a5 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:42.246215 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 420/836] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:47:42 2021] GET /identity/v3/auth/tokens => generated 1266 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 24 04:47:42.254925 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ca281-cff8-4431-888f-042aa99ebedf None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:42.255771 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4a618-e9b1-45c9-9c13-82efb0e6e6a5 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:42.265284 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ca281-cff8-4431-888f-042aa99ebedf None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:42.265609 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4a618-e9b1-45c9-9c13-82efb0e6e6a5 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:42.279638 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a54bad-6300-4d7e-a863-734e6bb4d919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:42.280817 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e3e22-1112-452e-b378-66184bdbbed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:42.281895 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a54bad-6300-4d7e-a863-734e6bb4d919 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:42.282180 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a54bad-6300-4d7e-a863-734e6bb4d919 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:42.282782 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e3e22-1112-452e-b378-66184bdbbed6 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:42.283057 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e3e22-1112-452e-b378-66184bdbbed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:42.283329 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e3e22-1112-452e-b378-66184bdbbed6 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:42.283722 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a54bad-6300-4d7e-a863-734e6bb4d919 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:42.285258 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69e3e22-1112-452e-b378-66184bdbbed6 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:42.291279 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69e3e22-1112-452e-b378-66184bdbbed6 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:42.311749 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a54bad-6300-4d7e-a863-734e6bb4d919 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:42.315027 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a54bad-6300-4d7e-a863-734e6bb4d919 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:42.318858 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-c69e3e22-1112-452e-b378-66184bdbbed6 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Dec 24 04:47:42.323461 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 421/837] 10.222.0.43 () {56 vars in 1150 bytes} [Fri Dec 24 04:47:42 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:47:42.329086 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e3e22-1112-452e-b378-66184bdbbed6 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:42.344720 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e3e22-1112-452e-b378-66184bdbbed6 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:42.348232 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-84a54bad-6300-4d7e-a863-734e6bb4d919 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:47:42.353589 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8698783e-935f-48fe-a5d0-6cbae76c906c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:42.354631 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 417/838] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:42.355447 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698783e-935f-48fe-a5d0-6cbae76c906c admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:42.355733 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698783e-935f-48fe-a5d0-6cbae76c906c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:42.356096 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698783e-935f-48fe-a5d0-6cbae76c906c admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:42.356864 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a54bad-6300-4d7e-a863-734e6bb4d919 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:42.358071 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8698783e-935f-48fe-a5d0-6cbae76c906c admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:42.358382 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8698783e-935f-48fe-a5d0-6cbae76c906c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:42.360571 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8698783e-935f-48fe-a5d0-6cbae76c906c admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:42.367259 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 422/839] 10.222.0.43 () {56 vars in 1145 bytes} [Fri Dec 24 04:47:42 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:42.373252 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8698783e-935f-48fe-a5d0-6cbae76c906c admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:42.376618 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a54bad-6300-4d7e-a863-734e6bb4d919 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:42.382106 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a5ffec-1b84-44da-9231-facd02ebd120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:42.382782 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a5ffec-1b84-44da-9231-facd02ebd120 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:42.383060 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a5ffec-1b84-44da-9231-facd02ebd120 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:42.383335 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a5ffec-1b84-44da-9231-facd02ebd120 admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:42.384093 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a5ffec-1b84-44da-9231-facd02ebd120 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:42.384402 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a5ffec-1b84-44da-9231-facd02ebd120 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:42.384858 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8698783e-935f-48fe-a5d0-6cbae76c906c admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:42.386265 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a5ffec-1b84-44da-9231-facd02ebd120 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:42.390564 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac86fd-e7ca-40bf-b42c-76df6578e31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:42.391224 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac86fd-e7ca-40bf-b42c-76df6578e31e admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:42.391557 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac86fd-e7ca-40bf-b42c-76df6578e31e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:42.391828 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac86fd-e7ca-40bf-b42c-76df6578e31e admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:42.392639 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac86fd-e7ca-40bf-b42c-76df6578e31e admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:42.392942 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac86fd-e7ca-40bf-b42c-76df6578e31e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:42.394571 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac86fd-e7ca-40bf-b42c-76df6578e31e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:42.400474 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 418/840] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:47:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:42.401164 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 423/841] 10.222.0.43 () {56 vars in 1145 bytes} [Fri Dec 24 04:47:42 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:42.409835 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a5ffec-1b84-44da-9231-facd02ebd120 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:42.411133 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac86fd-e7ca-40bf-b42c-76df6578e31e admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:42.422438 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac86fd-e7ca-40bf-b42c-76df6578e31e admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:42.426511 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a5ffec-1b84-44da-9231-facd02ebd120 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:42.431410 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e10bbd-ad85-4c4e-9084-121b2cea596f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:42.431617 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59747fd-ae05-4507-a097-c66a29c6d5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:42.432071 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e10bbd-ad85-4c4e-9084-121b2cea596f admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:42.432283 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59747fd-ae05-4507-a097-c66a29c6d5b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:42.432448 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e10bbd-ad85-4c4e-9084-121b2cea596f admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:42.432614 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59747fd-ae05-4507-a097-c66a29c6d5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:42.432762 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e10bbd-ad85-4c4e-9084-121b2cea596f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:42.432901 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59747fd-ae05-4507-a097-c66a29c6d5b7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:42.435398 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e10bbd-ad85-4c4e-9084-121b2cea596f admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:42.437091 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e10bbd-ad85-4c4e-9084-121b2cea596f admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:42.440928 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59747fd-ae05-4507-a097-c66a29c6d5b7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:42.443792 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59747fd-ae05-4507-a097-c66a29c6d5b7 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:42.461116 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-c59747fd-ae05-4507-a097-c66a29c6d5b7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 24 04:47:42.462335 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 424/842] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Dec 24 04:47:42 2021] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:42.468349 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 419/843] 10.222.0.43 () {60 vars in 1165 bytes} [Fri Dec 24 04:47:42 2021] POST /identity/v3/endpoints => generated 346 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:47:42.469836 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59747fd-ae05-4507-a097-c66a29c6d5b7 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:42.480070 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59747fd-ae05-4507-a097-c66a29c6d5b7 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:42.496247 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c326c0df-fbcd-4e07-8509-8a45be0803c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:42.496988 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326c0df-fbcd-4e07-8509-8a45be0803c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:42.497354 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326c0df-fbcd-4e07-8509-8a45be0803c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:42.497631 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326c0df-fbcd-4e07-8509-8a45be0803c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:42.498491 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c326c0df-fbcd-4e07-8509-8a45be0803c1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:42.498798 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c326c0df-fbcd-4e07-8509-8a45be0803c1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:42.500836 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c326c0df-fbcd-4e07-8509-8a45be0803c1 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:42.514677 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 425/844] 10.222.0.43 () {56 vars in 1169 bytes} [Fri Dec 24 04:47:42 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:42.521373 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e10bbd-ad85-4c4e-9084-121b2cea596f admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:42.533335 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e10bbd-ad85-4c4e-9084-121b2cea596f admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:42.538525 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b29808-b9ae-4f48-9727-285320a94025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:42.539585 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b29808-b9ae-4f48-9727-285320a94025 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:42.540071 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b29808-b9ae-4f48-9727-285320a94025 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:42.540617 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b29808-b9ae-4f48-9727-285320a94025 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:42.541711 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b29808-b9ae-4f48-9727-285320a94025 admin admin] RBAC: Adding query filter params (role.id=81b14dd0538e44b4bfa9bb906718914a, scope.project.id=c19ba4a2c0224c079c5a8a6a56569fd6, user.id=3d0ee2c830754741b0f9eedabf6bded8) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:42.542228 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b29808-b9ae-4f48-9727-285320a94025 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:42.544487 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b29808-b9ae-4f48-9727-285320a94025 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:42.556682 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 420/845] 10.222.0.43 () {56 vars in 1395 bytes} [Fri Dec 24 04:47:42 2021] GET /identity/v3/role_assignments?user.id=3d0ee2c830754741b0f9eedabf6bded8&scope.project.id=c19ba4a2c0224c079c5a8a6a56569fd6&role.id=81b14dd0538e44b4bfa9bb906718914a => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:42.561580 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a8e57-2d40-41ba-a22e-80d57b20a3ee None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:42.561892 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a8e57-2d40-41ba-a22e-80d57b20a3ee None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:42.562135 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a8e57-2d40-41ba-a22e-80d57b20a3ee None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:42.564356 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 426/846] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:42.570940 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8a06c-9783-4e3f-a00d-7b1851839d1d None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:42.571279 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8a06c-9783-4e3f-a00d-7b1851839d1d None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:42.571498 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8a06c-9783-4e3f-a00d-7b1851839d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:42.592620 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-dca8a06c-9783-4e3f-a00d-7b1851839d1d None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:42.593875 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-dca8a06c-9783-4e3f-a00d-7b1851839d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:42.602263 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 421/847] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:42 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:47:42.627349 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a8e57-2d40-41ba-a22e-80d57b20a3ee None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:42.641406 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a8e57-2d40-41ba-a22e-80d57b20a3ee None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:42.646232 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5554b06e-3f9e-4e76-b2ba-786c014030d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:42.647136 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5554b06e-3f9e-4e76-b2ba-786c014030d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:42.647427 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5554b06e-3f9e-4e76-b2ba-786c014030d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:42.647706 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5554b06e-3f9e-4e76-b2ba-786c014030d4 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:42.648463 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5554b06e-3f9e-4e76-b2ba-786c014030d4 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:42.650253 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5554b06e-3f9e-4e76-b2ba-786c014030d4 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:42.663287 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-5554b06e-3f9e-4e76-b2ba-786c014030d4 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Dec 24 04:47:42.668838 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 427/848] 10.222.0.43 () {56 vars in 1153 bytes} [Fri Dec 24 04:47:42 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:42.672019 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8a06c-9783-4e3f-a00d-7b1851839d1d None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:42.682030 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8a06c-9783-4e3f-a00d-7b1851839d1d None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:42.686975 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b453c021-331c-4ba1-b86d-ccbdfe954069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:42.687804 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453c021-331c-4ba1-b86d-ccbdfe954069 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:42.688092 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453c021-331c-4ba1-b86d-ccbdfe954069 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:42.688367 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453c021-331c-4ba1-b86d-ccbdfe954069 admin admin] PATH_INFO: `/v3/services` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:42.689223 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b453c021-331c-4ba1-b86d-ccbdfe954069 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:42.689540 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b453c021-331c-4ba1-b86d-ccbdfe954069 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:42.691298 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b453c021-331c-4ba1-b86d-ccbdfe954069 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:42.697060 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 422/849] 10.222.0.43 () {56 vars in 1147 bytes} [Fri Dec 24 04:47:42 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:42.703417 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5554b06e-3f9e-4e76-b2ba-786c014030d4 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:42.714340 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5554b06e-3f9e-4e76-b2ba-786c014030d4 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:42.719209 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9fd17-d8ad-4f4c-b9f1-ad956ce1a6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:42.719900 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9fd17-d8ad-4f4c-b9f1-ad956ce1a6bd admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:42.720181 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9fd17-d8ad-4f4c-b9f1-ad956ce1a6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:42.720455 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9fd17-d8ad-4f4c-b9f1-ad956ce1a6bd admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:42.721234 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e9fd17-d8ad-4f4c-b9f1-ad956ce1a6bd admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:42.721540 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e9fd17-d8ad-4f4c-b9f1-ad956ce1a6bd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:42.723150 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e9fd17-d8ad-4f4c-b9f1-ad956ce1a6bd admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:42.728480 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 428/850] 10.222.0.43 () {56 vars in 1147 bytes} [Fri Dec 24 04:47:42 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:43.609507 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133be402-2fec-49d2-8712-9eb2928ccd21 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:43.609845 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133be402-2fec-49d2-8712-9eb2928ccd21 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:43.610029 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133be402-2fec-49d2-8712-9eb2928ccd21 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:43.612163 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 423/851] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:43.618161 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d1e4b-ee08-4bde-9190-0f311a9e8f53 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:43.618453 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d1e4b-ee08-4bde-9190-0f311a9e8f53 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:43.618734 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d1e4b-ee08-4bde-9190-0f311a9e8f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:43.637052 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-1b8d1e4b-ee08-4bde-9190-0f311a9e8f53 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:43.638263 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-1b8d1e4b-ee08-4bde-9190-0f311a9e8f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:43.646280 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 429/852] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:43 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:47:43.671191 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133be402-2fec-49d2-8712-9eb2928ccd21 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:43.683938 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133be402-2fec-49d2-8712-9eb2928ccd21 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:43.688717 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506525e8-9e39-438e-8330-41c4cf71a7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:43.689514 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506525e8-9e39-438e-8330-41c4cf71a7b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:43.689795 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506525e8-9e39-438e-8330-41c4cf71a7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:43.690066 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506525e8-9e39-438e-8330-41c4cf71a7b0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:43.700892 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506525e8-9e39-438e-8330-41c4cf71a7b0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:47:43.707703 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-506525e8-9e39-438e-8330-41c4cf71a7b0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 24 04:47:43.709530 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 424/853] 10.222.0.43 () {56 vars in 1117 bytes} [Fri Dec 24 04:47:43 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:43.715941 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d1e4b-ee08-4bde-9190-0f311a9e8f53 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:43.727619 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d1e4b-ee08-4bde-9190-0f311a9e8f53 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:43.733069 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a2d4f9-4931-40e3-854f-f06e54dc253f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:43.733807 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a2d4f9-4931-40e3-854f-f06e54dc253f admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:43.734150 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a2d4f9-4931-40e3-854f-f06e54dc253f admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:43.734484 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a2d4f9-4931-40e3-854f-f06e54dc253f admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:43.735317 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a2d4f9-4931-40e3-854f-f06e54dc253f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:43.735678 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a2d4f9-4931-40e3-854f-f06e54dc253f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:43.737498 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a2d4f9-4931-40e3-854f-f06e54dc253f admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:43.747205 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 430/854] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:47:43 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:43.754333 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506525e8-9e39-438e-8330-41c4cf71a7b0 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:43.765585 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506525e8-9e39-438e-8330-41c4cf71a7b0 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:43.771875 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9445e4b-12f4-46a2-87c2-84e4b9aea512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:43.773024 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9445e4b-12f4-46a2-87c2-84e4b9aea512 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:43.773504 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9445e4b-12f4-46a2-87c2-84e4b9aea512 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:43.774005 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9445e4b-12f4-46a2-87c2-84e4b9aea512 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:43.785557 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9445e4b-12f4-46a2-87c2-84e4b9aea512 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:43.787740 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9445e4b-12f4-46a2-87c2-84e4b9aea512 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:43.805526 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-b9445e4b-12f4-46a2-87c2-84e4b9aea512 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:47:43.807322 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 425/855] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:43.813765 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a2d4f9-4931-40e3-854f-f06e54dc253f admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:43.824241 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a2d4f9-4931-40e3-854f-f06e54dc253f admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:43.829585 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc89b449-9112-4585-b17a-e868cb7100bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:43.830673 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89b449-9112-4585-b17a-e868cb7100bc admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:43.831441 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89b449-9112-4585-b17a-e868cb7100bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:43.832122 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89b449-9112-4585-b17a-e868cb7100bc admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:43.833151 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc89b449-9112-4585-b17a-e868cb7100bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:43.833669 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc89b449-9112-4585-b17a-e868cb7100bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:43.835855 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc89b449-9112-4585-b17a-e868cb7100bc admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:43.849776 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 431/856] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:47:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:43.856142 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9445e4b-12f4-46a2-87c2-84e4b9aea512 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:43.866467 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9445e4b-12f4-46a2-87c2-84e4b9aea512 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:43.871273 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4712fe6e-155d-4345-b187-d30c565f5a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:43.872409 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712fe6e-155d-4345-b187-d30c565f5a73 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:43.873077 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712fe6e-155d-4345-b187-d30c565f5a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:43.873545 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712fe6e-155d-4345-b187-d30c565f5a73 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:43.881528 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4712fe6e-155d-4345-b187-d30c565f5a73 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:43.884000 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4712fe6e-155d-4345-b187-d30c565f5a73 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:43.900765 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-4712fe6e-155d-4345-b187-d30c565f5a73 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 24 04:47:43.902672 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 426/857] 10.222.0.43 () {56 vars in 1117 bytes} [Fri Dec 24 04:47:43 2021] GET /identity/v3/users/swift => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:43.909165 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc89b449-9112-4585-b17a-e868cb7100bc admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:43.919639 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc89b449-9112-4585-b17a-e868cb7100bc admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:43.924630 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33be9b1-e1fc-4a9c-8c4e-45d3047dcba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:43.925573 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33be9b1-e1fc-4a9c-8c4e-45d3047dcba0 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:43.926091 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33be9b1-e1fc-4a9c-8c4e-45d3047dcba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:43.926557 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33be9b1-e1fc-4a9c-8c4e-45d3047dcba0 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:43.927653 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33be9b1-e1fc-4a9c-8c4e-45d3047dcba0 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:43.928163 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33be9b1-e1fc-4a9c-8c4e-45d3047dcba0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:43.930236 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33be9b1-e1fc-4a9c-8c4e-45d3047dcba0 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:43.949780 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 432/858] 10.222.0.43 () {56 vars in 1156 bytes} [Fri Dec 24 04:47:43 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:43.957832 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4712fe6e-155d-4345-b187-d30c565f5a73 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:43.968615 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4712fe6e-155d-4345-b187-d30c565f5a73 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:43.973432 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc50311-d4da-4ffb-9d71-164841cf5a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:43.974422 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc50311-d4da-4ffb-9d71-164841cf5a3a admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:43.974898 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc50311-d4da-4ffb-9d71-164841cf5a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:43.975374 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc50311-d4da-4ffb-9d71-164841cf5a3a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:43.984374 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc50311-d4da-4ffb-9d71-164841cf5a3a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:43.986541 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc50311-d4da-4ffb-9d71-164841cf5a3a admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:43.996081 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 427/859] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:47:43 2021] GET /identity/v3/auth/tokens => generated 1452 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:47:44.002782 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33be9b1-e1fc-4a9c-8c4e-45d3047dcba0 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:44.013024 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33be9b1-e1fc-4a9c-8c4e-45d3047dcba0 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:44.017959 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf54e59-0849-40dd-8d27-a1dbded2b166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:44.019009 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf54e59-0849-40dd-8d27-a1dbded2b166 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:44.019509 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf54e59-0849-40dd-8d27-a1dbded2b166 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:44.019987 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf54e59-0849-40dd-8d27-a1dbded2b166 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:44.030627 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf54e59-0849-40dd-8d27-a1dbded2b166 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:44.033015 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf54e59-0849-40dd-8d27-a1dbded2b166 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:44.050261 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-2cf54e59-0849-40dd-8d27-a1dbded2b166 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:47:44.052080 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 433/860] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:44.058334 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc50311-d4da-4ffb-9d71-164841cf5a3a admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:44.067626 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc50311-d4da-4ffb-9d71-164841cf5a3a admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:44.072426 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf2dcb-34ef-441e-be59-be3c5e390594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:44.073359 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf2dcb-34ef-441e-be59-be3c5e390594 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:44.073836 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf2dcb-34ef-441e-be59-be3c5e390594 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:44.074302 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf2dcb-34ef-441e-be59-be3c5e390594 admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:44.075448 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaf2dcb-34ef-441e-be59-be3c5e390594 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:44.075947 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaf2dcb-34ef-441e-be59-be3c5e390594 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:44.077785 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaf2dcb-34ef-441e-be59-be3c5e390594 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:44.090190 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 428/861] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:47:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:44.096572 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf54e59-0849-40dd-8d27-a1dbded2b166 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:44.107032 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf54e59-0849-40dd-8d27-a1dbded2b166 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:44.111945 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af1cd9-ddfd-4350-8542-17d09ccfda6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:44.113123 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af1cd9-ddfd-4350-8542-17d09ccfda6f admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:44.113636 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af1cd9-ddfd-4350-8542-17d09ccfda6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:44.114098 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af1cd9-ddfd-4350-8542-17d09ccfda6f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:44.121877 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af1cd9-ddfd-4350-8542-17d09ccfda6f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:44.124064 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af1cd9-ddfd-4350-8542-17d09ccfda6f admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:44.138021 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-14af1cd9-ddfd-4350-8542-17d09ccfda6f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 24 04:47:44.139800 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 434/862] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Dec 24 04:47:44 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:44.146284 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf2dcb-34ef-441e-be59-be3c5e390594 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:44.156422 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf2dcb-34ef-441e-be59-be3c5e390594 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:44.161137 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1242486-ee38-4fef-b616-71d53ee58163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:44.162025 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1242486-ee38-4fef-b616-71d53ee58163 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:44.162503 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1242486-ee38-4fef-b616-71d53ee58163 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:44.162970 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1242486-ee38-4fef-b616-71d53ee58163 admin admin] PATH_INFO: `/v3/projects` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:44.164042 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1242486-ee38-4fef-b616-71d53ee58163 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:44.164618 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1242486-ee38-4fef-b616-71d53ee58163 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:44.166691 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1242486-ee38-4fef-b616-71d53ee58163 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:44.179507 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 429/863] 10.222.0.43 () {56 vars in 1169 bytes} [Fri Dec 24 04:47:44 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:44.186131 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af1cd9-ddfd-4350-8542-17d09ccfda6f admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:44.202669 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af1cd9-ddfd-4350-8542-17d09ccfda6f admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:44.213165 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d219e4-05d8-4583-91d4-83f35287dc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:44.213815 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d219e4-05d8-4583-91d4-83f35287dc99 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:44.214092 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d219e4-05d8-4583-91d4-83f35287dc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:44.214362 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d219e4-05d8-4583-91d4-83f35287dc99 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:44.215204 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d219e4-05d8-4583-91d4-83f35287dc99 admin admin] RBAC: Adding query filter params (role.id=d5e6fc257d8541d5a5ed1988eacd5be7, scope.project.id=c19ba4a2c0224c079c5a8a6a56569fd6, user.id=218ae7d29b71487d86b11aeb380788ef) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:44.215727 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d219e4-05d8-4583-91d4-83f35287dc99 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:44.217860 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d219e4-05d8-4583-91d4-83f35287dc99 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:44.224369 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 435/864] 10.222.0.43 () {56 vars in 1395 bytes} [Fri Dec 24 04:47:44 2021] GET /identity/v3/role_assignments?user.id=218ae7d29b71487d86b11aeb380788ef&scope.project.id=c19ba4a2c0224c079c5a8a6a56569fd6&role.id=d5e6fc257d8541d5a5ed1988eacd5be7 => generated 608 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:44.956781 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf407b-3489-48a1-b884-a70177a9714b None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:44.957304 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf407b-3489-48a1-b884-a70177a9714b None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:44.957304 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf407b-3489-48a1-b884-a70177a9714b None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:44.959599 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 430/865] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:44.967743 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a994f7e-18dd-4d9d-84b8-0c954d1d1eda None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:44.967743 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a994f7e-18dd-4d9d-84b8-0c954d1d1eda None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:44.967743 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a994f7e-18dd-4d9d-84b8-0c954d1d1eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:44.985475 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-9a994f7e-18dd-4d9d-84b8-0c954d1d1eda None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:44.987027 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-9a994f7e-18dd-4d9d-84b8-0c954d1d1eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:45.000626 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 436/866] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:44 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:47:45.019504 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf407b-3489-48a1-b884-a70177a9714b None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:45.032422 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf407b-3489-48a1-b884-a70177a9714b None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:45.037182 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc90cf2f-59de-4ac9-9e2e-237adb6718b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:45.038222 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90cf2f-59de-4ac9-9e2e-237adb6718b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:45.038715 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90cf2f-59de-4ac9-9e2e-237adb6718b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:45.039186 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90cf2f-59de-4ac9-9e2e-237adb6718b9 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:45.040081 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc90cf2f-59de-4ac9-9e2e-237adb6718b9 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:45.041941 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc90cf2f-59de-4ac9-9e2e-237adb6718b9 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:45.051604 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b85b0-5292-42dd-95bd-40e670c96ea4 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:45.051890 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b85b0-5292-42dd-95bd-40e670c96ea4 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:45.052166 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b85b0-5292-42dd-95bd-40e670c96ea4 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:45.054243 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 437/867] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 24 04:47:45.055055 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-bc90cf2f-59de-4ac9-9e2e-237adb6718b9 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Dec 24 04:47:45.059953 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 431/868] 10.222.0.43 () {56 vars in 1135 bytes} [Fri Dec 24 04:47:45 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:45.061641 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cbf34a-a7a5-4076-8079-04832db0e1e4 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:45.061925 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cbf34a-a7a5-4076-8079-04832db0e1e4 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:45.062197 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cbf34a-a7a5-4076-8079-04832db0e1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:45.064338 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc90cf2f-59de-4ac9-9e2e-237adb6718b9 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:45.075366 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc90cf2f-59de-4ac9-9e2e-237adb6718b9 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:45.079609 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38fa0e2-905e-4e0e-a746-a1d232692c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:45.080353 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fa0e2-905e-4e0e-a746-a1d232692c8d admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:45.080793 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fa0e2-905e-4e0e-a746-a1d232692c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:45.081159 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fa0e2-905e-4e0e-a746-a1d232692c8d admin admin] PATH_INFO: `/v3/services` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:45.081977 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38fa0e2-905e-4e0e-a746-a1d232692c8d admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:45.082376 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38fa0e2-905e-4e0e-a746-a1d232692c8d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:45.084413 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38fa0e2-905e-4e0e-a746-a1d232692c8d admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:45.088808 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-52cbf34a-a7a5-4076-8079-04832db0e1e4 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:45.089301 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 432/869] 10.222.0.43 () {56 vars in 1135 bytes} [Fri Dec 24 04:47:45 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:45.090689 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-52cbf34a-a7a5-4076-8079-04832db0e1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:45.095309 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38fa0e2-905e-4e0e-a746-a1d232692c8d admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:45.100169 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 438/870] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:45 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:47:45.105679 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38fa0e2-905e-4e0e-a746-a1d232692c8d admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:45.110719 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef6d897-9e01-4db4-89c4-06de2cddb27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:45.112563 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6d897-9e01-4db4-89c4-06de2cddb27c admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:45.112740 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80da2a7-0995-4f12-860c-ff90de9e3ee5 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:45.113035 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80da2a7-0995-4f12-860c-ff90de9e3ee5 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:45.113311 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80da2a7-0995-4f12-860c-ff90de9e3ee5 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:45.113468 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6d897-9e01-4db4-89c4-06de2cddb27c admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:45.113889 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6d897-9e01-4db4-89c4-06de2cddb27c admin admin] PATH_INFO: `/v3/services` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:45.114775 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef6d897-9e01-4db4-89c4-06de2cddb27c admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:45.115219 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef6d897-9e01-4db4-89c4-06de2cddb27c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:45.115326 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 439/871] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 24 04:47:45.117077 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef6d897-9e01-4db4-89c4-06de2cddb27c admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:45.120963 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811ac99-de94-454f-97d9-4adfb92704c9 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:45.121250 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811ac99-de94-454f-97d9-4adfb92704c9 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:45.121596 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811ac99-de94-454f-97d9-4adfb92704c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:45.123183 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 433/872] 10.222.0.43 () {56 vars in 1135 bytes} [Fri Dec 24 04:47:45 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:45.125149 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef6d897-9e01-4db4-89c4-06de2cddb27c admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:45.135454 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef6d897-9e01-4db4-89c4-06de2cddb27c admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:45.140653 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2764e0-94cd-4720-9b9b-164f62df9aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:45.141814 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2764e0-94cd-4720-9b9b-164f62df9aee admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:45.141932 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-6811ac99-de94-454f-97d9-4adfb92704c9 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:45.142379 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2764e0-94cd-4720-9b9b-164f62df9aee admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:45.142795 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2764e0-94cd-4720-9b9b-164f62df9aee admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:45.143153 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-6811ac99-de94-454f-97d9-4adfb92704c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:45.156497 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2764e0-94cd-4720-9b9b-164f62df9aee admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:47:45.160614 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 440/873] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:45 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:47:45.164569 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-de2764e0-94cd-4720-9b9b-164f62df9aee admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 24 04:47:45.166397 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 434/874] 10.222.0.43 () {56 vars in 1141 bytes} [Fri Dec 24 04:47:45 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:47:45.173997 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6811ac99-de94-454f-97d9-4adfb92704c9 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:45.178816 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2764e0-94cd-4720-9b9b-164f62df9aee admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:45.184856 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6811ac99-de94-454f-97d9-4adfb92704c9 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:45.190106 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e793b532-5ec4-4c58-8677-eb739d5d1de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:45.190412 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2764e0-94cd-4720-9b9b-164f62df9aee admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:45.190801 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793b532-5ec4-4c58-8677-eb739d5d1de5 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:45.191084 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793b532-5ec4-4c58-8677-eb739d5d1de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:45.191414 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793b532-5ec4-4c58-8677-eb739d5d1de5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:45.192342 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e793b532-5ec4-4c58-8677-eb739d5d1de5 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:45.192701 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e793b532-5ec4-4c58-8677-eb739d5d1de5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:45.194652 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e793b532-5ec4-4c58-8677-eb739d5d1de5 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:45.196326 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffdf78b-e556-4905-ab63-54356863423d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:45.197207 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffdf78b-e556-4905-ab63-54356863423d admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:45.197660 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffdf78b-e556-4905-ab63-54356863423d admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:45.198076 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffdf78b-e556-4905-ab63-54356863423d admin admin] PATH_INFO: `/v3/services` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:45.198979 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffdf78b-e556-4905-ab63-54356863423d admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:45.201032 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffdf78b-e556-4905-ab63-54356863423d admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:45.210320 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 441/875] 10.222.0.43 () {56 vars in 1136 bytes} [Fri Dec 24 04:47:45 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:45.211696 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e793b532-5ec4-4c58-8677-eb739d5d1de5 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:45.219988 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 435/876] 10.222.0.43 () {60 vars in 1162 bytes} [Fri Dec 24 04:47:45 2021] POST /identity/v3/services => generated 269 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 04:47:45.224585 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e793b532-5ec4-4c58-8677-eb739d5d1de5 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:45.240090 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40fc5b9-9c09-4a58-917a-c9d7fbe532de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:45.240992 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40fc5b9-9c09-4a58-917a-c9d7fbe532de admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:45.241277 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40fc5b9-9c09-4a58-917a-c9d7fbe532de admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:45.241555 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40fc5b9-9c09-4a58-917a-c9d7fbe532de admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:45.255276 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40fc5b9-9c09-4a58-917a-c9d7fbe532de admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:45.257284 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40fc5b9-9c09-4a58-917a-c9d7fbe532de admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:45.277455 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-a40fc5b9-9c09-4a58-917a-c9d7fbe532de admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:47:45.279241 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 442/877] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:45.285271 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffdf78b-e556-4905-ab63-54356863423d admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:45.297000 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffdf78b-e556-4905-ab63-54356863423d admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:45.302220 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1fdaff-385f-4942-872c-489375ae7b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:45.302935 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1fdaff-385f-4942-872c-489375ae7b96 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:45.303192 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1fdaff-385f-4942-872c-489375ae7b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:45.303519 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1fdaff-385f-4942-872c-489375ae7b96 admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:45.304289 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1fdaff-385f-4942-872c-489375ae7b96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:45.304630 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1fdaff-385f-4942-872c-489375ae7b96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:45.306398 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1fdaff-385f-4942-872c-489375ae7b96 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:45.320571 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 436/878] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:47:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:45.326348 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40fc5b9-9c09-4a58-917a-c9d7fbe532de admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:45.339703 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40fc5b9-9c09-4a58-917a-c9d7fbe532de admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:45.344931 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb6125-3f6e-4de5-8c17-d53c6aeb1e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:45.345767 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb6125-3f6e-4de5-8c17-d53c6aeb1e02 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:45.346046 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb6125-3f6e-4de5-8c17-d53c6aeb1e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:45.346317 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb6125-3f6e-4de5-8c17-d53c6aeb1e02 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:45.355461 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bb6125-3f6e-4de5-8c17-d53c6aeb1e02 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:45.358206 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bb6125-3f6e-4de5-8c17-d53c6aeb1e02 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:45.374114 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-06bb6125-3f6e-4de5-8c17-d53c6aeb1e02 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 24 04:47:45.375716 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 443/879] 10.222.0.43 () {56 vars in 1138 bytes} [Fri Dec 24 04:47:45 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:45.382256 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1fdaff-385f-4942-872c-489375ae7b96 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:45.393906 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1fdaff-385f-4942-872c-489375ae7b96 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:45.398888 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5e5e3-7e35-4747-b6d0-ef6a6e484fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:45.399589 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5e5e3-7e35-4747-b6d0-ef6a6e484fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:45.399852 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5e5e3-7e35-4747-b6d0-ef6a6e484fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:45.400122 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5e5e3-7e35-4747-b6d0-ef6a6e484fd1 admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:45.401454 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f5e5e3-7e35-4747-b6d0-ef6a6e484fd1 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:45.401454 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f5e5e3-7e35-4747-b6d0-ef6a6e484fd1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:45.403422 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f5e5e3-7e35-4747-b6d0-ef6a6e484fd1 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:45.424917 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 437/880] 10.222.0.43 () {56 vars in 1170 bytes} [Fri Dec 24 04:47:45 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:45.431290 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb6125-3f6e-4de5-8c17-d53c6aeb1e02 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:45.446527 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb6125-3f6e-4de5-8c17-d53c6aeb1e02 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:45.452073 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b901b35-f258-42bf-9732-31f5b47cb5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:45.453144 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b901b35-f258-42bf-9732-31f5b47cb5b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:45.453625 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b901b35-f258-42bf-9732-31f5b47cb5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:45.454136 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b901b35-f258-42bf-9732-31f5b47cb5b5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:45.463956 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b901b35-f258-42bf-9732-31f5b47cb5b5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:45.466201 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b901b35-f258-42bf-9732-31f5b47cb5b5 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:45.477100 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 444/881] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:47:45 2021] GET /identity/v3/auth/tokens => generated 1562 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:47:45.483748 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5e5e3-7e35-4747-b6d0-ef6a6e484fd1 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:45.495680 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5e5e3-7e35-4747-b6d0-ef6a6e484fd1 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:45.500737 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b85d2-06b9-4eaf-96f4-afe8c62094e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:45.501630 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b85d2-06b9-4eaf-96f4-afe8c62094e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:45.501898 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b85d2-06b9-4eaf-96f4-afe8c62094e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:45.502167 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b85d2-06b9-4eaf-96f4-afe8c62094e0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:45.516010 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1b85d2-06b9-4eaf-96f4-afe8c62094e0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:45.517900 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1b85d2-06b9-4eaf-96f4-afe8c62094e0 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:45.537684 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-1d1b85d2-06b9-4eaf-96f4-afe8c62094e0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:47:45.539227 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 438/882] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:45.545509 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b901b35-f258-42bf-9732-31f5b47cb5b5 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:45.555644 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b901b35-f258-42bf-9732-31f5b47cb5b5 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:45.561121 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fcfbf2-1637-47f9-89f9-d55ca0036876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:45.562077 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcfbf2-1637-47f9-89f9-d55ca0036876 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:45.562640 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcfbf2-1637-47f9-89f9-d55ca0036876 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:45.563086 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcfbf2-1637-47f9-89f9-d55ca0036876 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:45.564028 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fcfbf2-1637-47f9-89f9-d55ca0036876 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:45.564595 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fcfbf2-1637-47f9-89f9-d55ca0036876 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:45.566411 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fcfbf2-1637-47f9-89f9-d55ca0036876 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:45.580307 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 445/883] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:47:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:45.586866 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b85d2-06b9-4eaf-96f4-afe8c62094e0 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:45.597475 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b85d2-06b9-4eaf-96f4-afe8c62094e0 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:45.602424 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7e5f78-0842-49ff-892a-e602ac1b8c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:45.603456 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e5f78-0842-49ff-892a-e602ac1b8c5e admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:45.603945 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e5f78-0842-49ff-892a-e602ac1b8c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:45.604394 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e5f78-0842-49ff-892a-e602ac1b8c5e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:45.612177 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7e5f78-0842-49ff-892a-e602ac1b8c5e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:45.614461 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7e5f78-0842-49ff-892a-e602ac1b8c5e admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:45.628356 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-ac7e5f78-0842-49ff-892a-e602ac1b8c5e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 24 04:47:45.630143 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 439/884] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Dec 24 04:47:45 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:45.636473 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fcfbf2-1637-47f9-89f9-d55ca0036876 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:45.646736 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fcfbf2-1637-47f9-89f9-d55ca0036876 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:45.651597 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e00709-9470-4b3f-9eba-e823ebc841b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:45.652454 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e00709-9470-4b3f-9eba-e823ebc841b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:45.653008 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e00709-9470-4b3f-9eba-e823ebc841b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:45.653475 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e00709-9470-4b3f-9eba-e823ebc841b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:45.654530 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e00709-9470-4b3f-9eba-e823ebc841b2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:45.655015 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e00709-9470-4b3f-9eba-e823ebc841b2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:45.657125 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e00709-9470-4b3f-9eba-e823ebc841b2 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:45.670616 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 446/885] 10.222.0.43 () {56 vars in 1169 bytes} [Fri Dec 24 04:47:45 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:45.677355 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7e5f78-0842-49ff-892a-e602ac1b8c5e admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:45.688324 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7e5f78-0842-49ff-892a-e602ac1b8c5e admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:45.693368 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc85155-946d-47d8-9731-6cb911702655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:45.694288 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc85155-946d-47d8-9731-6cb911702655 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:45.694744 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc85155-946d-47d8-9731-6cb911702655 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:45.695254 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc85155-946d-47d8-9731-6cb911702655 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:45.696337 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc85155-946d-47d8-9731-6cb911702655 admin admin] RBAC: Adding query filter params (role.id=687cef9f2c0040bc9e427ac01fd7a65c, scope.project.id=c19ba4a2c0224c079c5a8a6a56569fd6, user.id=3d0ee2c830754741b0f9eedabf6bded8) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:45.696845 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc85155-946d-47d8-9731-6cb911702655 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:45.699094 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc85155-946d-47d8-9731-6cb911702655 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:45.705756 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 440/886] 10.222.0.43 () {56 vars in 1395 bytes} [Fri Dec 24 04:47:45 2021] GET /identity/v3/role_assignments?user.id=3d0ee2c830754741b0f9eedabf6bded8&scope.project.id=c19ba4a2c0224c079c5a8a6a56569fd6&role.id=687cef9f2c0040bc9e427ac01fd7a65c => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:46.669248 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e9d3d-9fb4-4a3f-b2dd-1db22a2016cd None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:46.669748 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e9d3d-9fb4-4a3f-b2dd-1db22a2016cd None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:46.669748 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e9d3d-9fb4-4a3f-b2dd-1db22a2016cd None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:46.671583 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 447/887] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:46.677680 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1dfcf-1b4f-44ae-b156-5ef8b43ec5f0 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:46.678479 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1dfcf-1b4f-44ae-b156-5ef8b43ec5f0 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:46.678950 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1dfcf-1b4f-44ae-b156-5ef8b43ec5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:46.697000 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-c2f1dfcf-1b4f-44ae-b156-5ef8b43ec5f0 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:46.698522 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-c2f1dfcf-1b4f-44ae-b156-5ef8b43ec5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:46.712077 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 441/888] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:46 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:47:46.730790 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e9d3d-9fb4-4a3f-b2dd-1db22a2016cd None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:46.743803 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e9d3d-9fb4-4a3f-b2dd-1db22a2016cd None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:46.749386 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a54536f-6c8e-4599-a34b-d03ca29b2b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:46.750456 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a54536f-6c8e-4599-a34b-d03ca29b2b0c admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:46.750936 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a54536f-6c8e-4599-a34b-d03ca29b2b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:46.751406 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a54536f-6c8e-4599-a34b-d03ca29b2b0c admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:46.752279 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a54536f-6c8e-4599-a34b-d03ca29b2b0c admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:46.754119 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a54536f-6c8e-4599-a34b-d03ca29b2b0c admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:46.765888 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-6a54536f-6c8e-4599-a34b-d03ca29b2b0c admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 24 04:47:46.772669 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 448/889] 10.222.0.43 () {56 vars in 1147 bytes} [Fri Dec 24 04:47:46 2021] GET /identity/v3/services/object-store => generated 93 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:46.774385 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f1dfcf-1b4f-44ae-b156-5ef8b43ec5f0 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:46.784169 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f1dfcf-1b4f-44ae-b156-5ef8b43ec5f0 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:46.792877 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f907a9a-d77a-49e0-8433-400dea91de76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:46.794219 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f907a9a-d77a-49e0-8433-400dea91de76 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:46.794735 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f907a9a-d77a-49e0-8433-400dea91de76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:46.795214 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f907a9a-d77a-49e0-8433-400dea91de76 admin admin] PATH_INFO: `/v3/services` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:46.796151 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f907a9a-d77a-49e0-8433-400dea91de76 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:46.796686 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f907a9a-d77a-49e0-8433-400dea91de76 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:46.798527 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f907a9a-d77a-49e0-8433-400dea91de76 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:46.808625 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 442/890] 10.222.0.43 () {56 vars in 1143 bytes} [Fri Dec 24 04:47:46 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:46.811549 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a54536f-6c8e-4599-a34b-d03ca29b2b0c admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:46.821986 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a54536f-6c8e-4599-a34b-d03ca29b2b0c admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:46.828128 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c8e1f9-0b77-4506-88d3-e896935939ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:46.829087 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8e1f9-0b77-4506-88d3-e896935939ba admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:46.829565 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8e1f9-0b77-4506-88d3-e896935939ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:46.830032 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8e1f9-0b77-4506-88d3-e896935939ba admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:46.831034 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c8e1f9-0b77-4506-88d3-e896935939ba admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:46.831535 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c8e1f9-0b77-4506-88d3-e896935939ba admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:46.833396 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c8e1f9-0b77-4506-88d3-e896935939ba admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:46.844730 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 449/891] 10.222.0.43 () {56 vars in 1143 bytes} [Fri Dec 24 04:47:46 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:47.558096 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84780ddd-10e1-4e62-bd22-30b88785daf9 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:47.558489 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84780ddd-10e1-4e62-bd22-30b88785daf9 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:47.558681 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84780ddd-10e1-4e62-bd22-30b88785daf9 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:47.560947 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 443/892] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:47.566810 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959043ed-a457-4fda-b865-01bbd5c1cda2 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:47.567029 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959043ed-a457-4fda-b865-01bbd5c1cda2 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:47.567313 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959043ed-a457-4fda-b865-01bbd5c1cda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:47.585656 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-959043ed-a457-4fda-b865-01bbd5c1cda2 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:47.586839 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-959043ed-a457-4fda-b865-01bbd5c1cda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:47.595063 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 450/893] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:47 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:47:47.618579 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84780ddd-10e1-4e62-bd22-30b88785daf9 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:47.631331 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84780ddd-10e1-4e62-bd22-30b88785daf9 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:47.635725 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e30030-97b2-47f4-a147-d46de66242ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:47.636381 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e30030-97b2-47f4-a147-d46de66242ed admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:47.636693 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e30030-97b2-47f4-a147-d46de66242ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:47.636967 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e30030-97b2-47f4-a147-d46de66242ed admin admin] PATH_INFO: `/v3/services` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:47.637758 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e30030-97b2-47f4-a147-d46de66242ed admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:47.639362 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e30030-97b2-47f4-a147-d46de66242ed admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:47.654680 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 444/894] 10.222.0.43 () {60 vars in 1162 bytes} [Fri Dec 24 04:47:47 2021] POST /identity/v3/services => generated 251 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:47:47.659413 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4bbc6-a203-413e-bc9d-6cd121ccb76f None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:47.659713 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4bbc6-a203-413e-bc9d-6cd121ccb76f None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:47.659980 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4bbc6-a203-413e-bc9d-6cd121ccb76f None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:47.662161 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 451/895] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:47.668562 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff4c5c-88ea-4919-8c84-5e023c017663 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:47.668860 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff4c5c-88ea-4919-8c84-5e023c017663 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:47.669139 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff4c5c-88ea-4919-8c84-5e023c017663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:47.690511 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-09ff4c5c-88ea-4919-8c84-5e023c017663 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:47.692790 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-09ff4c5c-88ea-4919-8c84-5e023c017663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:47.714444 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 445/896] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:47 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:47:47.738730 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a4bbc6-a203-413e-bc9d-6cd121ccb76f None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:47.752516 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a4bbc6-a203-413e-bc9d-6cd121ccb76f None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:47.757596 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c2fe81-fb49-4faf-96f6-968058e9f267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:47.758787 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2fe81-fb49-4faf-96f6-968058e9f267 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:47.759277 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2fe81-fb49-4faf-96f6-968058e9f267 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:47.759739 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2fe81-fb49-4faf-96f6-968058e9f267 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:47.760674 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c2fe81-fb49-4faf-96f6-968058e9f267 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:47.762596 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c2fe81-fb49-4faf-96f6-968058e9f267 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:47.776702 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-f9c2fe81-fb49-4faf-96f6-968058e9f267 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Dec 24 04:47:47.778731 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 452/897] 10.222.0.43 () {56 vars in 1153 bytes} [Fri Dec 24 04:47:47 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:47.785436 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff4c5c-88ea-4919-8c84-5e023c017663 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:47.795336 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff4c5c-88ea-4919-8c84-5e023c017663 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:47.800308 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6508b82-2991-4830-8214-7abab2bc5756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:47.803311 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6508b82-2991-4830-8214-7abab2bc5756 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:47.803840 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6508b82-2991-4830-8214-7abab2bc5756 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:47.804302 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6508b82-2991-4830-8214-7abab2bc5756 admin admin] PATH_INFO: `/v3/services` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:47.805333 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6508b82-2991-4830-8214-7abab2bc5756 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:47.805856 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6508b82-2991-4830-8214-7abab2bc5756 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:47.807704 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6508b82-2991-4830-8214-7abab2bc5756 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:47.813812 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 446/898] 10.222.0.43 () {56 vars in 1147 bytes} [Fri Dec 24 04:47:47 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:47.820565 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c2fe81-fb49-4faf-96f6-968058e9f267 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:47.831320 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c2fe81-fb49-4faf-96f6-968058e9f267 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:47.836636 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785593d-f082-4360-baf3-a695565208be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:47.837638 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785593d-f082-4360-baf3-a695565208be admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:47.838109 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785593d-f082-4360-baf3-a695565208be admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:47.838568 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785593d-f082-4360-baf3-a695565208be admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:47.839490 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3785593d-f082-4360-baf3-a695565208be admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:47.839985 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3785593d-f082-4360-baf3-a695565208be admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:47.842142 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3785593d-f082-4360-baf3-a695565208be admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:47.847997 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 453/899] 10.222.0.43 () {56 vars in 1147 bytes} [Fri Dec 24 04:47:47 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:47.854822 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6508b82-2991-4830-8214-7abab2bc5756 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:47.865213 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6508b82-2991-4830-8214-7abab2bc5756 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:47.870098 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee0e5de-0ff0-4b83-b7cf-1f8dbe72c372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:47.871082 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0e5de-0ff0-4b83-b7cf-1f8dbe72c372 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:47.871594 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0e5de-0ff0-4b83-b7cf-1f8dbe72c372 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:47.872070 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0e5de-0ff0-4b83-b7cf-1f8dbe72c372 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:47.873133 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee0e5de-0ff0-4b83-b7cf-1f8dbe72c372 admin admin] RBAC: Adding query filter params (interface=public, service_id=4923ce58e47c449db6166e406903c5c9, region_id=RegionOne) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:47.873658 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee0e5de-0ff0-4b83-b7cf-1f8dbe72c372 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:47.875495 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee0e5de-0ff0-4b83-b7cf-1f8dbe72c372 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:47.881790 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 447/900] 10.222.0.43 () {56 vars in 1272 bytes} [Fri Dec 24 04:47:47 2021] GET /identity/v3/endpoints?service_id=4923ce58e47c449db6166e406903c5c9&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:47.888283 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785593d-f082-4360-baf3-a695565208be admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:47.898636 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785593d-f082-4360-baf3-a695565208be admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:47.903468 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c117dc4-8819-41c8-bab7-d4bd94813f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:47.904394 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c117dc4-8819-41c8-bab7-d4bd94813f52 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:47.904885 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c117dc4-8819-41c8-bab7-d4bd94813f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:47.905340 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c117dc4-8819-41c8-bab7-d4bd94813f52 admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:47.906223 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c117dc4-8819-41c8-bab7-d4bd94813f52 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:47.908031 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c117dc4-8819-41c8-bab7-d4bd94813f52 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:47.915044 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 454/901] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Dec 24 04:47:47 2021] GET /identity/v3/services => generated 1268 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 04:47:48.124465 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09661e12-73d0-4eeb-b9cc-0782dedc26d4 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:48.124855 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09661e12-73d0-4eeb-b9cc-0782dedc26d4 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:48.124970 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09661e12-73d0-4eeb-b9cc-0782dedc26d4 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:48.127042 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 448/902] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 24 04:47:48.133216 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f9ac0-2efa-46cf-ba95-21c02a8e453d None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:48.133509 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f9ac0-2efa-46cf-ba95-21c02a8e453d None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:48.133788 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f9ac0-2efa-46cf-ba95-21c02a8e453d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:48.151977 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-681f9ac0-2efa-46cf-ba95-21c02a8e453d None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:48.153286 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-681f9ac0-2efa-46cf-ba95-21c02a8e453d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:48.161443 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 455/903] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:48 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:47:48.185101 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09661e12-73d0-4eeb-b9cc-0782dedc26d4 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:48.197529 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09661e12-73d0-4eeb-b9cc-0782dedc26d4 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:48.201990 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d7142-dc8b-4c7f-9e06-330026e995c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:48.202800 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d7142-dc8b-4c7f-9e06-330026e995c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:48.203084 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d7142-dc8b-4c7f-9e06-330026e995c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:48.203360 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d7142-dc8b-4c7f-9e06-330026e995c2 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:48.214239 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19d7142-dc8b-4c7f-9e06-330026e995c2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:47:48.222238 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-c19d7142-dc8b-4c7f-9e06-330026e995c2 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 24 04:47:48.223753 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 449/904] 10.222.0.43 () {56 vars in 1141 bytes} [Fri Dec 24 04:47:48 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:48.230200 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f9ac0-2efa-46cf-ba95-21c02a8e453d None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:48.239754 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f9ac0-2efa-46cf-ba95-21c02a8e453d None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:48.244592 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e2285-37a2-42b7-94eb-0701d8a008b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:48.245299 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e2285-37a2-42b7-94eb-0701d8a008b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:48.245585 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e2285-37a2-42b7-94eb-0701d8a008b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:48.245859 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e2285-37a2-42b7-94eb-0701d8a008b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:48.246869 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70e2285-37a2-42b7-94eb-0701d8a008b6 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:48.247183 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70e2285-37a2-42b7-94eb-0701d8a008b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:48.248889 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70e2285-37a2-42b7-94eb-0701d8a008b6 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:48.257983 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 456/905] 10.222.0.43 () {56 vars in 1136 bytes} [Fri Dec 24 04:47:48 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:48.264154 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d7142-dc8b-4c7f-9e06-330026e995c2 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:48.274614 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d7142-dc8b-4c7f-9e06-330026e995c2 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:48.279262 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901f4a9-d998-4a85-9339-d98245f782ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:48.280090 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901f4a9-d998-4a85-9339-d98245f782ae admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:48.280418 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901f4a9-d998-4a85-9339-d98245f782ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:48.280722 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901f4a9-d998-4a85-9339-d98245f782ae admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:48.291365 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a901f4a9-d998-4a85-9339-d98245f782ae admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:48.293478 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a901f4a9-d998-4a85-9339-d98245f782ae admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:48.310899 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-a901f4a9-d998-4a85-9339-d98245f782ae admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:47:48.312419 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 450/906] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:47:48.320257 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e2285-37a2-42b7-94eb-0701d8a008b6 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:48.330476 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e2285-37a2-42b7-94eb-0701d8a008b6 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:48.335429 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb896bf5-7101-47bc-88ac-26b04e3c6d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:48.336088 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb896bf5-7101-47bc-88ac-26b04e3c6d3a admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:48.336371 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb896bf5-7101-47bc-88ac-26b04e3c6d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:48.336680 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb896bf5-7101-47bc-88ac-26b04e3c6d3a admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:48.337424 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb896bf5-7101-47bc-88ac-26b04e3c6d3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:48.337733 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb896bf5-7101-47bc-88ac-26b04e3c6d3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:48.339347 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb896bf5-7101-47bc-88ac-26b04e3c6d3a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:48.352986 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 457/907] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:47:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:48.359379 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901f4a9-d998-4a85-9339-d98245f782ae admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:48.369196 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901f4a9-d998-4a85-9339-d98245f782ae admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:48.374104 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362c8611-ed80-4669-a45c-238eb2092ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:48.374957 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c8611-ed80-4669-a45c-238eb2092ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:48.375187 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c8611-ed80-4669-a45c-238eb2092ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:48.375514 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c8611-ed80-4669-a45c-238eb2092ed2 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:48.383079 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362c8611-ed80-4669-a45c-238eb2092ed2 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:48.385227 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362c8611-ed80-4669-a45c-238eb2092ed2 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:48.400369 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-362c8611-ed80-4669-a45c-238eb2092ed2 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 24 04:47:48.401848 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 451/908] 10.222.0.43 () {56 vars in 1138 bytes} [Fri Dec 24 04:47:48 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:48.408080 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb896bf5-7101-47bc-88ac-26b04e3c6d3a admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:48.418168 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb896bf5-7101-47bc-88ac-26b04e3c6d3a admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:48.422837 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c321ee-b3f3-4363-bdb3-8e658d493b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:48.423613 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c321ee-b3f3-4363-bdb3-8e658d493b13 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:48.423941 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c321ee-b3f3-4363-bdb3-8e658d493b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:48.424220 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c321ee-b3f3-4363-bdb3-8e658d493b13 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:48.425116 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c321ee-b3f3-4363-bdb3-8e658d493b13 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:48.425498 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c321ee-b3f3-4363-bdb3-8e658d493b13 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:48.427316 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c321ee-b3f3-4363-bdb3-8e658d493b13 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:48.446471 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 458/909] 10.222.0.43 () {56 vars in 1170 bytes} [Fri Dec 24 04:47:48 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:48.452517 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362c8611-ed80-4669-a45c-238eb2092ed2 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:48.462658 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362c8611-ed80-4669-a45c-238eb2092ed2 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:48.467313 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a9644-0559-4e8e-a5eb-0aebfa626aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:48.468096 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a9644-0559-4e8e-a5eb-0aebfa626aab admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:48.468377 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a9644-0559-4e8e-a5eb-0aebfa626aab admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:48.468693 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a9644-0559-4e8e-a5eb-0aebfa626aab admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:48.479023 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a9644-0559-4e8e-a5eb-0aebfa626aab admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:48.481121 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a9644-0559-4e8e-a5eb-0aebfa626aab admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:48.498216 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-dd7a9644-0559-4e8e-a5eb-0aebfa626aab admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:47:48.499400 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 452/910] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:48.505623 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c321ee-b3f3-4363-bdb3-8e658d493b13 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:48.515724 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c321ee-b3f3-4363-bdb3-8e658d493b13 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:48.520323 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566276d-ab7b-418a-b0ad-0ce3ec31a091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:48.521057 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566276d-ab7b-418a-b0ad-0ce3ec31a091 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:48.521339 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566276d-ab7b-418a-b0ad-0ce3ec31a091 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:48.521666 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566276d-ab7b-418a-b0ad-0ce3ec31a091 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:48.522465 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d566276d-ab7b-418a-b0ad-0ce3ec31a091 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:48.522772 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d566276d-ab7b-418a-b0ad-0ce3ec31a091 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:48.524435 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d566276d-ab7b-418a-b0ad-0ce3ec31a091 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:48.540778 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 459/911] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:47:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:48.542675 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a9644-0559-4e8e-a5eb-0aebfa626aab admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:48.552848 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a9644-0559-4e8e-a5eb-0aebfa626aab admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:48.557566 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b68f5-ac0a-43cb-bf1b-d45b4f814818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:48.558404 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b68f5-ac0a-43cb-bf1b-d45b4f814818 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:48.558686 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b68f5-ac0a-43cb-bf1b-d45b4f814818 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:48.559018 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b68f5-ac0a-43cb-bf1b-d45b4f814818 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:48.566418 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15b68f5-ac0a-43cb-bf1b-d45b4f814818 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:48.568469 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15b68f5-ac0a-43cb-bf1b-d45b4f814818 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:48.581733 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-f15b68f5-ac0a-43cb-bf1b-d45b4f814818 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 24 04:47:48.583233 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 453/912] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Dec 24 04:47:48 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:48.589720 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566276d-ab7b-418a-b0ad-0ce3ec31a091 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:48.599860 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566276d-ab7b-418a-b0ad-0ce3ec31a091 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:48.604613 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a293db-f19c-44a7-afc6-24b90630b5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:48.605272 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a293db-f19c-44a7-afc6-24b90630b5d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:48.605600 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a293db-f19c-44a7-afc6-24b90630b5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:48.605950 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a293db-f19c-44a7-afc6-24b90630b5d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:48.606859 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a293db-f19c-44a7-afc6-24b90630b5d7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:48.607166 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a293db-f19c-44a7-afc6-24b90630b5d7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:48.609104 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a293db-f19c-44a7-afc6-24b90630b5d7 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:48.622696 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 460/913] 10.222.0.43 () {56 vars in 1169 bytes} [Fri Dec 24 04:47:48 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:48.629111 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b68f5-ac0a-43cb-bf1b-d45b4f814818 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:48.641165 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b68f5-ac0a-43cb-bf1b-d45b4f814818 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:48.645875 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f6409-8c96-4749-9ff8-7852a104b78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:48.646808 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f6409-8c96-4749-9ff8-7852a104b78c admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:48.647091 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f6409-8c96-4749-9ff8-7852a104b78c admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:48.647365 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f6409-8c96-4749-9ff8-7852a104b78c admin admin] PATH_INFO: `/v3/projects/c19ba4a2c0224c079c5a8a6a56569fd6/users/3d0ee2c830754741b0f9eedabf6bded8/roles/687cef9f2c0040bc9e427ac01fd7a65c` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:48.649679 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09f6409-8c96-4749-9ff8-7852a104b78c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c19ba4a2c0224c079c5a8a6a56569fd6, user_id=3d0ee2c830754741b0f9eedabf6bded8, role_id=687cef9f2c0040bc9e427ac01fd7a65c)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:48.652400 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09f6409-8c96-4749-9ff8-7852a104b78c admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:48.669517 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 454/914] 10.222.0.43 () {58 vars in 1460 bytes} [Fri Dec 24 04:47:48 2021] PUT /identity/v3/projects/c19ba4a2c0224c079c5a8a6a56569fd6/users/3d0ee2c830754741b0f9eedabf6bded8/roles/687cef9f2c0040bc9e427ac01fd7a65c => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:47:49.297986 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13b897-eee3-440b-b781-ae412cf60ec6 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:49.298547 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13b897-eee3-440b-b781-ae412cf60ec6 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:49.298547 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13b897-eee3-440b-b781-ae412cf60ec6 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:49.300602 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 461/915] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:49.306664 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d24aa-3d10-45e0-9565-05fe4953a30e None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:49.307058 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d24aa-3d10-45e0-9565-05fe4953a30e None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:49.307236 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d24aa-3d10-45e0-9565-05fe4953a30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:49.328293 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-615d24aa-3d10-45e0-9565-05fe4953a30e None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:49.329520 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-615d24aa-3d10-45e0-9565-05fe4953a30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:49.392656 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 455/916] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:49 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:47:49.410408 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e13b897-eee3-440b-b781-ae412cf60ec6 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:49.423278 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e13b897-eee3-440b-b781-ae412cf60ec6 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:49.427876 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e755b-329d-43e4-8a31-77dd8c26f111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:49.428561 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e755b-329d-43e4-8a31-77dd8c26f111 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:49.428849 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e755b-329d-43e4-8a31-77dd8c26f111 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:49.429181 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e755b-329d-43e4-8a31-77dd8c26f111 admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:49.429941 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e755b-329d-43e4-8a31-77dd8c26f111 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:49.431608 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e755b-329d-43e4-8a31-77dd8c26f111 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:49.452727 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 462/917] 10.222.0.43 () {60 vars in 1162 bytes} [Fri Dec 24 04:47:49 2021] POST /identity/v3/services => generated 241 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 04:47:50.183146 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454a230-f774-4cee-b094-b5b4a6530652 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:50.183640 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454a230-f774-4cee-b094-b5b4a6530652 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:50.184166 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454a230-f774-4cee-b094-b5b4a6530652 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:50.186439 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 456/918] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:50.192324 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e40d2-3c40-4f7c-bf6a-409cfe04c7a2 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:50.192896 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e40d2-3c40-4f7c-bf6a-409cfe04c7a2 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:50.193375 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e40d2-3c40-4f7c-bf6a-409cfe04c7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:50.211512 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-e78e40d2-3c40-4f7c-bf6a-409cfe04c7a2 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:50.213063 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-e78e40d2-3c40-4f7c-bf6a-409cfe04c7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:50.229827 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 463/919] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:50 2021] POST /identity/v3/auth/tokens => generated 1765 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:47:50.254367 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3454a230-f774-4cee-b094-b5b4a6530652 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:50.267047 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3454a230-f774-4cee-b094-b5b4a6530652 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:50.271709 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba24c0-4699-4fe3-8d9a-ab7a2956add4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:50.272748 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba24c0-4699-4fe3-8d9a-ab7a2956add4 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:50.273268 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba24c0-4699-4fe3-8d9a-ab7a2956add4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:50.273733 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba24c0-4699-4fe3-8d9a-ab7a2956add4 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:50.274603 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ba24c0-4699-4fe3-8d9a-ab7a2956add4 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:50.276417 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ba24c0-4699-4fe3-8d9a-ab7a2956add4 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:50.285642 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3f40a-773d-41e2-aafd-4371b9e9c5ac None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:50.286215 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3f40a-773d-41e2-aafd-4371b9e9c5ac None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:50.286683 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3f40a-773d-41e2-aafd-4371b9e9c5ac None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:50.288771 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-37ba24c0-4699-4fe3-8d9a-ab7a2956add4 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Dec 24 04:47:50.289108 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 464/920] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 24 04:47:50.290051 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 457/921] 10.222.0.43 () {56 vars in 1135 bytes} [Fri Dec 24 04:47:50 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:50.295758 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99df17-f123-4094-9322-e8be05fdb906 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:50.296063 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99df17-f123-4094-9322-e8be05fdb906 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:50.296304 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99df17-f123-4094-9322-e8be05fdb906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:50.297440 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba24c0-4699-4fe3-8d9a-ab7a2956add4 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:50.312088 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba24c0-4699-4fe3-8d9a-ab7a2956add4 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:50.319438 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cef1db-7c7d-47a9-aaef-181c96e80ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:50.320329 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cef1db-7c7d-47a9-aaef-181c96e80ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:50.320652 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-3a99df17-f123-4094-9322-e8be05fdb906 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:50.321085 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cef1db-7c7d-47a9-aaef-181c96e80ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:50.321293 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cef1db-7c7d-47a9-aaef-181c96e80ff5 admin admin] PATH_INFO: `/v3/services` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:50.322122 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cef1db-7c7d-47a9-aaef-181c96e80ff5 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:50.322525 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cef1db-7c7d-47a9-aaef-181c96e80ff5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:50.322869 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-3a99df17-f123-4094-9322-e8be05fdb906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:50.324316 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cef1db-7c7d-47a9-aaef-181c96e80ff5 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:50.329728 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 458/922] 10.222.0.43 () {56 vars in 1135 bytes} [Fri Dec 24 04:47:50 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:50.332553 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 465/923] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:50 2021] POST /identity/v3/auth/tokens => generated 1765 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 04:47:50.336046 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cef1db-7c7d-47a9-aaef-181c96e80ff5 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:50.345745 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cef1db-7c7d-47a9-aaef-181c96e80ff5 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:50.350379 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7fb82-640e-4e3b-989d-4d06459d995c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:50.351081 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7fb82-640e-4e3b-989d-4d06459d995c admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:50.351365 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7fb82-640e-4e3b-989d-4d06459d995c admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:50.351635 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7fb82-640e-4e3b-989d-4d06459d995c admin admin] PATH_INFO: `/v3/services` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:50.352412 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b7fb82-640e-4e3b-989d-4d06459d995c admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:50.352755 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b7fb82-640e-4e3b-989d-4d06459d995c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:50.354438 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b7fb82-640e-4e3b-989d-4d06459d995c admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:50.358776 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a99df17-f123-4094-9322-e8be05fdb906 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:50.361623 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 459/924] 10.222.0.43 () {56 vars in 1135 bytes} [Fri Dec 24 04:47:50 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:50.368104 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a99df17-f123-4094-9322-e8be05fdb906 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:50.368318 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7fb82-640e-4e3b-989d-4d06459d995c admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:50.373101 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7468dd0-3606-49c0-9bf6-d022f3187940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:50.374150 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7468dd0-3606-49c0-9bf6-d022f3187940 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:50.374483 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7468dd0-3606-49c0-9bf6-d022f3187940 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:50.374754 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7468dd0-3606-49c0-9bf6-d022f3187940 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:50.376004 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7468dd0-3606-49c0-9bf6-d022f3187940 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:50.377973 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7468dd0-3606-49c0-9bf6-d022f3187940 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:50.378547 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7fb82-640e-4e3b-989d-4d06459d995c admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:50.383057 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8467e5c-d202-4a36-91b4-38fb044782c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:50.383705 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8467e5c-d202-4a36-91b4-38fb044782c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:50.383969 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8467e5c-d202-4a36-91b4-38fb044782c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:50.384240 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8467e5c-d202-4a36-91b4-38fb044782c7 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:50.385083 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8467e5c-d202-4a36-91b4-38fb044782c7 admin admin] RBAC: Adding query filter params (interface=public, service_id=84b43cf4e95c4b2bba25d5bea01cdcaf, region_id=RegionOne) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:50.385392 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8467e5c-d202-4a36-91b4-38fb044782c7 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:50.387027 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8467e5c-d202-4a36-91b4-38fb044782c7 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:50.391017 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-b7468dd0-3606-49c0-9bf6-d022f3187940 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Dec 24 04:47:50.392514 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 466/925] 10.222.0.43 () {56 vars in 1153 bytes} [Fri Dec 24 04:47:50 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:47:50.397442 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 460/926] 10.222.0.43 () {56 vars in 1272 bytes} [Fri Dec 24 04:47:50 2021] GET /identity/v3/endpoints?service_id=84b43cf4e95c4b2bba25d5bea01cdcaf&interface=public®ion_id=RegionOne => generated 194 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:50.398676 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7468dd0-3606-49c0-9bf6-d022f3187940 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:50.398953 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8467e5c-d202-4a36-91b4-38fb044782c7 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:50.408671 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8467e5c-d202-4a36-91b4-38fb044782c7 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:50.408879 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7468dd0-3606-49c0-9bf6-d022f3187940 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:50.413335 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd682c1-75c8-4cbe-8091-f2613d2791dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:50.413828 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa5616-e797-4fa5-9bd7-ffe093497bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:50.414017 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd682c1-75c8-4cbe-8091-f2613d2791dc admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:50.414252 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd682c1-75c8-4cbe-8091-f2613d2791dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:50.414460 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa5616-e797-4fa5-9bd7-ffe093497bea admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:50.414558 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd682c1-75c8-4cbe-8091-f2613d2791dc admin admin] PATH_INFO: `/v3/services` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:50.414738 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa5616-e797-4fa5-9bd7-ffe093497bea admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:50.415008 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa5616-e797-4fa5-9bd7-ffe093497bea admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:50.415292 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd682c1-75c8-4cbe-8091-f2613d2791dc admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:50.415593 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd682c1-75c8-4cbe-8091-f2613d2791dc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:50.415715 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fa5616-e797-4fa5-9bd7-ffe093497bea admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:50.417262 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd682c1-75c8-4cbe-8091-f2613d2791dc admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:50.417440 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fa5616-e797-4fa5-9bd7-ffe093497bea admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:50.424054 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 467/928] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Dec 24 04:47:50 2021] GET /identity/v3/services => generated 1497 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 04:47:50.427454 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 461/928] 10.222.0.43 () {56 vars in 1147 bytes} [Fri Dec 24 04:47:50 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:50.433756 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa5616-e797-4fa5-9bd7-ffe093497bea admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:50.445465 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa5616-e797-4fa5-9bd7-ffe093497bea admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:50.450833 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1258cd-cf50-4653-a0c1-12090e5da504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:50.451574 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1258cd-cf50-4653-a0c1-12090e5da504 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:50.451859 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1258cd-cf50-4653-a0c1-12090e5da504 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:50.452160 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1258cd-cf50-4653-a0c1-12090e5da504 admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:50.452953 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1258cd-cf50-4653-a0c1-12090e5da504 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:50.453301 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1258cd-cf50-4653-a0c1-12090e5da504 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:50.454931 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1258cd-cf50-4653-a0c1-12090e5da504 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:50.466907 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 468/929] 10.222.0.43 () {56 vars in 1147 bytes} [Fri Dec 24 04:47:50 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:50.468323 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd682c1-75c8-4cbe-8091-f2613d2791dc admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:50.478600 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd682c1-75c8-4cbe-8091-f2613d2791dc admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:50.483915 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ecc32-0e63-4f0f-8bdd-ee94e6f94fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:50.484686 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ecc32-0e63-4f0f-8bdd-ee94e6f94fe2 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:50.484959 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ecc32-0e63-4f0f-8bdd-ee94e6f94fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:50.485229 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ecc32-0e63-4f0f-8bdd-ee94e6f94fe2 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:50.486011 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4ecc32-0e63-4f0f-8bdd-ee94e6f94fe2 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:50.487710 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4ecc32-0e63-4f0f-8bdd-ee94e6f94fe2 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:50.524760 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 462/930] 10.222.0.43 () {60 vars in 1165 bytes} [Fri Dec 24 04:47:50 2021] POST /identity/v3/endpoints => generated 347 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 04:47:51.089153 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141435f-8923-4abd-a252-9f79497f47f5 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:51.089534 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141435f-8923-4abd-a252-9f79497f47f5 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:51.089703 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141435f-8923-4abd-a252-9f79497f47f5 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:51.092138 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 469/931] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:51.097560 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6249b85-415d-4d85-a82d-2e435d245e47 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:51.097854 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6249b85-415d-4d85-a82d-2e435d245e47 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:51.098136 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6249b85-415d-4d85-a82d-2e435d245e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:51.116130 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-d6249b85-415d-4d85-a82d-2e435d245e47 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:51.117357 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-d6249b85-415d-4d85-a82d-2e435d245e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:51.134474 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 463/932] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:51 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 04:47:51.159773 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d141435f-8923-4abd-a252-9f79497f47f5 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:51.172211 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d141435f-8923-4abd-a252-9f79497f47f5 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:51.176654 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0321dc32-4f5b-432b-b9a7-91f55cd8592a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:51.177503 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321dc32-4f5b-432b-b9a7-91f55cd8592a admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:51.177788 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321dc32-4f5b-432b-b9a7-91f55cd8592a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:51.178059 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321dc32-4f5b-432b-b9a7-91f55cd8592a admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:51.189107 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0321dc32-4f5b-432b-b9a7-91f55cd8592a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:47:51.196444 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-0321dc32-4f5b-432b-b9a7-91f55cd8592a admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 24 04:47:51.197938 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 470/933] 10.222.0.43 () {56 vars in 1141 bytes} [Fri Dec 24 04:47:51 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:51.204486 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6249b85-415d-4d85-a82d-2e435d245e47 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:51.213810 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6249b85-415d-4d85-a82d-2e435d245e47 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:51.218578 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ffd412-235c-4cc7-a515-ccb9943ff4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:51.219237 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ffd412-235c-4cc7-a515-ccb9943ff4b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:51.219519 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ffd412-235c-4cc7-a515-ccb9943ff4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:51.219797 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ffd412-235c-4cc7-a515-ccb9943ff4b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:51.220602 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ffd412-235c-4cc7-a515-ccb9943ff4b8 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:51.220913 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ffd412-235c-4cc7-a515-ccb9943ff4b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:51.222524 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ffd412-235c-4cc7-a515-ccb9943ff4b8 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:51.231322 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 464/934] 10.222.0.43 () {56 vars in 1136 bytes} [Fri Dec 24 04:47:51 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:51.237584 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0321dc32-4f5b-432b-b9a7-91f55cd8592a admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:51.247634 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0321dc32-4f5b-432b-b9a7-91f55cd8592a admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:51.252265 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8206a083-7646-47c1-b62d-c6f86a8305a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:51.253137 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206a083-7646-47c1-b62d-c6f86a8305a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:51.253420 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206a083-7646-47c1-b62d-c6f86a8305a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:51.253745 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206a083-7646-47c1-b62d-c6f86a8305a2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:51.264351 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8206a083-7646-47c1-b62d-c6f86a8305a2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:51.266215 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8206a083-7646-47c1-b62d-c6f86a8305a2 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:51.283689 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-8206a083-7646-47c1-b62d-c6f86a8305a2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:47:51.285235 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 471/935] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:51.291414 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ffd412-235c-4cc7-a515-ccb9943ff4b8 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:51.301557 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ffd412-235c-4cc7-a515-ccb9943ff4b8 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:51.306181 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1b7a4-fcfe-4136-a92d-7b9077d496af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:51.306847 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1b7a4-fcfe-4136-a92d-7b9077d496af admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:51.307131 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1b7a4-fcfe-4136-a92d-7b9077d496af admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:51.307410 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1b7a4-fcfe-4136-a92d-7b9077d496af admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:51.308163 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e1b7a4-fcfe-4136-a92d-7b9077d496af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:51.308470 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e1b7a4-fcfe-4136-a92d-7b9077d496af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:51.310722 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e1b7a4-fcfe-4136-a92d-7b9077d496af admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:51.323629 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 465/936] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:47:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:51.329763 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8206a083-7646-47c1-b62d-c6f86a8305a2 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:51.340053 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8206a083-7646-47c1-b62d-c6f86a8305a2 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:51.344830 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6dcd8a-af73-4ce3-bd11-e32a048c3275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:51.345645 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6dcd8a-af73-4ce3-bd11-e32a048c3275 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:51.345926 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6dcd8a-af73-4ce3-bd11-e32a048c3275 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:51.346203 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6dcd8a-af73-4ce3-bd11-e32a048c3275 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:51.354060 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6dcd8a-af73-4ce3-bd11-e32a048c3275 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:51.356325 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6dcd8a-af73-4ce3-bd11-e32a048c3275 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:51.370772 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-ba6dcd8a-af73-4ce3-bd11-e32a048c3275 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 24 04:47:51.372520 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 472/937] 10.222.0.43 () {56 vars in 1138 bytes} [Fri Dec 24 04:47:51 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:51.378724 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1b7a4-fcfe-4136-a92d-7b9077d496af admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:51.388798 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1b7a4-fcfe-4136-a92d-7b9077d496af admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:51.393427 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a47ba00-16a3-4799-b10f-48eeaa5a832f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:51.394092 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47ba00-16a3-4799-b10f-48eeaa5a832f admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:51.394372 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47ba00-16a3-4799-b10f-48eeaa5a832f admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:51.394646 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47ba00-16a3-4799-b10f-48eeaa5a832f admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:51.395505 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a47ba00-16a3-4799-b10f-48eeaa5a832f admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:51.395871 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a47ba00-16a3-4799-b10f-48eeaa5a832f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:51.397831 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a47ba00-16a3-4799-b10f-48eeaa5a832f admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:51.416175 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 466/938] 10.222.0.43 () {56 vars in 1170 bytes} [Fri Dec 24 04:47:51 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:51.422254 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6dcd8a-af73-4ce3-bd11-e32a048c3275 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:51.433401 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6dcd8a-af73-4ce3-bd11-e32a048c3275 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:51.438445 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a3b67e-c780-495d-a306-148a95b7aa13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:51.439091 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a3b67e-c780-495d-a306-148a95b7aa13 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:51.439523 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a3b67e-c780-495d-a306-148a95b7aa13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:51.439785 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a3b67e-c780-495d-a306-148a95b7aa13 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:51.448303 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a3b67e-c780-495d-a306-148a95b7aa13 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:51.450190 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a3b67e-c780-495d-a306-148a95b7aa13 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:51.460331 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 473/939] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:47:51 2021] GET /identity/v3/auth/tokens => generated 1952 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:47:51.466242 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a47ba00-16a3-4799-b10f-48eeaa5a832f admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:51.478170 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a47ba00-16a3-4799-b10f-48eeaa5a832f admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:51.483371 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8cb73-ea6b-42a2-bbbf-6dce32efa0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:51.484469 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8cb73-ea6b-42a2-bbbf-6dce32efa0d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:51.484980 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8cb73-ea6b-42a2-bbbf-6dce32efa0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:51.485450 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8cb73-ea6b-42a2-bbbf-6dce32efa0d4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:51.496456 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b8cb73-ea6b-42a2-bbbf-6dce32efa0d4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:51.498847 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b8cb73-ea6b-42a2-bbbf-6dce32efa0d4 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:51.518288 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-d5b8cb73-ea6b-42a2-bbbf-6dce32efa0d4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:47:51.520239 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 467/940] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:51.526902 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a3b67e-c780-495d-a306-148a95b7aa13 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:51.537403 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a3b67e-c780-495d-a306-148a95b7aa13 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:51.543016 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9910230-fe47-4d0a-a644-4cee5e704095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:51.544746 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9910230-fe47-4d0a-a644-4cee5e704095 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:51.545240 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9910230-fe47-4d0a-a644-4cee5e704095 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:51.545712 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9910230-fe47-4d0a-a644-4cee5e704095 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:51.546722 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9910230-fe47-4d0a-a644-4cee5e704095 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:51.547269 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9910230-fe47-4d0a-a644-4cee5e704095 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:51.549150 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9910230-fe47-4d0a-a644-4cee5e704095 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:51.562427 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 474/941] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:47:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:51.568809 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8cb73-ea6b-42a2-bbbf-6dce32efa0d4 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:51.579880 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8cb73-ea6b-42a2-bbbf-6dce32efa0d4 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:51.585258 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bcc3ab-1a81-44a4-bcd4-b1de8fc14c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:51.586267 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bcc3ab-1a81-44a4-bcd4-b1de8fc14c0e admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:51.586800 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bcc3ab-1a81-44a4-bcd4-b1de8fc14c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:51.587266 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bcc3ab-1a81-44a4-bcd4-b1de8fc14c0e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:51.595600 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bcc3ab-1a81-44a4-bcd4-b1de8fc14c0e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:51.597883 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bcc3ab-1a81-44a4-bcd4-b1de8fc14c0e admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:51.613453 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-04bcc3ab-1a81-44a4-bcd4-b1de8fc14c0e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 24 04:47:51.615329 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 468/942] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Dec 24 04:47:51 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:51.622014 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9910230-fe47-4d0a-a644-4cee5e704095 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:51.632501 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9910230-fe47-4d0a-a644-4cee5e704095 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:51.638108 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b3de8-7f2f-4ea6-8754-081577e387dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:51.639092 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b3de8-7f2f-4ea6-8754-081577e387dd admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:51.639574 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b3de8-7f2f-4ea6-8754-081577e387dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:51.640104 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b3de8-7f2f-4ea6-8754-081577e387dd admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:51.641148 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93b3de8-7f2f-4ea6-8754-081577e387dd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:51.641661 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93b3de8-7f2f-4ea6-8754-081577e387dd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:51.643806 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93b3de8-7f2f-4ea6-8754-081577e387dd admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:51.659824 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 475/943] 10.222.0.43 () {56 vars in 1169 bytes} [Fri Dec 24 04:47:51 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:51.666638 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bcc3ab-1a81-44a4-bcd4-b1de8fc14c0e admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:51.679031 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bcc3ab-1a81-44a4-bcd4-b1de8fc14c0e admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:51.684023 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb9fab-dee8-4ea9-9a96-02f38332c49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:51.685493 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb9fab-dee8-4ea9-9a96-02f38332c49a admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:51.686035 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb9fab-dee8-4ea9-9a96-02f38332c49a admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:51.686516 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb9fab-dee8-4ea9-9a96-02f38332c49a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:51.687592 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdb9fab-dee8-4ea9-9a96-02f38332c49a admin admin] RBAC: Adding query filter params (role.id=687cef9f2c0040bc9e427ac01fd7a65c, scope.project.id=c19ba4a2c0224c079c5a8a6a56569fd6, user.id=3d0ee2c830754741b0f9eedabf6bded8) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:51.688113 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdb9fab-dee8-4ea9-9a96-02f38332c49a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:51.690254 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdb9fab-dee8-4ea9-9a96-02f38332c49a admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:51.697253 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 469/944] 10.222.0.43 () {56 vars in 1395 bytes} [Fri Dec 24 04:47:51 2021] GET /identity/v3/role_assignments?user.id=3d0ee2c830754741b0f9eedabf6bded8&scope.project.id=c19ba4a2c0224c079c5a8a6a56569fd6&role.id=687cef9f2c0040bc9e427ac01fd7a65c => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:51.926013 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f6e2a-35a3-4383-b3dc-fc6ad35888b7 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:51.926358 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f6e2a-35a3-4383-b3dc-fc6ad35888b7 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:51.926539 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f6e2a-35a3-4383-b3dc-fc6ad35888b7 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:51.928390 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 476/945] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:51.934723 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d86e0-2d00-4fdd-ab70-e7ccd666644c None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:51.935002 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d86e0-2d00-4fdd-ab70-e7ccd666644c None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:51.935276 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d86e0-2d00-4fdd-ab70-e7ccd666644c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:51.953832 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-464d86e0-2d00-4fdd-ab70-e7ccd666644c None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:51.955060 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-464d86e0-2d00-4fdd-ab70-e7ccd666644c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:51.963575 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 470/946] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:51 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:47:51.987449 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f6e2a-35a3-4383-b3dc-fc6ad35888b7 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:52.000273 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f6e2a-35a3-4383-b3dc-fc6ad35888b7 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:52.004742 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4c88d-9632-4cc6-9b1b-bae99f9ca874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:52.005546 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4c88d-9632-4cc6-9b1b-bae99f9ca874 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:52.005829 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4c88d-9632-4cc6-9b1b-bae99f9ca874 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:52.006101 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4c88d-9632-4cc6-9b1b-bae99f9ca874 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:52.006775 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d4c88d-9632-4cc6-9b1b-bae99f9ca874 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:52.008382 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d4c88d-9632-4cc6-9b1b-bae99f9ca874 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:52.020056 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-36d4c88d-9632-4cc6-9b1b-bae99f9ca874 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 24 04:47:52.021570 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 477/947] 10.222.0.43 () {56 vars in 1147 bytes} [Fri Dec 24 04:47:51 2021] GET /identity/v3/services/object-store => generated 93 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:52.028368 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d86e0-2d00-4fdd-ab70-e7ccd666644c None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:52.037858 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d86e0-2d00-4fdd-ab70-e7ccd666644c None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:52.042834 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90809dc-771e-4a3a-b6c0-1300a3a6c2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:52.043593 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90809dc-771e-4a3a-b6c0-1300a3a6c2ef admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:52.043881 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90809dc-771e-4a3a-b6c0-1300a3a6c2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:52.044199 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90809dc-771e-4a3a-b6c0-1300a3a6c2ef admin admin] PATH_INFO: `/v3/services` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:52.045026 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90809dc-771e-4a3a-b6c0-1300a3a6c2ef admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:52.045338 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90809dc-771e-4a3a-b6c0-1300a3a6c2ef admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:52.047009 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90809dc-771e-4a3a-b6c0-1300a3a6c2ef admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:52.052194 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 471/948] 10.222.0.43 () {56 vars in 1143 bytes} [Fri Dec 24 04:47:52 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:52.058427 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4c88d-9632-4cc6-9b1b-bae99f9ca874 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:52.068280 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4c88d-9632-4cc6-9b1b-bae99f9ca874 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:52.072936 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811f3177-df27-48cd-b852-497a8eb75a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:52.073590 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f3177-df27-48cd-b852-497a8eb75a25 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:52.073874 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f3177-df27-48cd-b852-497a8eb75a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:52.074151 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f3177-df27-48cd-b852-497a8eb75a25 admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:52.074922 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811f3177-df27-48cd-b852-497a8eb75a25 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:52.075412 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811f3177-df27-48cd-b852-497a8eb75a25 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:52.077096 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811f3177-df27-48cd-b852-497a8eb75a25 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:52.082354 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 478/949] 10.222.0.43 () {56 vars in 1143 bytes} [Fri Dec 24 04:47:52 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:52.088981 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90809dc-771e-4a3a-b6c0-1300a3a6c2ef admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:52.098882 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90809dc-771e-4a3a-b6c0-1300a3a6c2ef admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:52.103478 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fb92e5-6a48-49b1-ac38-ffcfbe3f07fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:52.104177 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb92e5-6a48-49b1-ac38-ffcfbe3f07fe admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:52.104463 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb92e5-6a48-49b1-ac38-ffcfbe3f07fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:52.104790 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb92e5-6a48-49b1-ac38-ffcfbe3f07fe admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:52.105593 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fb92e5-6a48-49b1-ac38-ffcfbe3f07fe admin admin] RBAC: Adding query filter params (interface=public, service_id=ee01ac57d9fc47e8aef80591452c8022, region_id=RegionOne) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:52.106021 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fb92e5-6a48-49b1-ac38-ffcfbe3f07fe admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:52.107841 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fb92e5-6a48-49b1-ac38-ffcfbe3f07fe admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:52.113581 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 472/950] 10.222.0.43 () {56 vars in 1272 bytes} [Fri Dec 24 04:47:52 2021] GET /identity/v3/endpoints?service_id=ee01ac57d9fc47e8aef80591452c8022&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:52.119760 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811f3177-df27-48cd-b852-497a8eb75a25 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:52.129744 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811f3177-df27-48cd-b852-497a8eb75a25 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:52.134387 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ed2b3-df62-4884-a466-06978f8fa74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:52.135040 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ed2b3-df62-4884-a466-06978f8fa74a admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:52.135322 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ed2b3-df62-4884-a466-06978f8fa74a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:52.135598 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ed2b3-df62-4884-a466-06978f8fa74a admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:52.136298 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896ed2b3-df62-4884-a466-06978f8fa74a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:52.138060 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896ed2b3-df62-4884-a466-06978f8fa74a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:52.144555 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 479/951] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Dec 24 04:47:52 2021] GET /identity/v3/services => generated 1497 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 04:47:52.890370 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442ebec-69d1-4682-a457-e99099f0e997 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:52.891084 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442ebec-69d1-4682-a457-e99099f0e997 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:52.891084 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442ebec-69d1-4682-a457-e99099f0e997 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:52.892959 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 473/952] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:52.899016 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e864e8-088f-46cc-bc45-d61845388d6a None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:52.899562 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e864e8-088f-46cc-bc45-d61845388d6a None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:52.899562 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e864e8-088f-46cc-bc45-d61845388d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:52.918521 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-b4e864e8-088f-46cc-bc45-d61845388d6a None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:52.919754 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-b4e864e8-088f-46cc-bc45-d61845388d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:52.928061 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 480/953] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:52 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:47:52.951804 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5442ebec-69d1-4682-a457-e99099f0e997 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:52.964477 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5442ebec-69d1-4682-a457-e99099f0e997 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:52.969036 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37922f7f-5a17-4277-af69-fc9cf3d1eb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:52.969830 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37922f7f-5a17-4277-af69-fc9cf3d1eb41 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:52.970103 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37922f7f-5a17-4277-af69-fc9cf3d1eb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:52.970370 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37922f7f-5a17-4277-af69-fc9cf3d1eb41 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:52.971045 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37922f7f-5a17-4277-af69-fc9cf3d1eb41 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:52.972684 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37922f7f-5a17-4277-af69-fc9cf3d1eb41 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:52.983903 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-37922f7f-5a17-4277-af69-fc9cf3d1eb41 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Dec 24 04:47:52.985407 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 474/954] 10.222.0.43 () {56 vars in 1135 bytes} [Fri Dec 24 04:47:52 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:47:52.991720 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e864e8-088f-46cc-bc45-d61845388d6a None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:53.001116 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e864e8-088f-46cc-bc45-d61845388d6a None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:53.005705 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf53134e-5621-4490-95eb-9494a55f2e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:53.006374 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53134e-5621-4490-95eb-9494a55f2e35 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:53.006655 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53134e-5621-4490-95eb-9494a55f2e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:53.006929 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53134e-5621-4490-95eb-9494a55f2e35 admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:53.007657 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf53134e-5621-4490-95eb-9494a55f2e35 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:53.007963 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf53134e-5621-4490-95eb-9494a55f2e35 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:53.009608 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf53134e-5621-4490-95eb-9494a55f2e35 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:53.014855 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 481/955] 10.222.0.43 () {56 vars in 1135 bytes} [Fri Dec 24 04:47:52 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:53.020958 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37922f7f-5a17-4277-af69-fc9cf3d1eb41 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:53.030918 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37922f7f-5a17-4277-af69-fc9cf3d1eb41 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:53.035166 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a598c-bb09-44d7-93db-00ae5432739e None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:53.035452 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a598c-bb09-44d7-93db-00ae5432739e None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:53.035728 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a598c-bb09-44d7-93db-00ae5432739e None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:53.037857 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 482/956] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 24 04:47:53.039294 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a678665-ff01-4063-88c4-b14f4d162563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:53.040197 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a678665-ff01-4063-88c4-b14f4d162563 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:53.040722 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a678665-ff01-4063-88c4-b14f4d162563 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:53.041195 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a678665-ff01-4063-88c4-b14f4d162563 admin admin] PATH_INFO: `/v3/services` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:53.042430 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a678665-ff01-4063-88c4-b14f4d162563 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:53.042938 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a678665-ff01-4063-88c4-b14f4d162563 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:53.043630 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fbd892-798a-4f82-ab37-a26cc461672d None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:53.043933 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fbd892-798a-4f82-ab37-a26cc461672d None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:53.044212 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fbd892-798a-4f82-ab37-a26cc461672d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:53.045547 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a678665-ff01-4063-88c4-b14f4d162563 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:53.051319 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 475/957] 10.222.0.43 () {56 vars in 1135 bytes} [Fri Dec 24 04:47:53 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:53.057326 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a678665-ff01-4063-88c4-b14f4d162563 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:53.063973 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-b2fbd892-798a-4f82-ab37-a26cc461672d None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:53.065505 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-b2fbd892-798a-4f82-ab37-a26cc461672d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:53.067624 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a678665-ff01-4063-88c4-b14f4d162563 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:53.072682 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a08ab-6888-4cc9-b7d3-a574df08da48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:53.080544 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 483/958] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:53 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:47:53.080679 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a08ab-6888-4cc9-b7d3-a574df08da48 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:53.080679 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a08ab-6888-4cc9-b7d3-a574df08da48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:53.080679 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a08ab-6888-4cc9-b7d3-a574df08da48 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:53.080679 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5a08ab-6888-4cc9-b7d3-a574df08da48 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:53.080679 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5a08ab-6888-4cc9-b7d3-a574df08da48 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:53.098534 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fbd892-798a-4f82-ab37-a26cc461672d None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:53.101917 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 476/959] 10.222.0.43 () {60 vars in 1165 bytes} [Fri Dec 24 04:47:53 2021] POST /identity/v3/endpoints => generated 346 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 04:47:53.110886 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fbd892-798a-4f82-ab37-a26cc461672d None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:53.126399 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57fb03-876f-4699-9263-11bb5b72002b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:53.127565 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57fb03-876f-4699-9263-11bb5b72002b admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:53.128019 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57fb03-876f-4699-9263-11bb5b72002b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:53.128461 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57fb03-876f-4699-9263-11bb5b72002b admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:53.129479 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad57fb03-876f-4699-9263-11bb5b72002b admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:53.131376 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad57fb03-876f-4699-9263-11bb5b72002b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:53.144092 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-ad57fb03-876f-4699-9263-11bb5b72002b admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Dec 24 04:47:53.146087 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 484/960] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Dec 24 04:47:53 2021] GET /identity/v3/services/compute => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:53.152969 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a08ab-6888-4cc9-b7d3-a574df08da48 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:53.164301 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a08ab-6888-4cc9-b7d3-a574df08da48 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:53.169771 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dedcda-882d-494a-9a37-408559da54c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:53.170814 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dedcda-882d-494a-9a37-408559da54c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:53.171300 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dedcda-882d-494a-9a37-408559da54c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:53.171747 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dedcda-882d-494a-9a37-408559da54c8 admin admin] PATH_INFO: `/v3/services` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:53.172771 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dedcda-882d-494a-9a37-408559da54c8 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:53.173262 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dedcda-882d-494a-9a37-408559da54c8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:53.175108 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dedcda-882d-494a-9a37-408559da54c8 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:53.181213 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 477/961] 10.222.0.43 () {56 vars in 1133 bytes} [Fri Dec 24 04:47:53 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:53.188160 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57fb03-876f-4699-9263-11bb5b72002b admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:53.199057 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57fb03-876f-4699-9263-11bb5b72002b admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:53.204387 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b2bca-0ef4-4ee3-8b19-309a27ab2fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:53.205407 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b2bca-0ef4-4ee3-8b19-309a27ab2fbb admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:53.205910 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b2bca-0ef4-4ee3-8b19-309a27ab2fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:53.206355 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b2bca-0ef4-4ee3-8b19-309a27ab2fbb admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:53.207917 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8b2bca-0ef4-4ee3-8b19-309a27ab2fbb admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:53.208418 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8b2bca-0ef4-4ee3-8b19-309a27ab2fbb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:53.210750 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8b2bca-0ef4-4ee3-8b19-309a27ab2fbb admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:53.217602 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 485/962] 10.222.0.43 () {56 vars in 1133 bytes} [Fri Dec 24 04:47:53 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:54.144042 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184f3b3-7b6e-44d4-ba84-274f1f949461 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:54.144612 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184f3b3-7b6e-44d4-ba84-274f1f949461 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:54.144612 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184f3b3-7b6e-44d4-ba84-274f1f949461 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:54.146730 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 478/963] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:54.153328 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b5f0f-5404-4250-bc35-1a7863cd13ea None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:54.153857 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b5f0f-5404-4250-bc35-1a7863cd13ea None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:54.153857 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b5f0f-5404-4250-bc35-1a7863cd13ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:54.173117 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-442b5f0f-5404-4250-bc35-1a7863cd13ea None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:54.174304 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-442b5f0f-5404-4250-bc35-1a7863cd13ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:54.182423 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 486/964] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:54 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 04:47:54.205372 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184f3b3-7b6e-44d4-ba84-274f1f949461 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:54.218545 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184f3b3-7b6e-44d4-ba84-274f1f949461 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:54.223190 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d97adc8-27cb-4e0e-a5ca-46fa9f71acfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:54.223974 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97adc8-27cb-4e0e-a5ca-46fa9f71acfe admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:54.224251 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97adc8-27cb-4e0e-a5ca-46fa9f71acfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:54.224542 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97adc8-27cb-4e0e-a5ca-46fa9f71acfe admin admin] PATH_INFO: `/v3/services/image` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:54.225227 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d97adc8-27cb-4e0e-a5ca-46fa9f71acfe admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:54.226829 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d97adc8-27cb-4e0e-a5ca-46fa9f71acfe admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:54.237982 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-5d97adc8-27cb-4e0e-a5ca-46fa9f71acfe admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Dec 24 04:47:54.239450 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 479/965] 10.222.0.43 () {56 vars in 1126 bytes} [Fri Dec 24 04:47:54 2021] GET /identity/v3/services/image => generated 86 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:54.245805 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442b5f0f-5404-4250-bc35-1a7863cd13ea None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:54.255379 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442b5f0f-5404-4250-bc35-1a7863cd13ea None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:54.259980 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d02ac8f-96ee-40d0-bcbb-c7aa1d211c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:54.260672 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02ac8f-96ee-40d0-bcbb-c7aa1d211c21 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:54.260950 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02ac8f-96ee-40d0-bcbb-c7aa1d211c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:54.261217 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02ac8f-96ee-40d0-bcbb-c7aa1d211c21 admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:54.262157 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d02ac8f-96ee-40d0-bcbb-c7aa1d211c21 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:54.262753 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d02ac8f-96ee-40d0-bcbb-c7aa1d211c21 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:54.264383 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d02ac8f-96ee-40d0-bcbb-c7aa1d211c21 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:54.269905 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 487/966] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:54 2021] GET /identity/v3/services?name=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:54.276006 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d97adc8-27cb-4e0e-a5ca-46fa9f71acfe admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:54.285843 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d97adc8-27cb-4e0e-a5ca-46fa9f71acfe admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:54.290741 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c2c99e-7d8a-4fa8-ad54-bf8b898123bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:54.291393 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2c99e-7d8a-4fa8-ad54-bf8b898123bd admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:54.291671 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2c99e-7d8a-4fa8-ad54-bf8b898123bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:54.291938 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2c99e-7d8a-4fa8-ad54-bf8b898123bd admin admin] PATH_INFO: `/v3/services` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:54.292692 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c2c99e-7d8a-4fa8-ad54-bf8b898123bd admin admin] RBAC: Adding query filter params (type=image) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:54.292992 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c2c99e-7d8a-4fa8-ad54-bf8b898123bd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:54.294735 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c2c99e-7d8a-4fa8-ad54-bf8b898123bd admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:54.299677 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 480/967] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:54 2021] GET /identity/v3/services?type=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:54.566004 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7366f2-fcd1-4f75-b762-b6dc7b55b812 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:54.566373 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7366f2-fcd1-4f75-b762-b6dc7b55b812 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:54.566539 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7366f2-fcd1-4f75-b762-b6dc7b55b812 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:54.568586 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 488/968] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:54.574529 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771748e7-af5e-48d4-bba4-44e25f286b5e None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:54.574822 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771748e7-af5e-48d4-bba4-44e25f286b5e None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:54.575105 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771748e7-af5e-48d4-bba4-44e25f286b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:54.593552 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-771748e7-af5e-48d4-bba4-44e25f286b5e None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:54.594747 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-771748e7-af5e-48d4-bba4-44e25f286b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:54.602796 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 481/969] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:54 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:47:54.627469 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7366f2-fcd1-4f75-b762-b6dc7b55b812 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:54.642262 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7366f2-fcd1-4f75-b762-b6dc7b55b812 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:54.646923 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426c1be-029d-4ca5-bc70-1dca36ab058d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:54.647721 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426c1be-029d-4ca5-bc70-1dca36ab058d admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:54.648002 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426c1be-029d-4ca5-bc70-1dca36ab058d admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:54.648275 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426c1be-029d-4ca5-bc70-1dca36ab058d admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:54.649044 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3426c1be-029d-4ca5-bc70-1dca36ab058d admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:54.651005 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3426c1be-029d-4ca5-bc70-1dca36ab058d admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:54.663270 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-3426c1be-029d-4ca5-bc70-1dca36ab058d admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 24 04:47:54.664462 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 489/970] 10.222.0.43 () {56 vars in 1147 bytes} [Fri Dec 24 04:47:54 2021] GET /identity/v3/services/object-store => generated 93 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:54.671434 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771748e7-af5e-48d4-bba4-44e25f286b5e None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:54.680643 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771748e7-af5e-48d4-bba4-44e25f286b5e None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:54.685489 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c31e74-6a17-4249-b169-7ffa5e4df350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:54.686142 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c31e74-6a17-4249-b169-7ffa5e4df350 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:54.686410 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c31e74-6a17-4249-b169-7ffa5e4df350 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:54.686683 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c31e74-6a17-4249-b169-7ffa5e4df350 admin admin] PATH_INFO: `/v3/services` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:54.687420 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c31e74-6a17-4249-b169-7ffa5e4df350 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:54.687726 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c31e74-6a17-4249-b169-7ffa5e4df350 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:54.689379 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c31e74-6a17-4249-b169-7ffa5e4df350 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:54.694728 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 482/971] 10.222.0.43 () {56 vars in 1143 bytes} [Fri Dec 24 04:47:54 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:54.701027 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426c1be-029d-4ca5-bc70-1dca36ab058d admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:54.711133 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426c1be-029d-4ca5-bc70-1dca36ab058d admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:54.716084 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11847803-2caf-405b-b4f4-3241895cede9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:54.716776 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11847803-2caf-405b-b4f4-3241895cede9 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:54.717105 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11847803-2caf-405b-b4f4-3241895cede9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:54.717387 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11847803-2caf-405b-b4f4-3241895cede9 admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:54.718124 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11847803-2caf-405b-b4f4-3241895cede9 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:54.718431 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11847803-2caf-405b-b4f4-3241895cede9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:54.720048 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11847803-2caf-405b-b4f4-3241895cede9 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:54.725554 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 490/972] 10.222.0.43 () {56 vars in 1143 bytes} [Fri Dec 24 04:47:54 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:54.731849 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c31e74-6a17-4249-b169-7ffa5e4df350 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:54.741688 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c31e74-6a17-4249-b169-7ffa5e4df350 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:54.746527 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc63e4d-6ae3-4533-8a14-91fe37954fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:54.747378 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc63e4d-6ae3-4533-8a14-91fe37954fa2 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:54.747663 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc63e4d-6ae3-4533-8a14-91fe37954fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:54.747990 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc63e4d-6ae3-4533-8a14-91fe37954fa2 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:54.749074 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc63e4d-6ae3-4533-8a14-91fe37954fa2 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:54.750618 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc63e4d-6ae3-4533-8a14-91fe37954fa2 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:54.774922 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 483/973] 10.222.0.43 () {60 vars in 1165 bytes} [Fri Dec 24 04:47:54 2021] POST /identity/v3/endpoints => generated 349 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 04:47:55.594303 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799feaa-0693-41b4-89df-c9b9709bcc83 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:55.594997 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799feaa-0693-41b4-89df-c9b9709bcc83 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:55.594997 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799feaa-0693-41b4-89df-c9b9709bcc83 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:55.596852 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 491/974] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:55.602768 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd86727-67c2-4d91-b4fe-3e5533ecd8f2 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:55.603267 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd86727-67c2-4d91-b4fe-3e5533ecd8f2 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:55.603420 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd86727-67c2-4d91-b4fe-3e5533ecd8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:55.621564 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-6fd86727-67c2-4d91-b4fe-3e5533ecd8f2 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:55.622765 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-6fd86727-67c2-4d91-b4fe-3e5533ecd8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:55.640823 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 484/975] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:55 2021] POST /identity/v3/auth/tokens => generated 2327 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:47:55.648723 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897ec39-97f9-46c8-9244-e414ae83e610 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:55.648723 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897ec39-97f9-46c8-9244-e414ae83e610 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:55.648723 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897ec39-97f9-46c8-9244-e414ae83e610 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:55.648723 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 492/976] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:55.657578 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605581a-3706-413e-ba04-7997e5e038eb None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:55.657578 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605581a-3706-413e-ba04-7997e5e038eb None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:55.657578 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605581a-3706-413e-ba04-7997e5e038eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:55.664635 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897ec39-97f9-46c8-9244-e414ae83e610 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:55.675285 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-7605581a-3706-413e-ba04-7997e5e038eb None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:55.676788 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-7605581a-3706-413e-ba04-7997e5e038eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:55.676971 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897ec39-97f9-46c8-9244-e414ae83e610 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:55.682031 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad9ccd5-b06b-459f-954c-4439eca84c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:55.682686 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9ccd5-b06b-459f-954c-4439eca84c33 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:55.682969 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9ccd5-b06b-459f-954c-4439eca84c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:55.683248 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9ccd5-b06b-459f-954c-4439eca84c33 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:55.684149 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad9ccd5-b06b-459f-954c-4439eca84c33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:55.686348 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad9ccd5-b06b-459f-954c-4439eca84c33 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:55.686991 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 485/977] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:55 2021] POST /identity/v3/auth/tokens => generated 2327 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:47:55.692615 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.common [None req-7ad9ccd5-b06b-459f-954c-4439eca84c33 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Dec 24 04:47:55.710861 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.sql.core [None req-7ad9ccd5-b06b-459f-954c-4439eca84c33 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Dec 24 04:47:55.710861 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Dec 24 04:47:55.710861 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [parameters: {'id': '40b7f9af99344f2887acf703c4b03e18', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Dec 24 04:47:55.710861 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79113) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Dec 24 04:47:55.712207 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7605581a-3706-413e-ba04-7997e5e038eb None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:55.718287 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-7ad9ccd5-b06b-459f-954c-4439eca84c33 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 40b7f9af99344f2887acf703c4b03e18.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 40b7f9af99344f2887acf703c4b03e18. Dec 24 04:47:55.719847 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 493/978] 10.222.0.43 () {60 vars in 1161 bytes} [Fri Dec 24 04:47:55 2021] POST /identity/v3/projects => generated 262 bytes in 56 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:47:55.722445 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7605581a-3706-413e-ba04-7997e5e038eb None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:55.726626 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad9ccd5-b06b-459f-954c-4439eca84c33 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:55.729269 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d13e3e4-084f-4ba6-a74e-6c3236db7cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:55.730188 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d13e3e4-084f-4ba6-a74e-6c3236db7cb6 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:55.730742 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d13e3e4-084f-4ba6-a74e-6c3236db7cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:55.731220 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d13e3e4-084f-4ba6-a74e-6c3236db7cb6 admin admin] PATH_INFO: `/v3/services` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:55.732222 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d13e3e4-084f-4ba6-a74e-6c3236db7cb6 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:55.734193 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d13e3e4-084f-4ba6-a74e-6c3236db7cb6 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:55.737802 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad9ccd5-b06b-459f-954c-4439eca84c33 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:55.743299 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdce778-b43f-40fa-bea2-2191cf623d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:55.744136 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdce778-b43f-40fa-bea2-2191cf623d31 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:55.744423 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdce778-b43f-40fa-bea2-2191cf623d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:55.744728 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdce778-b43f-40fa-bea2-2191cf623d31 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:55.752357 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdce778-b43f-40fa-bea2-2191cf623d31 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:55.753361 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 486/979] 10.222.0.43 () {60 vars in 1162 bytes} [Fri Dec 24 04:47:55 2021] POST /identity/v3/services => generated 242 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 04:47:55.756566 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdce778-b43f-40fa-bea2-2191cf623d31 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:55.776557 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-4fdce778-b43f-40fa-bea2-2191cf623d31 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 24 04:47:55.782827 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 494/980] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Dec 24 04:47:55 2021] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:47:55.786341 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d13e3e4-084f-4ba6-a74e-6c3236db7cb6 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:55.807621 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d13e3e4-084f-4ba6-a74e-6c3236db7cb6 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:55.813153 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21725a8c-dc07-4d90-b587-c0a3fbae0527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:55.814157 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21725a8c-dc07-4d90-b587-c0a3fbae0527 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:55.814629 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21725a8c-dc07-4d90-b587-c0a3fbae0527 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:55.815091 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21725a8c-dc07-4d90-b587-c0a3fbae0527 admin admin] PATH_INFO: `/v3/projects` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:55.816031 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21725a8c-dc07-4d90-b587-c0a3fbae0527 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:55.816488 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21725a8c-dc07-4d90-b587-c0a3fbae0527 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:55.818730 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21725a8c-dc07-4d90-b587-c0a3fbae0527 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:55.844785 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 487/981] 10.222.0.43 () {56 vars in 1133 bytes} [Fri Dec 24 04:47:55 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:56.636611 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7472de0-50cc-44fe-85d3-88f7b327e0ed None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:56.637157 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7472de0-50cc-44fe-85d3-88f7b327e0ed None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:56.637157 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7472de0-50cc-44fe-85d3-88f7b327e0ed None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:56.641890 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 495/982] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:56 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:56.648008 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713674e0-a79b-43d3-b741-fa08f12d5368 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:56.648890 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713674e0-a79b-43d3-b741-fa08f12d5368 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:56.649361 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713674e0-a79b-43d3-b741-fa08f12d5368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:56.669054 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-713674e0-a79b-43d3-b741-fa08f12d5368 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:56.670584 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-713674e0-a79b-43d3-b741-fa08f12d5368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:56.678846 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 488/983] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:56 2021] POST /identity/v3/auth/tokens => generated 2423 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 04:47:56.706225 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7472de0-50cc-44fe-85d3-88f7b327e0ed None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:56.719748 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7472de0-50cc-44fe-85d3-88f7b327e0ed None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:56.724458 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07f48e-8a8b-4c98-be04-a11047c3ba44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:56.725378 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07f48e-8a8b-4c98-be04-a11047c3ba44 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:56.725849 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07f48e-8a8b-4c98-be04-a11047c3ba44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:56.726327 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07f48e-8a8b-4c98-be04-a11047c3ba44 admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:56.727318 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07f48e-8a8b-4c98-be04-a11047c3ba44 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:56.729241 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07f48e-8a8b-4c98-be04-a11047c3ba44 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:56.745250 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 496/984] 10.222.0.43 () {60 vars in 1162 bytes} [Fri Dec 24 04:47:56 2021] POST /identity/v3/services => generated 242 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:47:57.288557 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473479c-d71a-47ec-8b91-a22870a3f4bd None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:57.288557 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473479c-d71a-47ec-8b91-a22870a3f4bd None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:57.288557 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473479c-d71a-47ec-8b91-a22870a3f4bd None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:57.289858 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 489/985] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:57.296410 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a680f-4d1b-47c1-a0be-ed35d9f75e4f None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:57.296997 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a680f-4d1b-47c1-a0be-ed35d9f75e4f None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:57.297485 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a680f-4d1b-47c1-a0be-ed35d9f75e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:57.318359 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-709a680f-4d1b-47c1-a0be-ed35d9f75e4f None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:57.320131 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-709a680f-4d1b-47c1-a0be-ed35d9f75e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:57.338969 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 497/986] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:57 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 04:47:57.362237 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473479c-d71a-47ec-8b91-a22870a3f4bd None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:57.374948 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473479c-d71a-47ec-8b91-a22870a3f4bd None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:57.379425 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea61e8-a338-43f9-afba-4d37283c3e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:57.380228 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea61e8-a338-43f9-afba-4d37283c3e81 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:57.380515 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea61e8-a338-43f9-afba-4d37283c3e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:57.380839 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea61e8-a338-43f9-afba-4d37283c3e81 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:57.381524 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cea61e8-a338-43f9-afba-4d37283c3e81 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:57.383165 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cea61e8-a338-43f9-afba-4d37283c3e81 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:57.394892 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-3cea61e8-a338-43f9-afba-4d37283c3e81 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 24 04:47:57.396364 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 490/987] 10.222.0.43 () {56 vars in 1147 bytes} [Fri Dec 24 04:47:57 2021] GET /identity/v3/services/object-store => generated 93 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:57.403078 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a680f-4d1b-47c1-a0be-ed35d9f75e4f None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:57.412350 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a680f-4d1b-47c1-a0be-ed35d9f75e4f None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:57.417301 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b998a-627e-4c2b-8d28-e50d67e1dfd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:57.418295 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b998a-627e-4c2b-8d28-e50d67e1dfd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:57.418845 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b998a-627e-4c2b-8d28-e50d67e1dfd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:57.419328 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b998a-627e-4c2b-8d28-e50d67e1dfd4 admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:57.420266 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755b998a-627e-4c2b-8d28-e50d67e1dfd4 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:57.420790 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755b998a-627e-4c2b-8d28-e50d67e1dfd4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:57.422603 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755b998a-627e-4c2b-8d28-e50d67e1dfd4 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:57.428036 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 498/988] 10.222.0.43 () {56 vars in 1143 bytes} [Fri Dec 24 04:47:57 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:57.433897 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea61e8-a338-43f9-afba-4d37283c3e81 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:57.443602 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea61e8-a338-43f9-afba-4d37283c3e81 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:57.448178 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea570f-4856-4f9d-94ff-c8b81dd87c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:57.448868 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea570f-4856-4f9d-94ff-c8b81dd87c03 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:57.449152 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea570f-4856-4f9d-94ff-c8b81dd87c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:57.449550 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea570f-4856-4f9d-94ff-c8b81dd87c03 admin admin] PATH_INFO: `/v3/services` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:57.450602 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ea570f-4856-4f9d-94ff-c8b81dd87c03 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:57.450911 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ea570f-4856-4f9d-94ff-c8b81dd87c03 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:57.452746 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ea570f-4856-4f9d-94ff-c8b81dd87c03 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:57.457945 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 491/989] 10.222.0.43 () {56 vars in 1143 bytes} [Fri Dec 24 04:47:57 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:57.464559 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b998a-627e-4c2b-8d28-e50d67e1dfd4 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:57.475421 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b998a-627e-4c2b-8d28-e50d67e1dfd4 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:57.480044 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de32cc-b179-4032-8158-f7378790336e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:57.480867 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de32cc-b179-4032-8158-f7378790336e admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:57.481279 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de32cc-b179-4032-8158-f7378790336e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:57.481575 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de32cc-b179-4032-8158-f7378790336e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:57.482382 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6de32cc-b179-4032-8158-f7378790336e admin admin] RBAC: Adding query filter params (interface=admin, service_id=ee01ac57d9fc47e8aef80591452c8022, region_id=RegionOne) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:57.482693 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6de32cc-b179-4032-8158-f7378790336e admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:57.483707 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING py.warnings [None req-d6de32cc-b179-4032-8158-f7378790336e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:47:57.483707 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: warnings.warn(msg) Dec 24 04:47:57.483707 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: Dec 24 04:47:57.484599 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6de32cc-b179-4032-8158-f7378790336e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:57.493541 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 499/990] 10.222.0.43 () {56 vars in 1270 bytes} [Fri Dec 24 04:47:57 2021] GET /identity/v3/endpoints?service_id=ee01ac57d9fc47e8aef80591452c8022&interface=admin®ion_id=RegionOne => generated 193 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:57.499556 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea570f-4856-4f9d-94ff-c8b81dd87c03 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:57.509418 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea570f-4856-4f9d-94ff-c8b81dd87c03 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:57.513999 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a7c34-f79e-47c7-9fd6-39a9e0d2b815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:57.514648 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a7c34-f79e-47c7-9fd6-39a9e0d2b815 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:57.514928 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a7c34-f79e-47c7-9fd6-39a9e0d2b815 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:57.515199 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a7c34-f79e-47c7-9fd6-39a9e0d2b815 admin admin] PATH_INFO: `/v3/services` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:57.515898 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197a7c34-f79e-47c7-9fd6-39a9e0d2b815 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:57.517533 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197a7c34-f79e-47c7-9fd6-39a9e0d2b815 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:57.524065 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 492/991] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Dec 24 04:47:57 2021] GET /identity/v3/services => generated 1957 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 04:47:58.268438 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd290843-b187-4859-9cc6-0bb7be3d80ee None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:58.268993 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd290843-b187-4859-9cc6-0bb7be3d80ee None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:58.268993 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd290843-b187-4859-9cc6-0bb7be3d80ee None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:58.270942 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 500/992] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:58.278904 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44ea0c-5927-430b-8e0f-9bdc77c6eeb1 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:58.278904 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44ea0c-5927-430b-8e0f-9bdc77c6eeb1 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:58.278904 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44ea0c-5927-430b-8e0f-9bdc77c6eeb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:58.296226 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-ea44ea0c-5927-430b-8e0f-9bdc77c6eeb1 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:58.297726 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-ea44ea0c-5927-430b-8e0f-9bdc77c6eeb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:58.306056 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 493/993] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:58 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:47:58.333331 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd290843-b187-4859-9cc6-0bb7be3d80ee None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:58.346341 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd290843-b187-4859-9cc6-0bb7be3d80ee None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:58.351113 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e0f37-a82c-4648-80a0-819535fe2770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:58.352143 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e0f37-a82c-4648-80a0-819535fe2770 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:58.352642 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e0f37-a82c-4648-80a0-819535fe2770 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:58.353106 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e0f37-a82c-4648-80a0-819535fe2770 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:58.353966 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868e0f37-a82c-4648-80a0-819535fe2770 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:58.355822 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868e0f37-a82c-4648-80a0-819535fe2770 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:58.367078 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-868e0f37-a82c-4648-80a0-819535fe2770 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Dec 24 04:47:58.368846 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 501/994] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Dec 24 04:47:58 2021] GET /identity/v3/services/compute => generated 88 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:58.375706 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44ea0c-5927-430b-8e0f-9bdc77c6eeb1 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:58.385040 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44ea0c-5927-430b-8e0f-9bdc77c6eeb1 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:58.390196 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474c4c8f-dbf5-4b4e-8f73-46baeebd066e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:58.390695 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2cd90-0d59-4276-abc0-032c57eddb01 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:58.390984 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2cd90-0d59-4276-abc0-032c57eddb01 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:58.391261 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2cd90-0d59-4276-abc0-032c57eddb01 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:58.391690 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c4c8f-dbf5-4b4e-8f73-46baeebd066e admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:58.392156 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c4c8f-dbf5-4b4e-8f73-46baeebd066e admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:58.392669 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c4c8f-dbf5-4b4e-8f73-46baeebd066e admin admin] PATH_INFO: `/v3/services` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:58.393418 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 502/995] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 24 04:47:58.393816 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474c4c8f-dbf5-4b4e-8f73-46baeebd066e admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:58.394385 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474c4c8f-dbf5-4b4e-8f73-46baeebd066e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:58.396177 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474c4c8f-dbf5-4b4e-8f73-46baeebd066e admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:58.398809 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f536665-b3e6-4ada-8b4a-8c32a67024ad None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:58.399095 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f536665-b3e6-4ada-8b4a-8c32a67024ad None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:58.399371 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f536665-b3e6-4ada-8b4a-8c32a67024ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:58.402631 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 494/996] 10.222.0.43 () {56 vars in 1133 bytes} [Fri Dec 24 04:47:58 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:58.408800 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474c4c8f-dbf5-4b4e-8f73-46baeebd066e admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:58.417658 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-2f536665-b3e6-4ada-8b4a-8c32a67024ad None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:58.419075 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474c4c8f-dbf5-4b4e-8f73-46baeebd066e admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:58.419188 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-2f536665-b3e6-4ada-8b4a-8c32a67024ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:58.423905 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369905ba-2dce-4b4e-824d-2734ff0a9405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:58.424787 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369905ba-2dce-4b4e-824d-2734ff0a9405 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:58.425312 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369905ba-2dce-4b4e-824d-2734ff0a9405 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:58.425749 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369905ba-2dce-4b4e-824d-2734ff0a9405 admin admin] PATH_INFO: `/v3/services` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:58.426678 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369905ba-2dce-4b4e-824d-2734ff0a9405 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:58.427146 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369905ba-2dce-4b4e-824d-2734ff0a9405 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:58.428142 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 503/997] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:58 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 04:47:58.429257 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369905ba-2dce-4b4e-824d-2734ff0a9405 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:58.434958 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 495/998] 10.222.0.43 () {56 vars in 1133 bytes} [Fri Dec 24 04:47:58 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:58.441353 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f536665-b3e6-4ada-8b4a-8c32a67024ad None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:58.451304 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f536665-b3e6-4ada-8b4a-8c32a67024ad None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:58.453670 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369905ba-2dce-4b4e-824d-2734ff0a9405 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:58.458488 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84560288-26b3-4d39-8905-2dd452f1d4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:58.459518 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84560288-26b3-4d39-8905-2dd452f1d4e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:58.459772 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84560288-26b3-4d39-8905-2dd452f1d4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:58.460027 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84560288-26b3-4d39-8905-2dd452f1d4e6 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:58.460947 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84560288-26b3-4d39-8905-2dd452f1d4e6 admin admin] RBAC: Adding query filter params (interface=public, service_id=3c80755eadbf4dd791c4089c1471b794, region_id=RegionOne) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:58.461248 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84560288-26b3-4d39-8905-2dd452f1d4e6 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:58.462888 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84560288-26b3-4d39-8905-2dd452f1d4e6 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:58.465633 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369905ba-2dce-4b4e-824d-2734ff0a9405 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:58.468968 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 504/999] 10.222.0.43 () {56 vars in 1272 bytes} [Fri Dec 24 04:47:58 2021] GET /identity/v3/endpoints?service_id=3c80755eadbf4dd791c4089c1471b794&interface=public®ion_id=RegionOne => generated 194 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:58.470728 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be22824b-156f-4f4c-bf40-22cb3ee830cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:58.471789 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22824b-156f-4f4c-bf40-22cb3ee830cf admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:58.472308 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22824b-156f-4f4c-bf40-22cb3ee830cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:58.472813 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22824b-156f-4f4c-bf40-22cb3ee830cf admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:58.473804 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be22824b-156f-4f4c-bf40-22cb3ee830cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:58.474940 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84560288-26b3-4d39-8905-2dd452f1d4e6 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:58.476294 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be22824b-156f-4f4c-bf40-22cb3ee830cf admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:58.477813 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.common [None req-be22824b-156f-4f4c-bf40-22cb3ee830cf admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Dec 24 04:47:58.485173 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84560288-26b3-4d39-8905-2dd452f1d4e6 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:58.490266 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583686e0-f1d5-46a8-86fb-403e5cea726a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:58.490980 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583686e0-f1d5-46a8-86fb-403e5cea726a admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:58.491265 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583686e0-f1d5-46a8-86fb-403e5cea726a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:58.491905 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583686e0-f1d5-46a8-86fb-403e5cea726a admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:58.493168 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.sql.core [None req-be22824b-156f-4f4c-bf40-22cb3ee830cf admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Dec 24 04:47:58.493168 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Dec 24 04:47:58.493168 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [parameters: {'user_id': '1793bdc6afc24de9a2dd42196d90cac3', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Dec 24 04:47:58.493168 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79112) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Dec 24 04:47:58.496669 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583686e0-f1d5-46a8-86fb-403e5cea726a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:58.498610 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583686e0-f1d5-46a8-86fb-403e5cea726a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:58.506741 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 505/1000] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Dec 24 04:47:58 2021] GET /identity/v3/services => generated 1957 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 04:47:58.512612 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-be22824b-156f-4f4c-bf40-22cb3ee830cf admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Dec 24 04:47:58.512612 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 496/1001] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 04:47:58 2021] POST /identity/v3/users => generated 160 bytes in 56 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:47:58.516213 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583686e0-f1d5-46a8-86fb-403e5cea726a admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:58.526497 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583686e0-f1d5-46a8-86fb-403e5cea726a admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:58.531483 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f3c45-09e8-40ce-b82c-27d69b72e39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:58.532302 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f3c45-09e8-40ce-b82c-27d69b72e39a admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:58.532627 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f3c45-09e8-40ce-b82c-27d69b72e39a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:58.532905 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f3c45-09e8-40ce-b82c-27d69b72e39a admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:58.541323 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f3c45-09e8-40ce-b82c-27d69b72e39a admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:58.543573 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f3c45-09e8-40ce-b82c-27d69b72e39a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:58.558957 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-d44f3c45-09e8-40ce-b82c-27d69b72e39a admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 24 04:47:58.560576 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 506/1002] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:47:58 2021] GET /identity/v3/users/cinder => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:47:58.567199 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be22824b-156f-4f4c-bf40-22cb3ee830cf admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:58.579518 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be22824b-156f-4f4c-bf40-22cb3ee830cf admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:58.584765 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097ced74-233b-4966-8ca6-7bccdbd91f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:58.585461 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ced74-233b-4966-8ca6-7bccdbd91f4d admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:58.585745 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ced74-233b-4966-8ca6-7bccdbd91f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:58.586023 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ced74-233b-4966-8ca6-7bccdbd91f4d admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:58.586872 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097ced74-233b-4966-8ca6-7bccdbd91f4d admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:58.587181 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097ced74-233b-4966-8ca6-7bccdbd91f4d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:58.589494 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097ced74-233b-4966-8ca6-7bccdbd91f4d admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:58.632540 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 497/1003] 10.222.0.43 () {56 vars in 1122 bytes} [Fri Dec 24 04:47:58 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:59.351855 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9dc04b-5c15-49e0-b588-146413d8b011 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:59.352409 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9dc04b-5c15-49e0-b588-146413d8b011 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:59.352409 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9dc04b-5c15-49e0-b588-146413d8b011 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:59.354240 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 507/1004] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:59.360243 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d8f53-b6fb-4f3e-8ed0-6ca36ae6243e None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:59.360696 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d8f53-b6fb-4f3e-8ed0-6ca36ae6243e None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:59.360863 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d8f53-b6fb-4f3e-8ed0-6ca36ae6243e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:59.379571 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-b96d8f53-b6fb-4f3e-8ed0-6ca36ae6243e None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:59.381112 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-b96d8f53-b6fb-4f3e-8ed0-6ca36ae6243e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:59.389510 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 498/1005] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:59 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:47:59.413357 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9dc04b-5c15-49e0-b588-146413d8b011 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:59.426400 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9dc04b-5c15-49e0-b588-146413d8b011 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:59.431157 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237d93d-6396-4618-b36a-caf6b78438c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:59.431934 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237d93d-6396-4618-b36a-caf6b78438c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:59.432215 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237d93d-6396-4618-b36a-caf6b78438c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:59.432462 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237d93d-6396-4618-b36a-caf6b78438c1 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:59.433311 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e237d93d-6396-4618-b36a-caf6b78438c1 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:59.435019 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e237d93d-6396-4618-b36a-caf6b78438c1 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:59.445866 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-e237d93d-6396-4618-b36a-caf6b78438c1 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Dec 24 04:47:59.452266 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 508/1006] 10.222.0.43 () {56 vars in 1126 bytes} [Fri Dec 24 04:47:59 2021] GET /identity/v3/services/image => generated 86 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:47:59.453486 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d8f53-b6fb-4f3e-8ed0-6ca36ae6243e None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:59.463140 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d8f53-b6fb-4f3e-8ed0-6ca36ae6243e None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:59.468069 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53285b11-45fc-4055-a2ec-50db7a1c58d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:59.468823 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53285b11-45fc-4055-a2ec-50db7a1c58d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:59.469185 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53285b11-45fc-4055-a2ec-50db7a1c58d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:59.469520 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53285b11-45fc-4055-a2ec-50db7a1c58d9 admin admin] PATH_INFO: `/v3/services` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:59.470333 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53285b11-45fc-4055-a2ec-50db7a1c58d9 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:59.470704 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53285b11-45fc-4055-a2ec-50db7a1c58d9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:59.472405 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53285b11-45fc-4055-a2ec-50db7a1c58d9 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:59.480583 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 499/1007] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:59 2021] GET /identity/v3/services?name=image => generated 122 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:47:59.484405 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237d93d-6396-4618-b36a-caf6b78438c1 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:59.494801 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237d93d-6396-4618-b36a-caf6b78438c1 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:59.500696 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c989a35-0ca0-4c68-bc4c-b71b359e9c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:59.501342 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c989a35-0ca0-4c68-bc4c-b71b359e9c03 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:59.501629 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c989a35-0ca0-4c68-bc4c-b71b359e9c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:59.501863 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c989a35-0ca0-4c68-bc4c-b71b359e9c03 admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:59.502597 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c989a35-0ca0-4c68-bc4c-b71b359e9c03 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:59.502898 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c989a35-0ca0-4c68-bc4c-b71b359e9c03 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:59.504438 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c989a35-0ca0-4c68-bc4c-b71b359e9c03 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:59.509954 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 509/1008] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:47:59 2021] GET /identity/v3/services?type=image => generated 350 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:59.516605 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53285b11-45fc-4055-a2ec-50db7a1c58d9 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:59.527464 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53285b11-45fc-4055-a2ec-50db7a1c58d9 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:59.533270 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1438e9b-d04b-42f2-94b3-874a62254707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:59.534481 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1438e9b-d04b-42f2-94b3-874a62254707 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:59.534971 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1438e9b-d04b-42f2-94b3-874a62254707 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:59.535450 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1438e9b-d04b-42f2-94b3-874a62254707 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:59.536492 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1438e9b-d04b-42f2-94b3-874a62254707 admin admin] RBAC: Adding query filter params (interface=public, service_id=e30e7d7946cc4e0f834f5402e45df148, region_id=RegionOne) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:47:59.537071 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1438e9b-d04b-42f2-94b3-874a62254707 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:59.538943 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1438e9b-d04b-42f2-94b3-874a62254707 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:59.545819 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 500/1009] 10.222.0.43 () {56 vars in 1272 bytes} [Fri Dec 24 04:47:59 2021] GET /identity/v3/endpoints?service_id=e30e7d7946cc4e0f834f5402e45df148&interface=public®ion_id=RegionOne => generated 194 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:47:59.551776 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c989a35-0ca0-4c68-bc4c-b71b359e9c03 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:47:59.561976 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c989a35-0ca0-4c68-bc4c-b71b359e9c03 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:47:59.566416 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5616b6d-089a-40c2-8d30-1b4043f6eb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:47:59.567007 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5616b6d-089a-40c2-8d30-1b4043f6eb01 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:59.567284 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5616b6d-089a-40c2-8d30-1b4043f6eb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:59.567551 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5616b6d-089a-40c2-8d30-1b4043f6eb01 admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:59.568240 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5616b6d-089a-40c2-8d30-1b4043f6eb01 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:47:59.569856 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5616b6d-089a-40c2-8d30-1b4043f6eb01 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:47:59.576770 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 510/1010] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Dec 24 04:47:59 2021] GET /identity/v3/services => generated 1957 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 04:47:59.937042 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa9729-9938-4354-8197-05bc03889248 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:59.937410 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa9729-9938-4354-8197-05bc03889248 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:59.937516 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa9729-9938-4354-8197-05bc03889248 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:59.939336 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 501/1011] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:47:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:47:59.945358 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8a1c0-625b-4830-b735-a61d9f565476 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:47:59.945645 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8a1c0-625b-4830-b735-a61d9f565476 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:47:59.945917 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8a1c0-625b-4830-b735-a61d9f565476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:47:59.966641 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-3ee8a1c0-625b-4830-b735-a61d9f565476 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:47:59.967837 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-3ee8a1c0-625b-4830-b735-a61d9f565476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:47:59.976580 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 511/1012] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:47:59 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:48:00.000354 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa9729-9938-4354-8197-05bc03889248 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:00.013577 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa9729-9938-4354-8197-05bc03889248 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:00.018046 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1db65c-1a64-436a-869b-615606240ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:00.018847 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1db65c-1a64-436a-869b-615606240ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:00.019120 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1db65c-1a64-436a-869b-615606240ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:00.019392 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1db65c-1a64-436a-869b-615606240ee7 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:00.020059 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1db65c-1a64-436a-869b-615606240ee7 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:00.021687 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1db65c-1a64-436a-869b-615606240ee7 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:00.033203 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-6c1db65c-1a64-436a-869b-615606240ee7 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 24 04:48:00.034534 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 502/1013] 10.222.0.43 () {56 vars in 1147 bytes} [Fri Dec 24 04:47:59 2021] GET /identity/v3/services/object-store => generated 93 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:48:00.041174 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee8a1c0-625b-4830-b735-a61d9f565476 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:00.050259 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee8a1c0-625b-4830-b735-a61d9f565476 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:00.055215 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2958f5-0e8f-4f05-a888-e083457ba038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:00.055861 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2958f5-0e8f-4f05-a888-e083457ba038 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:00.056120 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2958f5-0e8f-4f05-a888-e083457ba038 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:00.056394 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2958f5-0e8f-4f05-a888-e083457ba038 admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:00.057146 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2958f5-0e8f-4f05-a888-e083457ba038 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:48:00.057451 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2958f5-0e8f-4f05-a888-e083457ba038 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:00.059092 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2958f5-0e8f-4f05-a888-e083457ba038 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:00.064033 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 512/1014] 10.222.0.43 () {56 vars in 1143 bytes} [Fri Dec 24 04:48:00 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:00.069865 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1db65c-1a64-436a-869b-615606240ee7 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:00.080150 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1db65c-1a64-436a-869b-615606240ee7 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:00.085044 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c909cf-3509-49cc-b0f1-140bb8df9825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:00.085690 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c909cf-3509-49cc-b0f1-140bb8df9825 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:00.085975 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c909cf-3509-49cc-b0f1-140bb8df9825 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:00.086249 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c909cf-3509-49cc-b0f1-140bb8df9825 admin admin] PATH_INFO: `/v3/services` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:00.086971 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c909cf-3509-49cc-b0f1-140bb8df9825 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:48:00.087276 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c909cf-3509-49cc-b0f1-140bb8df9825 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:00.088974 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c909cf-3509-49cc-b0f1-140bb8df9825 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:00.094334 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 503/1015] 10.222.0.43 () {56 vars in 1143 bytes} [Fri Dec 24 04:48:00 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:00.100254 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2958f5-0e8f-4f05-a888-e083457ba038 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:00.110107 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2958f5-0e8f-4f05-a888-e083457ba038 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:00.114702 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10f04f5-c5b1-4f7c-b9eb-b9476f18f2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:00.115328 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f04f5-c5b1-4f7c-b9eb-b9476f18f2e0 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:00.115605 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f04f5-c5b1-4f7c-b9eb-b9476f18f2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:00.115872 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f04f5-c5b1-4f7c-b9eb-b9476f18f2e0 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:00.116645 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10f04f5-c5b1-4f7c-b9eb-b9476f18f2e0 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:00.117635 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING py.warnings [None req-c10f04f5-c5b1-4f7c-b9eb-b9476f18f2e0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:48:00.117635 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: warnings.warn(msg) Dec 24 04:48:00.117635 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: Dec 24 04:48:00.118482 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10f04f5-c5b1-4f7c-b9eb-b9476f18f2e0 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:00.140629 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 513/1016] 10.222.0.43 () {60 vars in 1165 bytes} [Fri Dec 24 04:48:00 2021] POST /identity/v3/endpoints => generated 325 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 04:48:00.880447 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8234b92-9129-4274-82cf-627dfa4922da None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:00.881083 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8234b92-9129-4274-82cf-627dfa4922da None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:00.881083 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8234b92-9129-4274-82cf-627dfa4922da None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:00.882755 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 504/1017] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:48:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:48:00.888902 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cfe811-5d8c-4701-8a88-c00b7302525f None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:00.889395 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cfe811-5d8c-4701-8a88-c00b7302525f None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:00.889627 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cfe811-5d8c-4701-8a88-c00b7302525f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:00.907758 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-32cfe811-5d8c-4701-8a88-c00b7302525f None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:48:00.908955 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-32cfe811-5d8c-4701-8a88-c00b7302525f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:48:00.926546 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 514/1018] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:48:00 2021] POST /identity/v3/auth/tokens => generated 2668 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:48:00.950627 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8234b92-9129-4274-82cf-627dfa4922da None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:00.963770 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8234b92-9129-4274-82cf-627dfa4922da None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:00.968516 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6beda9-2a38-4bc1-93c8-83ad964f52d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:00.969331 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6beda9-2a38-4bc1-93c8-83ad964f52d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:00.969606 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6beda9-2a38-4bc1-93c8-83ad964f52d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:00.969872 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6beda9-2a38-4bc1-93c8-83ad964f52d1 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:00.970561 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6beda9-2a38-4bc1-93c8-83ad964f52d1 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:00.972166 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6beda9-2a38-4bc1-93c8-83ad964f52d1 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:00.983762 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-8d6beda9-2a38-4bc1-93c8-83ad964f52d1 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Dec 24 04:48:00.985245 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 505/1019] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Dec 24 04:48:00 2021] GET /identity/v3/services/compute => generated 88 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:48:00.991844 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cfe811-5d8c-4701-8a88-c00b7302525f None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:01.001690 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cfe811-5d8c-4701-8a88-c00b7302525f None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:01.006940 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d1753-3652-45e8-9e0e-fc5decfce092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:01.007613 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d1753-3652-45e8-9e0e-fc5decfce092 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:01.007895 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d1753-3652-45e8-9e0e-fc5decfce092 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:01.008165 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d1753-3652-45e8-9e0e-fc5decfce092 admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:01.008939 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5d1753-3652-45e8-9e0e-fc5decfce092 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:48:01.009240 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5d1753-3652-45e8-9e0e-fc5decfce092 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:01.010845 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5d1753-3652-45e8-9e0e-fc5decfce092 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:01.016956 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 515/1020] 10.222.0.43 () {56 vars in 1133 bytes} [Fri Dec 24 04:48:00 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:01.023223 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6beda9-2a38-4bc1-93c8-83ad964f52d1 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:01.034716 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6beda9-2a38-4bc1-93c8-83ad964f52d1 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:01.040486 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf66c8e-e675-40bb-a88b-4f2ad2c7964f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:01.041172 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf66c8e-e675-40bb-a88b-4f2ad2c7964f admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:01.041455 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf66c8e-e675-40bb-a88b-4f2ad2c7964f admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:01.041724 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf66c8e-e675-40bb-a88b-4f2ad2c7964f admin admin] PATH_INFO: `/v3/services` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:01.042451 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf66c8e-e675-40bb-a88b-4f2ad2c7964f admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:48:01.042753 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf66c8e-e675-40bb-a88b-4f2ad2c7964f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:01.044746 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf66c8e-e675-40bb-a88b-4f2ad2c7964f admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:01.050216 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 506/1021] 10.222.0.43 () {56 vars in 1133 bytes} [Fri Dec 24 04:48:01 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:01.056373 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d1753-3652-45e8-9e0e-fc5decfce092 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:01.066590 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d1753-3652-45e8-9e0e-fc5decfce092 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:01.071520 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f10ac6-898f-4986-b33f-5ad51e75ec0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:01.072162 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f10ac6-898f-4986-b33f-5ad51e75ec0a admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:01.072443 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f10ac6-898f-4986-b33f-5ad51e75ec0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:01.072759 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f10ac6-898f-4986-b33f-5ad51e75ec0a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:01.073515 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f10ac6-898f-4986-b33f-5ad51e75ec0a admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:01.075469 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f10ac6-898f-4986-b33f-5ad51e75ec0a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:01.095491 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 516/1022] 10.222.0.43 () {60 vars in 1165 bytes} [Fri Dec 24 04:48:01 2021] POST /identity/v3/endpoints => generated 334 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:48:01.947047 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22971bf-d842-4c99-a8cd-6ddf30cf690e None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:01.947613 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22971bf-d842-4c99-a8cd-6ddf30cf690e None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:01.947613 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22971bf-d842-4c99-a8cd-6ddf30cf690e None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:01.949586 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 507/1023] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:48:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:48:01.955381 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d2439-aa80-4928-9e9c-6833db40ebf9 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:01.955807 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d2439-aa80-4928-9e9c-6833db40ebf9 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:01.955882 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d2439-aa80-4928-9e9c-6833db40ebf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:01.976733 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-538d2439-aa80-4928-9e9c-6833db40ebf9 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:48:01.977931 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-538d2439-aa80-4928-9e9c-6833db40ebf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:48:01.996004 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 517/1024] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:48:01 2021] POST /identity/v3/auth/tokens => generated 2824 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:48:02.019666 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22971bf-d842-4c99-a8cd-6ddf30cf690e None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:02.032837 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22971bf-d842-4c99-a8cd-6ddf30cf690e None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:02.037604 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e591927-7fae-4de1-9e17-2a8d81c1191e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:02.038385 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e591927-7fae-4de1-9e17-2a8d81c1191e admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:02.038667 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e591927-7fae-4de1-9e17-2a8d81c1191e admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:02.038914 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e591927-7fae-4de1-9e17-2a8d81c1191e admin admin] PATH_INFO: `/v3/services/image` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:02.039619 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e591927-7fae-4de1-9e17-2a8d81c1191e admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:02.041300 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e591927-7fae-4de1-9e17-2a8d81c1191e admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:02.052697 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-3e591927-7fae-4de1-9e17-2a8d81c1191e admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Dec 24 04:48:02.054090 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 508/1025] 10.222.0.43 () {56 vars in 1126 bytes} [Fri Dec 24 04:48:02 2021] GET /identity/v3/services/image => generated 86 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:48:02.060298 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d2439-aa80-4928-9e9c-6833db40ebf9 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:02.069676 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d2439-aa80-4928-9e9c-6833db40ebf9 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:02.074670 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619b774-aa71-4f04-8bb1-b9eb9976a27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:02.075347 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619b774-aa71-4f04-8bb1-b9eb9976a27e admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:02.075625 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619b774-aa71-4f04-8bb1-b9eb9976a27e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:02.075897 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619b774-aa71-4f04-8bb1-b9eb9976a27e admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:02.076674 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0619b774-aa71-4f04-8bb1-b9eb9976a27e admin admin] RBAC: Adding query filter params (name=image) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:48:02.076983 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0619b774-aa71-4f04-8bb1-b9eb9976a27e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:02.078628 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0619b774-aa71-4f04-8bb1-b9eb9976a27e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:02.084964 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 518/1026] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:48:02 2021] GET /identity/v3/services?name=image => generated 122 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:02.091624 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e591927-7fae-4de1-9e17-2a8d81c1191e admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:02.102078 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e591927-7fae-4de1-9e17-2a8d81c1191e admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:02.107729 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda9355-e2f6-4ce4-9ce6-7df1f8fbf7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:02.108468 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda9355-e2f6-4ce4-9ce6-7df1f8fbf7fa admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:02.108914 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda9355-e2f6-4ce4-9ce6-7df1f8fbf7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:02.109339 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda9355-e2f6-4ce4-9ce6-7df1f8fbf7fa admin admin] PATH_INFO: `/v3/services` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:02.109984 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdda9355-e2f6-4ce4-9ce6-7df1f8fbf7fa admin admin] RBAC: Adding query filter params (type=image) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:48:02.110296 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdda9355-e2f6-4ce4-9ce6-7df1f8fbf7fa admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:02.111903 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdda9355-e2f6-4ce4-9ce6-7df1f8fbf7fa admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:02.117270 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 509/1027] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:48:02 2021] GET /identity/v3/services?type=image => generated 350 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:02.124059 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619b774-aa71-4f04-8bb1-b9eb9976a27e admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:02.133989 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619b774-aa71-4f04-8bb1-b9eb9976a27e admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:02.138752 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e22f74-fc99-4d0c-9368-de37e058b83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:02.139494 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e22f74-fc99-4d0c-9368-de37e058b83e admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:02.139843 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e22f74-fc99-4d0c-9368-de37e058b83e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:02.140185 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e22f74-fc99-4d0c-9368-de37e058b83e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:02.141050 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e22f74-fc99-4d0c-9368-de37e058b83e admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:02.142721 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e22f74-fc99-4d0c-9368-de37e058b83e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:02.165930 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 519/1028] 10.222.0.43 () {60 vars in 1165 bytes} [Fri Dec 24 04:48:02 2021] POST /identity/v3/endpoints => generated 327 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:48:02.477284 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4b105-12af-4411-a1f3-d98b51d40011 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:02.477772 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4b105-12af-4411-a1f3-d98b51d40011 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:02.478150 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4b105-12af-4411-a1f3-d98b51d40011 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:02.480064 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 510/1029] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:48:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:48:02.486270 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226e07e-9118-4246-a10e-860fe58fe7fd None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:02.486631 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226e07e-9118-4246-a10e-860fe58fe7fd None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:02.486942 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226e07e-9118-4246-a10e-860fe58fe7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:02.504752 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-f226e07e-9118-4246-a10e-860fe58fe7fd None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:48:02.505933 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-f226e07e-9118-4246-a10e-860fe58fe7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:48:02.524325 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 520/1030] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:48:02 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 04:48:02.548339 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d4b105-12af-4411-a1f3-d98b51d40011 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:02.561093 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d4b105-12af-4411-a1f3-d98b51d40011 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:02.565889 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31847576-6bfe-4744-8d85-466af9190a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:02.566635 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31847576-6bfe-4744-8d85-466af9190a0e admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:02.566898 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31847576-6bfe-4744-8d85-466af9190a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:02.567167 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31847576-6bfe-4744-8d85-466af9190a0e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:02.568361 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31847576-6bfe-4744-8d85-466af9190a0e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:02.570066 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31847576-6bfe-4744-8d85-466af9190a0e admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:02.571856 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 511/1031] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:48:02 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:02.578009 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f226e07e-9118-4246-a10e-860fe58fe7fd None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:02.587799 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f226e07e-9118-4246-a10e-860fe58fe7fd None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:02.592756 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4fe06-6364-4c88-be30-bd1323f5bc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:02.593539 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4fe06-6364-4c88-be30-bd1323f5bc68 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:02.593917 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4fe06-6364-4c88-be30-bd1323f5bc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:02.594285 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4fe06-6364-4c88-be30-bd1323f5bc68 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:02.595128 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4fe06-6364-4c88-be30-bd1323f5bc68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:02.597070 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4fe06-6364-4c88-be30-bd1323f5bc68 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:02.628583 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 521/1032] 10.222.0.43 () {60 vars in 1162 bytes} [Fri Dec 24 04:48:02 2021] POST /identity/v3/projects => generated 311 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:48:03.540407 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cffec-c119-4f92-8a1e-74cd05595b3f None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:03.540974 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cffec-c119-4f92-8a1e-74cd05595b3f None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:03.540974 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cffec-c119-4f92-8a1e-74cd05595b3f None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:03.542721 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 512/1033] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:48:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:48:03.548891 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c052d64-6817-4a9d-ae20-18212eb1597f None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:03.549310 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c052d64-6817-4a9d-ae20-18212eb1597f None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:03.549448 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c052d64-6817-4a9d-ae20-18212eb1597f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:03.567942 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-0c052d64-6817-4a9d-ae20-18212eb1597f None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:48:03.569090 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-0c052d64-6817-4a9d-ae20-18212eb1597f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:48:03.633542 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 522/1034] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:48:03 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:48:03.657344 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405cffec-c119-4f92-8a1e-74cd05595b3f None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:03.670343 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405cffec-c119-4f92-8a1e-74cd05595b3f None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:03.674976 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e7144-e651-43e5-9ece-9c2b20283146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:03.675843 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e7144-e651-43e5-9ece-9c2b20283146 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:03.676187 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e7144-e651-43e5-9ece-9c2b20283146 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:03.676539 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e7144-e651-43e5-9ece-9c2b20283146 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:03.687943 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401e7144-e651-43e5-9ece-9c2b20283146 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:48:03.695285 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-401e7144-e651-43e5-9ece-9c2b20283146 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 24 04:48:03.696678 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 513/1035] 10.222.0.43 () {56 vars in 1141 bytes} [Fri Dec 24 04:48:03 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:48:03.703042 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c052d64-6817-4a9d-ae20-18212eb1597f None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:03.712504 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c052d64-6817-4a9d-ae20-18212eb1597f None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:03.717091 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bd3838-46d8-4e58-80e6-4fe5aa06b169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:03.717743 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd3838-46d8-4e58-80e6-4fe5aa06b169 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:03.718021 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd3838-46d8-4e58-80e6-4fe5aa06b169 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:03.718285 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd3838-46d8-4e58-80e6-4fe5aa06b169 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:03.719040 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bd3838-46d8-4e58-80e6-4fe5aa06b169 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:48:03.719352 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bd3838-46d8-4e58-80e6-4fe5aa06b169 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:03.721120 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bd3838-46d8-4e58-80e6-4fe5aa06b169 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:03.729707 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 523/1036] 10.222.0.43 () {56 vars in 1136 bytes} [Fri Dec 24 04:48:03 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:03.735860 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e7144-e651-43e5-9ece-9c2b20283146 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:03.745610 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e7144-e651-43e5-9ece-9c2b20283146 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:03.750665 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79afad9-969d-4776-aae8-477594bcd44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:03.751448 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79afad9-969d-4776-aae8-477594bcd44b admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:03.751699 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79afad9-969d-4776-aae8-477594bcd44b admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:03.751995 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79afad9-969d-4776-aae8-477594bcd44b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:03.762531 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79afad9-969d-4776-aae8-477594bcd44b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:03.764494 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79afad9-969d-4776-aae8-477594bcd44b admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:03.781482 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-e79afad9-969d-4776-aae8-477594bcd44b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:48:03.782829 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 514/1037] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:48:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:48:03.788918 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bd3838-46d8-4e58-80e6-4fe5aa06b169 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:03.799083 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bd3838-46d8-4e58-80e6-4fe5aa06b169 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:03.804185 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef56c822-b35b-4456-a38c-6375135b6cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:03.804920 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef56c822-b35b-4456-a38c-6375135b6cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:03.805168 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef56c822-b35b-4456-a38c-6375135b6cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:03.805450 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef56c822-b35b-4456-a38c-6375135b6cd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:03.806199 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef56c822-b35b-4456-a38c-6375135b6cd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:48:03.806501 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef56c822-b35b-4456-a38c-6375135b6cd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:03.808119 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef56c822-b35b-4456-a38c-6375135b6cd4 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:03.824829 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 524/1038] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:48:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:48:03.827194 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79afad9-969d-4776-aae8-477594bcd44b admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:03.837911 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79afad9-969d-4776-aae8-477594bcd44b admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:03.842965 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f357d321-2a0f-431a-8947-d10794b9fd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:03.843747 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357d321-2a0f-431a-8947-d10794b9fd29 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:03.844025 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357d321-2a0f-431a-8947-d10794b9fd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:03.844294 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357d321-2a0f-431a-8947-d10794b9fd29 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:03.851941 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f357d321-2a0f-431a-8947-d10794b9fd29 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:03.854001 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f357d321-2a0f-431a-8947-d10794b9fd29 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:03.868534 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-f357d321-2a0f-431a-8947-d10794b9fd29 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 24 04:48:03.869879 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 515/1039] 10.222.0.43 () {56 vars in 1114 bytes} [Fri Dec 24 04:48:03 2021] GET /identity/v3/users/nova => generated 82 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:48:03.876440 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef56c822-b35b-4456-a38c-6375135b6cd4 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:03.886436 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef56c822-b35b-4456-a38c-6375135b6cd4 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:03.891034 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6bd61-ec0a-4d5c-b9d6-25dc612f8de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:03.891760 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6bd61-ec0a-4d5c-b9d6-25dc612f8de7 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:03.892103 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6bd61-ec0a-4d5c-b9d6-25dc612f8de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:03.892458 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6bd61-ec0a-4d5c-b9d6-25dc612f8de7 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:03.893412 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d6bd61-ec0a-4d5c-b9d6-25dc612f8de7 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:48:03.893787 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d6bd61-ec0a-4d5c-b9d6-25dc612f8de7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:03.895697 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d6bd61-ec0a-4d5c-b9d6-25dc612f8de7 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:03.916577 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 525/1040] 10.222.0.43 () {56 vars in 1154 bytes} [Fri Dec 24 04:48:03 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:48:03.920585 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f357d321-2a0f-431a-8947-d10794b9fd29 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:03.930611 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f357d321-2a0f-431a-8947-d10794b9fd29 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:03.935006 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d93851e-266e-4324-9929-72bfd7a32dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:03.935640 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93851e-266e-4324-9929-72bfd7a32dda admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:03.935916 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93851e-266e-4324-9929-72bfd7a32dda admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:03.936180 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93851e-266e-4324-9929-72bfd7a32dda admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:03.944158 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d93851e-266e-4324-9929-72bfd7a32dda admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:03.945951 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d93851e-266e-4324-9929-72bfd7a32dda admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:03.955491 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 516/1041] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:48:03 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:48:03.961995 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6bd61-ec0a-4d5c-b9d6-25dc612f8de7 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:03.972135 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6bd61-ec0a-4d5c-b9d6-25dc612f8de7 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:03.977132 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496486aa-6274-487e-abb4-83b7835db640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:03.978060 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496486aa-6274-487e-abb4-83b7835db640 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:03.978444 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496486aa-6274-487e-abb4-83b7835db640 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:03.978822 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496486aa-6274-487e-abb4-83b7835db640 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:03.990255 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496486aa-6274-487e-abb4-83b7835db640 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:03.992286 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496486aa-6274-487e-abb4-83b7835db640 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:04.011299 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-496486aa-6274-487e-abb4-83b7835db640 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:48:04.013160 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 526/1042] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:48:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:48:04.019246 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d93851e-266e-4324-9929-72bfd7a32dda admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:04.028437 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d93851e-266e-4324-9929-72bfd7a32dda admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:04.033606 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce834b-0382-41fd-a541-3a1129369a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:04.034260 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce834b-0382-41fd-a541-3a1129369a2a admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:04.034555 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce834b-0382-41fd-a541-3a1129369a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:04.034809 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce834b-0382-41fd-a541-3a1129369a2a admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:04.035555 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ce834b-0382-41fd-a541-3a1129369a2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:48:04.035869 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ce834b-0382-41fd-a541-3a1129369a2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:04.037500 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ce834b-0382-41fd-a541-3a1129369a2a admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:04.052699 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 517/1043] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:48:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:04.059780 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496486aa-6274-487e-abb4-83b7835db640 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:04.069864 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496486aa-6274-487e-abb4-83b7835db640 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:04.074962 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e200d48-0c87-4c37-9d18-d1d88fac8f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:04.075683 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e200d48-0c87-4c37-9d18-d1d88fac8f5c admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:04.075972 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e200d48-0c87-4c37-9d18-d1d88fac8f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:04.076246 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e200d48-0c87-4c37-9d18-d1d88fac8f5c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:04.083229 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e200d48-0c87-4c37-9d18-d1d88fac8f5c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:04.085549 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e200d48-0c87-4c37-9d18-d1d88fac8f5c admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:04.098593 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-9e200d48-0c87-4c37-9d18-d1d88fac8f5c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 24 04:48:04.099926 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 527/1044] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Dec 24 04:48:04 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:48:04.106383 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce834b-0382-41fd-a541-3a1129369a2a admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:04.116324 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce834b-0382-41fd-a541-3a1129369a2a admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:04.121376 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b3d799-76db-4ef4-8476-3c4aaceee58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:04.122115 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3d799-76db-4ef4-8476-3c4aaceee58b admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:04.122470 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3d799-76db-4ef4-8476-3c4aaceee58b admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:04.122813 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3d799-76db-4ef4-8476-3c4aaceee58b admin admin] PATH_INFO: `/v3/projects` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:04.123701 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b3d799-76db-4ef4-8476-3c4aaceee58b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:48:04.124073 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b3d799-76db-4ef4-8476-3c4aaceee58b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:04.126051 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b3d799-76db-4ef4-8476-3c4aaceee58b admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:04.138994 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 518/1045] 10.222.0.43 () {56 vars in 1169 bytes} [Fri Dec 24 04:48:04 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:04.145590 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e200d48-0c87-4c37-9d18-d1d88fac8f5c admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:04.156690 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e200d48-0c87-4c37-9d18-d1d88fac8f5c admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:04.162740 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f524157b-4488-4f9d-8726-6b1402ce21e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:04.163487 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524157b-4488-4f9d-8726-6b1402ce21e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:04.163827 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524157b-4488-4f9d-8726-6b1402ce21e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:04.164161 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524157b-4488-4f9d-8726-6b1402ce21e3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:04.165119 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f524157b-4488-4f9d-8726-6b1402ce21e3 admin admin] RBAC: Adding query filter params (role.id=687cef9f2c0040bc9e427ac01fd7a65c, scope.project.id=c19ba4a2c0224c079c5a8a6a56569fd6, user.id=6f9ad1e8f8f74edcb44aabe17eb59648) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:48:04.165522 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f524157b-4488-4f9d-8726-6b1402ce21e3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:04.167480 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f524157b-4488-4f9d-8726-6b1402ce21e3 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:04.174552 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 528/1046] 10.222.0.43 () {56 vars in 1395 bytes} [Fri Dec 24 04:48:04 2021] GET /identity/v3/role_assignments?user.id=6f9ad1e8f8f74edcb44aabe17eb59648&scope.project.id=c19ba4a2c0224c079c5a8a6a56569fd6&role.id=687cef9f2c0040bc9e427ac01fd7a65c => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:04.577681 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e61e62-af64-40b2-97b2-54541c1aa8df None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:04.578253 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e61e62-af64-40b2-97b2-54541c1aa8df None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:04.578253 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e61e62-af64-40b2-97b2-54541c1aa8df None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:04.580183 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 519/1047] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:48:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:48:04.586217 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aed2b4-4073-41a0-8215-353febc223a2 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:04.586659 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aed2b4-4073-41a0-8215-353febc223a2 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:04.586802 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aed2b4-4073-41a0-8215-353febc223a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:04.604779 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-e3aed2b4-4073-41a0-8215-353febc223a2 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:48:04.606159 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-e3aed2b4-4073-41a0-8215-353febc223a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:48:04.614765 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 529/1048] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:48:04 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:48:04.638788 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e61e62-af64-40b2-97b2-54541c1aa8df None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:04.651479 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e61e62-af64-40b2-97b2-54541c1aa8df None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:04.656282 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56689e3-91ee-486f-9ec9-a7404aeb5ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:04.656948 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56689e3-91ee-486f-9ec9-a7404aeb5ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:04.657226 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56689e3-91ee-486f-9ec9-a7404aeb5ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:04.657494 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56689e3-91ee-486f-9ec9-a7404aeb5ac8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:04.665662 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56689e3-91ee-486f-9ec9-a7404aeb5ac8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:04.667434 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56689e3-91ee-486f-9ec9-a7404aeb5ac8 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:04.680560 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 520/1049] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:48:04 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:48:04.683376 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aed2b4-4073-41a0-8215-353febc223a2 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:04.692865 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aed2b4-4073-41a0-8215-353febc223a2 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:04.697746 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e15f6-674e-416c-8256-4c5f5d86ecaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:04.698611 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e15f6-674e-416c-8256-4c5f5d86ecaf admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:04.698991 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e15f6-674e-416c-8256-4c5f5d86ecaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:04.699364 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e15f6-674e-416c-8256-4c5f5d86ecaf admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:04.700740 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481e15f6-674e-416c-8256-4c5f5d86ecaf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:04.702505 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481e15f6-674e-416c-8256-4c5f5d86ecaf admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:04.704290 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 530/1050] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:48:04 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:05.028379 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e6568-27f0-47ab-b1d1-0069f33b4137 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:05.028843 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e6568-27f0-47ab-b1d1-0069f33b4137 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:05.029058 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e6568-27f0-47ab-b1d1-0069f33b4137 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:05.031012 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 521/1051] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:48:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:48:05.037154 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e20b2-8154-419a-aa8b-70c445de3ca9 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:05.037438 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e20b2-8154-419a-aa8b-70c445de3ca9 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:05.037713 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e20b2-8154-419a-aa8b-70c445de3ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:05.055816 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-5c2e20b2-8154-419a-aa8b-70c445de3ca9 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:48:05.057038 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-5c2e20b2-8154-419a-aa8b-70c445de3ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:48:05.064997 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 531/1052] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:48:05 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 04:48:05.090802 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e6568-27f0-47ab-b1d1-0069f33b4137 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:05.103986 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e6568-27f0-47ab-b1d1-0069f33b4137 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:05.108917 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc10b7-1486-4a76-baee-93cf65b20330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:05.109691 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc10b7-1486-4a76-baee-93cf65b20330 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:05.109969 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc10b7-1486-4a76-baee-93cf65b20330 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:05.110236 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc10b7-1486-4a76-baee-93cf65b20330 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:05.111439 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc10b7-1486-4a76-baee-93cf65b20330 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:05.113166 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc10b7-1486-4a76-baee-93cf65b20330 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:05.114732 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 522/1053] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:48:05 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:05.120993 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e20b2-8154-419a-aa8b-70c445de3ca9 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:05.130323 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e20b2-8154-419a-aa8b-70c445de3ca9 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:05.135140 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67575d14-bcba-4334-8e86-49802036d2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:05.135795 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67575d14-bcba-4334-8e86-49802036d2bb admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:05.136072 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67575d14-bcba-4334-8e86-49802036d2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:05.136341 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67575d14-bcba-4334-8e86-49802036d2bb admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:05.137183 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67575d14-bcba-4334-8e86-49802036d2bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:05.139075 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67575d14-bcba-4334-8e86-49802036d2bb admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:05.168553 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 532/1054] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Dec 24 04:48:05 2021] POST /identity/v3/users => generated 285 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:48:06.490354 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ccde4-7934-4d8b-b5cf-d9ab70a5ed3c None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:06.490953 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ccde4-7934-4d8b-b5cf-d9ab70a5ed3c None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:06.490953 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ccde4-7934-4d8b-b5cf-d9ab70a5ed3c None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:06.492787 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 523/1055] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:48:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:48:06.498736 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60d6ec-8c5e-412b-a468-aad635890626 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:06.499159 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60d6ec-8c5e-412b-a468-aad635890626 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:06.499258 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60d6ec-8c5e-412b-a468-aad635890626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:06.517931 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-cb60d6ec-8c5e-412b-a468-aad635890626 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:48:06.519122 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-cb60d6ec-8c5e-412b-a468-aad635890626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:48:06.527270 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 533/1056] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:48:06 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:48:06.550835 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ccde4-7934-4d8b-b5cf-d9ab70a5ed3c None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:06.563792 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ccde4-7934-4d8b-b5cf-d9ab70a5ed3c None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:06.568704 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a52352-cbcc-4fb8-bac7-31f5cbb2c0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:06.569425 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a52352-cbcc-4fb8-bac7-31f5cbb2c0b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:06.569701 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a52352-cbcc-4fb8-bac7-31f5cbb2c0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:06.569962 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a52352-cbcc-4fb8-bac7-31f5cbb2c0b7 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:06.580566 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a52352-cbcc-4fb8-bac7-31f5cbb2c0b7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:48:06.587998 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-c6a52352-cbcc-4fb8-bac7-31f5cbb2c0b7 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 24 04:48:06.589180 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 524/1057] 10.222.0.43 () {56 vars in 1141 bytes} [Fri Dec 24 04:48:06 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:48:06.595761 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb60d6ec-8c5e-412b-a468-aad635890626 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:06.605047 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb60d6ec-8c5e-412b-a468-aad635890626 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:06.609936 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a67d35-04de-4151-9cd0-cca388dfa46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:06.610594 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a67d35-04de-4151-9cd0-cca388dfa46f admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:06.610868 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a67d35-04de-4151-9cd0-cca388dfa46f admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:06.611138 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a67d35-04de-4151-9cd0-cca388dfa46f admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:06.611899 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a67d35-04de-4151-9cd0-cca388dfa46f admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:48:06.612199 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a67d35-04de-4151-9cd0-cca388dfa46f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:06.613825 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a67d35-04de-4151-9cd0-cca388dfa46f admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:06.622142 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 534/1058] 10.222.0.43 () {56 vars in 1136 bytes} [Fri Dec 24 04:48:06 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:06.628450 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a52352-cbcc-4fb8-bac7-31f5cbb2c0b7 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:06.639106 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a52352-cbcc-4fb8-bac7-31f5cbb2c0b7 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:06.644012 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e9e2c-2a3c-4737-a52a-f2a63dbc8afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:06.644797 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e9e2c-2a3c-4737-a52a-f2a63dbc8afa admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:06.645070 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e9e2c-2a3c-4737-a52a-f2a63dbc8afa admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:06.645336 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e9e2c-2a3c-4737-a52a-f2a63dbc8afa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:06.655626 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e9e2c-2a3c-4737-a52a-f2a63dbc8afa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:06.657504 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e9e2c-2a3c-4737-a52a-f2a63dbc8afa admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:06.675875 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-f53e9e2c-2a3c-4737-a52a-f2a63dbc8afa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:48:06.677064 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 525/1059] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:48:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:48:06.683366 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a67d35-04de-4151-9cd0-cca388dfa46f admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:06.693574 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a67d35-04de-4151-9cd0-cca388dfa46f admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:06.698349 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3960eb-42c9-4931-a502-e1b5fa11093a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:06.698992 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3960eb-42c9-4931-a502-e1b5fa11093a admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:06.699459 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3960eb-42c9-4931-a502-e1b5fa11093a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:06.699808 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3960eb-42c9-4931-a502-e1b5fa11093a admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:06.700468 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3960eb-42c9-4931-a502-e1b5fa11093a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:48:06.700809 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3960eb-42c9-4931-a502-e1b5fa11093a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:06.702391 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3960eb-42c9-4931-a502-e1b5fa11093a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:06.719537 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 535/1060] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:48:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:06.721057 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e9e2c-2a3c-4737-a52a-f2a63dbc8afa admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:06.730734 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e9e2c-2a3c-4737-a52a-f2a63dbc8afa admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:06.735781 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e165916-ae18-45eb-8323-7b72a537dacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:06.736567 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e165916-ae18-45eb-8323-7b72a537dacd admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:06.736843 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e165916-ae18-45eb-8323-7b72a537dacd admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:06.737110 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e165916-ae18-45eb-8323-7b72a537dacd admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:06.744445 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e165916-ae18-45eb-8323-7b72a537dacd admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:06.746498 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e165916-ae18-45eb-8323-7b72a537dacd admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:06.760201 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-1e165916-ae18-45eb-8323-7b72a537dacd admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 24 04:48:06.761508 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 526/1061] 10.222.0.43 () {56 vars in 1114 bytes} [Fri Dec 24 04:48:06 2021] GET /identity/v3/users/nova => generated 82 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:48:06.767520 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3960eb-42c9-4931-a502-e1b5fa11093a admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:06.777309 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3960eb-42c9-4931-a502-e1b5fa11093a admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:06.781935 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e115a07-c0e2-45c5-8e47-3ba88ca04a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:06.782580 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e115a07-c0e2-45c5-8e47-3ba88ca04a5f admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:06.782856 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e115a07-c0e2-45c5-8e47-3ba88ca04a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:06.783124 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e115a07-c0e2-45c5-8e47-3ba88ca04a5f admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:06.783964 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e115a07-c0e2-45c5-8e47-3ba88ca04a5f admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:48:06.784266 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e115a07-c0e2-45c5-8e47-3ba88ca04a5f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:06.786122 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e115a07-c0e2-45c5-8e47-3ba88ca04a5f admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:06.803437 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 536/1062] 10.222.0.43 () {56 vars in 1154 bytes} [Fri Dec 24 04:48:06 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:06.809636 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e165916-ae18-45eb-8323-7b72a537dacd admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:06.819937 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e165916-ae18-45eb-8323-7b72a537dacd admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:06.825785 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffac0b3-708b-4b8d-b0d5-7793307b5afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:06.826563 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffac0b3-708b-4b8d-b0d5-7793307b5afa admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:06.826812 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffac0b3-708b-4b8d-b0d5-7793307b5afa admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:06.827099 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffac0b3-708b-4b8d-b0d5-7793307b5afa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:06.838347 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffac0b3-708b-4b8d-b0d5-7793307b5afa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:06.840299 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffac0b3-708b-4b8d-b0d5-7793307b5afa admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:06.857133 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-8ffac0b3-708b-4b8d-b0d5-7793307b5afa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:48:06.858293 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 527/1063] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:48:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:48:06.864594 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e115a07-c0e2-45c5-8e47-3ba88ca04a5f admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:06.874896 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e115a07-c0e2-45c5-8e47-3ba88ca04a5f admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:06.879906 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d0ea8-46f6-4fb7-ad7a-244f622ecace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:06.880559 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d0ea8-46f6-4fb7-ad7a-244f622ecace admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:06.880851 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d0ea8-46f6-4fb7-ad7a-244f622ecace admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:06.881109 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d0ea8-46f6-4fb7-ad7a-244f622ecace admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:06.881851 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203d0ea8-46f6-4fb7-ad7a-244f622ecace admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:48:06.882149 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203d0ea8-46f6-4fb7-ad7a-244f622ecace admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:06.883735 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203d0ea8-46f6-4fb7-ad7a-244f622ecace admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:06.895193 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 537/1064] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:48:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:06.901177 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffac0b3-708b-4b8d-b0d5-7793307b5afa admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:06.911052 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffac0b3-708b-4b8d-b0d5-7793307b5afa admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:06.915880 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b89ac-f0d1-4895-b09e-cbf0f7b79a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:06.916702 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b89ac-f0d1-4895-b09e-cbf0f7b79a5c admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:06.916978 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b89ac-f0d1-4895-b09e-cbf0f7b79a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:06.917245 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b89ac-f0d1-4895-b09e-cbf0f7b79a5c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:06.923962 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3b89ac-f0d1-4895-b09e-cbf0f7b79a5c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:06.925942 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3b89ac-f0d1-4895-b09e-cbf0f7b79a5c admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:06.938695 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-3b3b89ac-f0d1-4895-b09e-cbf0f7b79a5c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 24 04:48:06.939845 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 528/1065] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Dec 24 04:48:06 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:48:06.946345 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d0ea8-46f6-4fb7-ad7a-244f622ecace admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:06.956733 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d0ea8-46f6-4fb7-ad7a-244f622ecace admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:06.961681 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1435597-78d1-426e-9702-094a7cec9263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:06.962326 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1435597-78d1-426e-9702-094a7cec9263 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:06.962604 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1435597-78d1-426e-9702-094a7cec9263 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:06.962873 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1435597-78d1-426e-9702-094a7cec9263 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:06.963664 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1435597-78d1-426e-9702-094a7cec9263 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:48:06.963967 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1435597-78d1-426e-9702-094a7cec9263 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:06.965901 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1435597-78d1-426e-9702-094a7cec9263 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:06.978466 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 538/1066] 10.222.0.43 () {56 vars in 1169 bytes} [Fri Dec 24 04:48:06 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:06.985130 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b89ac-f0d1-4895-b09e-cbf0f7b79a5c admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:06.995522 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b89ac-f0d1-4895-b09e-cbf0f7b79a5c admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:07.000655 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec235af1-c038-4e08-ba4c-b5115a0b2942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:07.001509 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec235af1-c038-4e08-ba4c-b5115a0b2942 admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:07.001783 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec235af1-c038-4e08-ba4c-b5115a0b2942 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:07.002021 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec235af1-c038-4e08-ba4c-b5115a0b2942 admin admin] PATH_INFO: `/v3/projects/c19ba4a2c0224c079c5a8a6a56569fd6/users/6f9ad1e8f8f74edcb44aabe17eb59648/roles/687cef9f2c0040bc9e427ac01fd7a65c` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:07.004298 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec235af1-c038-4e08-ba4c-b5115a0b2942 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c19ba4a2c0224c079c5a8a6a56569fd6, user_id=6f9ad1e8f8f74edcb44aabe17eb59648, role_id=687cef9f2c0040bc9e427ac01fd7a65c)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:07.006943 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec235af1-c038-4e08-ba4c-b5115a0b2942 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:07.021388 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 529/1067] 10.222.0.43 () {58 vars in 1460 bytes} [Fri Dec 24 04:48:06 2021] PUT /identity/v3/projects/c19ba4a2c0224c079c5a8a6a56569fd6/users/6f9ad1e8f8f74edcb44aabe17eb59648/roles/687cef9f2c0040bc9e427ac01fd7a65c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:48:07.540660 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc690fb1-2e14-4194-8023-5499be0740dc None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:07.541240 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc690fb1-2e14-4194-8023-5499be0740dc None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:07.541240 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc690fb1-2e14-4194-8023-5499be0740dc None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:07.543235 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 539/1068] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:48:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:48:07.549269 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbeb39d-b4fd-48d6-a8dc-4f3a5ff24f92 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:07.549704 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbeb39d-b4fd-48d6-a8dc-4f3a5ff24f92 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:07.549807 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbeb39d-b4fd-48d6-a8dc-4f3a5ff24f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:07.568583 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-efbeb39d-b4fd-48d6-a8dc-4f3a5ff24f92 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:48:07.569703 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-efbeb39d-b4fd-48d6-a8dc-4f3a5ff24f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:48:07.630949 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 530/1069] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:48:07 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:48:07.655266 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc690fb1-2e14-4194-8023-5499be0740dc None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:07.669179 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc690fb1-2e14-4194-8023-5499be0740dc None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:07.674365 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a2aed-0e9c-4bae-8a97-d5d9008f7876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:07.675143 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a2aed-0e9c-4bae-8a97-d5d9008f7876 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:07.675425 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a2aed-0e9c-4bae-8a97-d5d9008f7876 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:07.675683 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a2aed-0e9c-4bae-8a97-d5d9008f7876 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:07.688792 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11a2aed-0e9c-4bae-8a97-d5d9008f7876 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:48:07.695637 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-e11a2aed-0e9c-4bae-8a97-d5d9008f7876 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 24 04:48:07.696854 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 540/1070] 10.222.0.43 () {56 vars in 1117 bytes} [Fri Dec 24 04:48:07 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:48:07.703718 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbeb39d-b4fd-48d6-a8dc-4f3a5ff24f92 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:07.713341 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbeb39d-b4fd-48d6-a8dc-4f3a5ff24f92 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:07.718629 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c7a8a-7628-439d-a9bc-75e37d58eb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:07.719286 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c7a8a-7628-439d-a9bc-75e37d58eb46 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:07.719564 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c7a8a-7628-439d-a9bc-75e37d58eb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:07.719833 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c7a8a-7628-439d-a9bc-75e37d58eb46 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:07.720645 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85c7a8a-7628-439d-a9bc-75e37d58eb46 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:48:07.720949 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85c7a8a-7628-439d-a9bc-75e37d58eb46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:07.722559 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85c7a8a-7628-439d-a9bc-75e37d58eb46 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:07.731355 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 531/1071] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:48:07 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:07.737935 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a2aed-0e9c-4bae-8a97-d5d9008f7876 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:07.749193 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a2aed-0e9c-4bae-8a97-d5d9008f7876 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:07.755233 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9cd52-d8de-482d-9096-3c536a064b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:07.756158 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9cd52-d8de-482d-9096-3c536a064b35 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:07.756607 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9cd52-d8de-482d-9096-3c536a064b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:07.756898 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9cd52-d8de-482d-9096-3c536a064b35 admin admin] PATH_INFO: `/v3/users/712e4b295f3e4ab4acbc405ca8c05bba` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:07.771888 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba9cd52-d8de-482d-9096-3c536a064b35 admin admin] RBAC: Authorizing `identity:get_user(user_id=712e4b295f3e4ab4acbc405ca8c05bba)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:07.774066 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba9cd52-d8de-482d-9096-3c536a064b35 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:07.775939 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 541/1072] 10.222.0.43 () {56 vars in 1198 bytes} [Fri Dec 24 04:48:07 2021] GET /identity/v3/users/712e4b295f3e4ab4acbc405ca8c05bba => generated 285 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:07.782439 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c7a8a-7628-439d-a9bc-75e37d58eb46 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:07.792604 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c7a8a-7628-439d-a9bc-75e37d58eb46 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:07.797355 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51968c-5967-459b-8410-2ca648bd07c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:07.797987 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51968c-5967-459b-8410-2ca648bd07c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:07.798268 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51968c-5967-459b-8410-2ca648bd07c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:07.798541 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51968c-5967-459b-8410-2ca648bd07c3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:07.806664 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e51968c-5967-459b-8410-2ca648bd07c3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:07.808429 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e51968c-5967-459b-8410-2ca648bd07c3 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:07.817541 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 532/1073] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:48:07 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:48:07.824063 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9cd52-d8de-482d-9096-3c536a064b35 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:07.834800 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9cd52-d8de-482d-9096-3c536a064b35 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:07.840939 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dedaf5e-e8b9-4754-b7ac-2a0f6f589b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:07.841798 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dedaf5e-e8b9-4754-b7ac-2a0f6f589b91 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:07.842076 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dedaf5e-e8b9-4754-b7ac-2a0f6f589b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:07.842329 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dedaf5e-e8b9-4754-b7ac-2a0f6f589b91 admin admin] PATH_INFO: `/v3/projects/351a4cf1f2b149cd8d1bbc8d55cb0bc1` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:07.843638 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dedaf5e-e8b9-4754-b7ac-2a0f6f589b91 admin admin] RBAC: Authorizing `identity:get_project(project_id=351a4cf1f2b149cd8d1bbc8d55cb0bc1)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:07.845722 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dedaf5e-e8b9-4754-b7ac-2a0f6f589b91 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:07.847413 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 542/1074] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:48:07 2021] GET /identity/v3/projects/351a4cf1f2b149cd8d1bbc8d55cb0bc1 => generated 311 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:07.853962 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51968c-5967-459b-8410-2ca648bd07c3 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:07.863245 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51968c-5967-459b-8410-2ca648bd07c3 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:07.867992 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b533af-8ac7-458f-a6cb-f3c583539b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:07.868633 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b533af-8ac7-458f-a6cb-f3c583539b35 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:07.868945 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b533af-8ac7-458f-a6cb-f3c583539b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:07.869219 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b533af-8ac7-458f-a6cb-f3c583539b35 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:07.870064 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b533af-8ac7-458f-a6cb-f3c583539b35 admin admin] RBAC: Adding query filter params (role.id=d5e6fc257d8541d5a5ed1988eacd5be7, scope.project.id=351a4cf1f2b149cd8d1bbc8d55cb0bc1, user.id=712e4b295f3e4ab4acbc405ca8c05bba) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:48:07.870372 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b533af-8ac7-458f-a6cb-f3c583539b35 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:07.872553 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b533af-8ac7-458f-a6cb-f3c583539b35 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:07.878245 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 533/1075] 10.222.0.43 () {56 vars in 1395 bytes} [Fri Dec 24 04:48:07 2021] GET /identity/v3/role_assignments?user.id=712e4b295f3e4ab4acbc405ca8c05bba&scope.project.id=351a4cf1f2b149cd8d1bbc8d55cb0bc1&role.id=d5e6fc257d8541d5a5ed1988eacd5be7 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:09.375013 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2acc5-1cb7-42ef-8a96-8977567d68b8 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:09.375537 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2acc5-1cb7-42ef-8a96-8977567d68b8 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:09.375537 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2acc5-1cb7-42ef-8a96-8977567d68b8 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:09.377355 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 543/1076] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:48:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:48:09.383133 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6506cf1-3a7c-4c80-bc09-75309dde4a0d None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:09.383532 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6506cf1-3a7c-4c80-bc09-75309dde4a0d None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:09.383719 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6506cf1-3a7c-4c80-bc09-75309dde4a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:09.402820 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-c6506cf1-3a7c-4c80-bc09-75309dde4a0d None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:48:09.404028 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-c6506cf1-3a7c-4c80-bc09-75309dde4a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:48:09.413393 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 534/1077] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:48:09 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:48:09.437686 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a2acc5-1cb7-42ef-8a96-8977567d68b8 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:09.451472 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a2acc5-1cb7-42ef-8a96-8977567d68b8 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:09.456655 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f05a1d-decc-48f6-a8bc-de9bccc105bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:09.457450 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f05a1d-decc-48f6-a8bc-de9bccc105bc admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:09.457733 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f05a1d-decc-48f6-a8bc-de9bccc105bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:09.458008 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f05a1d-decc-48f6-a8bc-de9bccc105bc admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:09.468715 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f05a1d-decc-48f6-a8bc-de9bccc105bc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:48:09.475950 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-c6f05a1d-decc-48f6-a8bc-de9bccc105bc admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 24 04:48:09.477138 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 544/1078] 10.222.0.43 () {56 vars in 1141 bytes} [Fri Dec 24 04:48:09 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:48:09.483865 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6506cf1-3a7c-4c80-bc09-75309dde4a0d None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:09.493324 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6506cf1-3a7c-4c80-bc09-75309dde4a0d None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:09.499132 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b6a9e-c7f0-4cbc-aacb-6092f2546134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:09.499789 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b6a9e-c7f0-4cbc-aacb-6092f2546134 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:09.500073 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b6a9e-c7f0-4cbc-aacb-6092f2546134 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:09.500345 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b6a9e-c7f0-4cbc-aacb-6092f2546134 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:09.501156 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b6a9e-c7f0-4cbc-aacb-6092f2546134 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:48:09.501463 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b6a9e-c7f0-4cbc-aacb-6092f2546134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:09.503100 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b6a9e-c7f0-4cbc-aacb-6092f2546134 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:09.511906 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 535/1079] 10.222.0.43 () {56 vars in 1136 bytes} [Fri Dec 24 04:48:09 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:48:09.518446 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f05a1d-decc-48f6-a8bc-de9bccc105bc admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:09.529569 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f05a1d-decc-48f6-a8bc-de9bccc105bc admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:09.535466 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b62c1-0364-4cbd-85ad-618c0bd49216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:09.536240 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b62c1-0364-4cbd-85ad-618c0bd49216 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:09.536542 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b62c1-0364-4cbd-85ad-618c0bd49216 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:09.536826 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b62c1-0364-4cbd-85ad-618c0bd49216 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:09.547437 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b62c1-0364-4cbd-85ad-618c0bd49216 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:09.549301 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b62c1-0364-4cbd-85ad-618c0bd49216 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:09.566249 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-5a5b62c1-0364-4cbd-85ad-618c0bd49216 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:48:09.567536 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 545/1080] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:48:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:48:09.573891 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b6a9e-c7f0-4cbc-aacb-6092f2546134 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:09.584395 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b6a9e-c7f0-4cbc-aacb-6092f2546134 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:09.590440 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a437036-54a5-46d4-a230-a34951a40507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:09.591150 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a437036-54a5-46d4-a230-a34951a40507 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:09.591488 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a437036-54a5-46d4-a230-a34951a40507 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:09.591817 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a437036-54a5-46d4-a230-a34951a40507 admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:09.592661 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a437036-54a5-46d4-a230-a34951a40507 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:48:09.593049 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a437036-54a5-46d4-a230-a34951a40507 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:09.594719 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a437036-54a5-46d4-a230-a34951a40507 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:09.606793 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 536/1081] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:48:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:09.613205 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b62c1-0364-4cbd-85ad-618c0bd49216 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:09.623166 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b62c1-0364-4cbd-85ad-618c0bd49216 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:09.628177 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46f816-2e53-4327-843f-da1c9f7686c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:09.628988 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46f816-2e53-4327-843f-da1c9f7686c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:09.629238 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46f816-2e53-4327-843f-da1c9f7686c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:09.629512 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46f816-2e53-4327-843f-da1c9f7686c6 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:09.636958 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e46f816-2e53-4327-843f-da1c9f7686c6 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:09.639061 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e46f816-2e53-4327-843f-da1c9f7686c6 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:09.653048 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-9e46f816-2e53-4327-843f-da1c9f7686c6 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 24 04:48:09.654189 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 546/1082] 10.222.0.43 () {56 vars in 1114 bytes} [Fri Dec 24 04:48:09 2021] GET /identity/v3/users/nova => generated 82 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:48:09.660563 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a437036-54a5-46d4-a230-a34951a40507 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:09.670299 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a437036-54a5-46d4-a230-a34951a40507 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:09.675159 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7df3b9-3b6d-4969-87b6-c7fa8982aa84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:09.675809 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7df3b9-3b6d-4969-87b6-c7fa8982aa84 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:09.676082 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7df3b9-3b6d-4969-87b6-c7fa8982aa84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:09.676347 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7df3b9-3b6d-4969-87b6-c7fa8982aa84 admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:09.677230 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7df3b9-3b6d-4969-87b6-c7fa8982aa84 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:48:09.677531 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7df3b9-3b6d-4969-87b6-c7fa8982aa84 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:09.679381 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7df3b9-3b6d-4969-87b6-c7fa8982aa84 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:09.696404 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 537/1083] 10.222.0.43 () {56 vars in 1154 bytes} [Fri Dec 24 04:48:09 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:09.702979 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46f816-2e53-4327-843f-da1c9f7686c6 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:09.713582 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46f816-2e53-4327-843f-da1c9f7686c6 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:09.718509 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8002db5f-8b6e-4dc1-a944-7ae6b5a1d7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:09.719135 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002db5f-8b6e-4dc1-a944-7ae6b5a1d7e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:09.719412 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002db5f-8b6e-4dc1-a944-7ae6b5a1d7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:09.719686 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002db5f-8b6e-4dc1-a944-7ae6b5a1d7e8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:09.728125 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8002db5f-8b6e-4dc1-a944-7ae6b5a1d7e8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:09.730058 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8002db5f-8b6e-4dc1-a944-7ae6b5a1d7e8 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:09.739463 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 547/1084] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:48:09 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:48:09.745868 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7df3b9-3b6d-4969-87b6-c7fa8982aa84 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:09.756162 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7df3b9-3b6d-4969-87b6-c7fa8982aa84 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:09.761957 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ffa356-f6bb-4b78-be47-c2f58980d8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:09.762756 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ffa356-f6bb-4b78-be47-c2f58980d8f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:09.763040 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ffa356-f6bb-4b78-be47-c2f58980d8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:09.763313 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ffa356-f6bb-4b78-be47-c2f58980d8f5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:09.775079 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ffa356-f6bb-4b78-be47-c2f58980d8f5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:09.777009 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ffa356-f6bb-4b78-be47-c2f58980d8f5 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:09.796317 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-b2ffa356-f6bb-4b78-be47-c2f58980d8f5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:48:09.797626 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 538/1085] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:48:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:48:09.803996 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8002db5f-8b6e-4dc1-a944-7ae6b5a1d7e8 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:09.813377 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8002db5f-8b6e-4dc1-a944-7ae6b5a1d7e8 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:09.819281 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd436b-c502-462f-b1ad-86b856b7dec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:09.819874 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd436b-c502-462f-b1ad-86b856b7dec6 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:09.820152 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd436b-c502-462f-b1ad-86b856b7dec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:09.820420 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd436b-c502-462f-b1ad-86b856b7dec6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:09.821188 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dd436b-c502-462f-b1ad-86b856b7dec6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:48:09.821510 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dd436b-c502-462f-b1ad-86b856b7dec6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:09.823077 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dd436b-c502-462f-b1ad-86b856b7dec6 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:09.835548 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 548/1086] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:48:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:09.841855 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ffa356-f6bb-4b78-be47-c2f58980d8f5 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:09.851809 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ffa356-f6bb-4b78-be47-c2f58980d8f5 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:09.856884 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a8afc9-bfae-4cb3-82ef-43745490df78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:09.857670 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8afc9-bfae-4cb3-82ef-43745490df78 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:09.857948 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8afc9-bfae-4cb3-82ef-43745490df78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:09.858221 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8afc9-bfae-4cb3-82ef-43745490df78 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:09.865139 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a8afc9-bfae-4cb3-82ef-43745490df78 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:09.867101 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a8afc9-bfae-4cb3-82ef-43745490df78 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:09.880181 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-b6a8afc9-bfae-4cb3-82ef-43745490df78 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 24 04:48:09.881373 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 539/1087] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Dec 24 04:48:09 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:48:09.888050 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd436b-c502-462f-b1ad-86b856b7dec6 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:09.898110 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd436b-c502-462f-b1ad-86b856b7dec6 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:09.903256 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6aaec-9838-4904-ac4c-543746a3e17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:09.903894 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6aaec-9838-4904-ac4c-543746a3e17b admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:09.904176 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6aaec-9838-4904-ac4c-543746a3e17b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:09.904450 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6aaec-9838-4904-ac4c-543746a3e17b admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:09.905293 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e6aaec-9838-4904-ac4c-543746a3e17b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:48:09.905587 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e6aaec-9838-4904-ac4c-543746a3e17b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:09.907441 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e6aaec-9838-4904-ac4c-543746a3e17b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:09.920860 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 549/1088] 10.222.0.43 () {56 vars in 1169 bytes} [Fri Dec 24 04:48:09 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:48:09.927295 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a8afc9-bfae-4cb3-82ef-43745490df78 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:09.938650 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a8afc9-bfae-4cb3-82ef-43745490df78 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:09.944424 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9451fe-dea0-4e21-96ab-a8f181ebbecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:09.945102 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9451fe-dea0-4e21-96ab-a8f181ebbecd admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:09.945381 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9451fe-dea0-4e21-96ab-a8f181ebbecd admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:09.945647 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9451fe-dea0-4e21-96ab-a8f181ebbecd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:09.946495 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9451fe-dea0-4e21-96ab-a8f181ebbecd admin admin] RBAC: Adding query filter params (role.id=687cef9f2c0040bc9e427ac01fd7a65c, scope.project.id=c19ba4a2c0224c079c5a8a6a56569fd6, user.id=6f9ad1e8f8f74edcb44aabe17eb59648) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:48:09.946804 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9451fe-dea0-4e21-96ab-a8f181ebbecd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:09.948729 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9451fe-dea0-4e21-96ab-a8f181ebbecd admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:09.955301 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 540/1089] 10.222.0.43 () {56 vars in 1395 bytes} [Fri Dec 24 04:48:09 2021] GET /identity/v3/role_assignments?user.id=6f9ad1e8f8f74edcb44aabe17eb59648&scope.project.id=c19ba4a2c0224c079c5a8a6a56569fd6&role.id=687cef9f2c0040bc9e427ac01fd7a65c => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:10.174652 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a24d5d-c4ca-4190-90a1-f2e1460699ae None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:10.174910 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a24d5d-c4ca-4190-90a1-f2e1460699ae None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:10.175194 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a24d5d-c4ca-4190-90a1-f2e1460699ae None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:10.177095 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 550/1090] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:48:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:48:10.183002 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9bde44-0fce-4be5-8e5d-9dcb1b3a0234 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:10.183292 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9bde44-0fce-4be5-8e5d-9dcb1b3a0234 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:10.183664 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9bde44-0fce-4be5-8e5d-9dcb1b3a0234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:10.201821 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-af9bde44-0fce-4be5-8e5d-9dcb1b3a0234 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:48:10.202986 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-af9bde44-0fce-4be5-8e5d-9dcb1b3a0234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:48:10.211765 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 541/1091] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:48:10 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:48:10.236582 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a24d5d-c4ca-4190-90a1-f2e1460699ae None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:10.250269 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a24d5d-c4ca-4190-90a1-f2e1460699ae None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:10.255388 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122fa6f-224c-4679-b636-74b98fc9ecd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:10.256174 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122fa6f-224c-4679-b636-74b98fc9ecd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:10.256453 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122fa6f-224c-4679-b636-74b98fc9ecd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:10.256754 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122fa6f-224c-4679-b636-74b98fc9ecd7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:10.268835 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2122fa6f-224c-4679-b636-74b98fc9ecd7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:48:10.280181 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-2122fa6f-224c-4679-b636-74b98fc9ecd7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 24 04:48:10.282303 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 551/1092] 10.222.0.43 () {56 vars in 1117 bytes} [Fri Dec 24 04:48:10 2021] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:48:10.290131 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9bde44-0fce-4be5-8e5d-9dcb1b3a0234 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:10.299398 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9bde44-0fce-4be5-8e5d-9dcb1b3a0234 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:10.304376 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534df96-71f3-4c88-b7c0-4c376f9edcaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:10.305084 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534df96-71f3-4c88-b7c0-4c376f9edcaa admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:10.305351 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534df96-71f3-4c88-b7c0-4c376f9edcaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:10.305659 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534df96-71f3-4c88-b7c0-4c376f9edcaa admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:10.306853 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a534df96-71f3-4c88-b7c0-4c376f9edcaa admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:48:10.307161 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a534df96-71f3-4c88-b7c0-4c376f9edcaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:10.308857 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a534df96-71f3-4c88-b7c0-4c376f9edcaa admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:10.317900 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 542/1093] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:48:10 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:10.324291 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122fa6f-224c-4679-b636-74b98fc9ecd7 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:10.334937 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122fa6f-224c-4679-b636-74b98fc9ecd7 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:10.340336 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e88c14c-8a71-494d-a68e-e0132640281b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:10.341226 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88c14c-8a71-494d-a68e-e0132640281b admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:10.341506 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88c14c-8a71-494d-a68e-e0132640281b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:10.341776 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88c14c-8a71-494d-a68e-e0132640281b admin admin] PATH_INFO: `/v3/users/712e4b295f3e4ab4acbc405ca8c05bba` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:10.343100 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e88c14c-8a71-494d-a68e-e0132640281b admin admin] RBAC: Authorizing `identity:get_user(user_id=712e4b295f3e4ab4acbc405ca8c05bba)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:10.345323 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e88c14c-8a71-494d-a68e-e0132640281b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:10.346913 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 552/1094] 10.222.0.43 () {56 vars in 1198 bytes} [Fri Dec 24 04:48:10 2021] GET /identity/v3/users/712e4b295f3e4ab4acbc405ca8c05bba => generated 285 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:10.353466 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534df96-71f3-4c88-b7c0-4c376f9edcaa admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:10.363884 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534df96-71f3-4c88-b7c0-4c376f9edcaa admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:10.368760 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a19f08-1458-4019-9253-fae166ca0b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:10.371070 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a19f08-1458-4019-9253-fae166ca0b8a admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:10.371070 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a19f08-1458-4019-9253-fae166ca0b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:10.371070 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a19f08-1458-4019-9253-fae166ca0b8a admin admin] PATH_INFO: `/v3/projects/351a4cf1f2b149cd8d1bbc8d55cb0bc1` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:10.371579 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a19f08-1458-4019-9253-fae166ca0b8a admin admin] RBAC: Authorizing `identity:get_project(project_id=351a4cf1f2b149cd8d1bbc8d55cb0bc1)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:10.373839 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a19f08-1458-4019-9253-fae166ca0b8a admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:10.375600 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 543/1095] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:48:10 2021] GET /identity/v3/projects/351a4cf1f2b149cd8d1bbc8d55cb0bc1 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:10.382384 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e88c14c-8a71-494d-a68e-e0132640281b admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:10.393058 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e88c14c-8a71-494d-a68e-e0132640281b admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:10.397741 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99207956-76db-4237-bf80-912c4f28cbc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:10.398622 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99207956-76db-4237-bf80-912c4f28cbc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:10.398898 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99207956-76db-4237-bf80-912c4f28cbc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:10.399144 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99207956-76db-4237-bf80-912c4f28cbc2 admin admin] PATH_INFO: `/v3/projects/351a4cf1f2b149cd8d1bbc8d55cb0bc1/users/712e4b295f3e4ab4acbc405ca8c05bba/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:10.401293 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99207956-76db-4237-bf80-912c4f28cbc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=351a4cf1f2b149cd8d1bbc8d55cb0bc1, user_id=712e4b295f3e4ab4acbc405ca8c05bba, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:10.404115 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99207956-76db-4237-bf80-912c4f28cbc2 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:10.419031 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 553/1096] 10.222.0.43 () {58 vars in 1460 bytes} [Fri Dec 24 04:48:10 2021] PUT /identity/v3/projects/351a4cf1f2b149cd8d1bbc8d55cb0bc1/users/712e4b295f3e4ab4acbc405ca8c05bba/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 04:48:12.759597 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3bff46-43de-4327-9b19-91be57cb927b None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:12.760143 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3bff46-43de-4327-9b19-91be57cb927b None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:12.760143 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3bff46-43de-4327-9b19-91be57cb927b None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:12.762176 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 544/1097] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:48:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:48:12.769463 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce2ccf-d51f-4ca8-9735-bfbcc3f2fb16 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:12.770160 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce2ccf-d51f-4ca8-9735-bfbcc3f2fb16 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:12.770345 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce2ccf-d51f-4ca8-9735-bfbcc3f2fb16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:12.797661 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-2dce2ccf-d51f-4ca8-9735-bfbcc3f2fb16 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:48:12.798863 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-2dce2ccf-d51f-4ca8-9735-bfbcc3f2fb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:48:12.862310 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 554/1098] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:48:12 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 04:48:12.887877 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3bff46-43de-4327-9b19-91be57cb927b None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:12.902749 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3bff46-43de-4327-9b19-91be57cb927b None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:12.908757 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc6a7c-1c3e-44f1-94f8-48a6a02c9b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:12.909533 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc6a7c-1c3e-44f1-94f8-48a6a02c9b3d admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:12.909812 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc6a7c-1c3e-44f1-94f8-48a6a02c9b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:12.910084 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc6a7c-1c3e-44f1-94f8-48a6a02c9b3d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:12.922305 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dc6a7c-1c3e-44f1-94f8-48a6a02c9b3d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:48:12.929232 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-31dc6a7c-1c3e-44f1-94f8-48a6a02c9b3d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 24 04:48:12.930387 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 545/1099] 10.222.0.43 () {56 vars in 1117 bytes} [Fri Dec 24 04:48:12 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:48:12.937989 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce2ccf-d51f-4ca8-9735-bfbcc3f2fb16 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:12.952817 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce2ccf-d51f-4ca8-9735-bfbcc3f2fb16 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:12.962753 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdf957f-509b-4e5b-8c2c-947de4d920d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:12.963791 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf957f-509b-4e5b-8c2c-947de4d920d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:12.964253 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf957f-509b-4e5b-8c2c-947de4d920d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:12.964932 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf957f-509b-4e5b-8c2c-947de4d920d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:12.965795 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdf957f-509b-4e5b-8c2c-947de4d920d4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:48:12.966095 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdf957f-509b-4e5b-8c2c-947de4d920d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:12.967786 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdf957f-509b-4e5b-8c2c-947de4d920d4 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:12.976463 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 555/1100] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:48:12 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:12.983107 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc6a7c-1c3e-44f1-94f8-48a6a02c9b3d admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:12.993784 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc6a7c-1c3e-44f1-94f8-48a6a02c9b3d admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:13.000455 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ca550-57a1-49e1-856a-b243cb77846c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:13.001364 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ca550-57a1-49e1-856a-b243cb77846c admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:13.001648 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ca550-57a1-49e1-856a-b243cb77846c admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:13.001916 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ca550-57a1-49e1-856a-b243cb77846c admin admin] PATH_INFO: `/v3/users/712e4b295f3e4ab4acbc405ca8c05bba` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:13.003351 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0ca550-57a1-49e1-856a-b243cb77846c admin admin] RBAC: Authorizing `identity:get_user(user_id=712e4b295f3e4ab4acbc405ca8c05bba)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:13.005549 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0ca550-57a1-49e1-856a-b243cb77846c admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:13.007132 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 546/1101] 10.222.0.43 () {56 vars in 1198 bytes} [Fri Dec 24 04:48:12 2021] GET /identity/v3/users/712e4b295f3e4ab4acbc405ca8c05bba => generated 285 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:13.014168 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdf957f-509b-4e5b-8c2c-947de4d920d4 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:13.025155 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdf957f-509b-4e5b-8c2c-947de4d920d4 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:13.031068 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e266a4-634b-439d-9e03-5548a51de2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:13.031698 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e266a4-634b-439d-9e03-5548a51de2b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:13.031980 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e266a4-634b-439d-9e03-5548a51de2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:13.032252 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e266a4-634b-439d-9e03-5548a51de2b2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:13.040078 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e266a4-634b-439d-9e03-5548a51de2b2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:13.041853 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e266a4-634b-439d-9e03-5548a51de2b2 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:13.050854 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 556/1102] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:48:13 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:48:13.057053 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ca550-57a1-49e1-856a-b243cb77846c admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:13.067557 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ca550-57a1-49e1-856a-b243cb77846c admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:13.073688 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6b1acf-70ca-4c92-8304-e33f2d9ca0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:13.074540 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b1acf-70ca-4c92-8304-e33f2d9ca0a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:13.074813 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b1acf-70ca-4c92-8304-e33f2d9ca0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:13.075081 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b1acf-70ca-4c92-8304-e33f2d9ca0a5 admin admin] PATH_INFO: `/v3/projects/351a4cf1f2b149cd8d1bbc8d55cb0bc1` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:13.076423 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6b1acf-70ca-4c92-8304-e33f2d9ca0a5 admin admin] RBAC: Authorizing `identity:get_project(project_id=351a4cf1f2b149cd8d1bbc8d55cb0bc1)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:13.078484 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6b1acf-70ca-4c92-8304-e33f2d9ca0a5 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:13.080099 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 547/1103] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:48:13 2021] GET /identity/v3/projects/351a4cf1f2b149cd8d1bbc8d55cb0bc1 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:13.086844 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e266a4-634b-439d-9e03-5548a51de2b2 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:13.095947 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e266a4-634b-439d-9e03-5548a51de2b2 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:13.102479 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ae1c7-9160-4b2d-8533-3f93688f285f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:13.103088 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ae1c7-9160-4b2d-8533-3f93688f285f admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:13.103367 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ae1c7-9160-4b2d-8533-3f93688f285f admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:13.103633 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ae1c7-9160-4b2d-8533-3f93688f285f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:13.104468 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41ae1c7-9160-4b2d-8533-3f93688f285f admin admin] RBAC: Adding query filter params (role.id=d5e6fc257d8541d5a5ed1988eacd5be7, scope.project.id=351a4cf1f2b149cd8d1bbc8d55cb0bc1, user.id=712e4b295f3e4ab4acbc405ca8c05bba) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:48:13.104804 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41ae1c7-9160-4b2d-8533-3f93688f285f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:13.106604 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41ae1c7-9160-4b2d-8533-3f93688f285f admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:13.112793 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 557/1104] 10.222.0.43 () {56 vars in 1395 bytes} [Fri Dec 24 04:48:13 2021] GET /identity/v3/role_assignments?user.id=712e4b295f3e4ab4acbc405ca8c05bba&scope.project.id=351a4cf1f2b149cd8d1bbc8d55cb0bc1&role.id=d5e6fc257d8541d5a5ed1988eacd5be7 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:15.447226 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893b036-6df4-4a8c-b87f-03ae71457b0f None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:15.448056 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893b036-6df4-4a8c-b87f-03ae71457b0f None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:15.448056 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893b036-6df4-4a8c-b87f-03ae71457b0f None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:15.450424 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 548/1105] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:48:15 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:48:15.456515 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef130f3-ef54-4594-845e-af477dacfb18 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:15.456977 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef130f3-ef54-4594-845e-af477dacfb18 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:15.457070 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef130f3-ef54-4594-845e-af477dacfb18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:15.476902 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-eef130f3-ef54-4594-845e-af477dacfb18 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:48:15.478077 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-eef130f3-ef54-4594-845e-af477dacfb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:48:15.489005 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 558/1106] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:48:15 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:48:15.515362 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d893b036-6df4-4a8c-b87f-03ae71457b0f None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:15.536093 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d893b036-6df4-4a8c-b87f-03ae71457b0f None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:15.543536 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470bd09-0372-4754-a7c3-e4b0db5a3e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:15.544320 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470bd09-0372-4754-a7c3-e4b0db5a3e7c admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:15.544619 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470bd09-0372-4754-a7c3-e4b0db5a3e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:15.544886 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470bd09-0372-4754-a7c3-e4b0db5a3e7c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:15.546206 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8470bd09-0372-4754-a7c3-e4b0db5a3e7c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:15.547885 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8470bd09-0372-4754-a7c3-e4b0db5a3e7c admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:15.549457 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 549/1107] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:48:15 2021] GET /identity/v3/domains/default => generated 199 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:48:15.555458 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef130f3-ef54-4594-845e-af477dacfb18 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:15.564396 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef130f3-ef54-4594-845e-af477dacfb18 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:15.569757 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a8e387-7524-4426-a8dc-8b29a9ba8b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:15.570339 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8e387-7524-4426-a8dc-8b29a9ba8b05 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:15.570611 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8e387-7524-4426-a8dc-8b29a9ba8b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:15.570884 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8e387-7524-4426-a8dc-8b29a9ba8b05 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:15.571608 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a8e387-7524-4426-a8dc-8b29a9ba8b05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:15.573540 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a8e387-7524-4426-a8dc-8b29a9ba8b05 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:15.600296 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 559/1108] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Dec 24 04:48:15 2021] POST /identity/v3/users => generated 286 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:48:18.022203 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e33a3-fd72-4718-b3d6-9334116cd0c8 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:18.022764 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e33a3-fd72-4718-b3d6-9334116cd0c8 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:18.022764 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e33a3-fd72-4718-b3d6-9334116cd0c8 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:18.025564 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 550/1109] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:48:18 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:48:18.035483 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecce4a0-cdb3-42c2-b8ba-9934f226c5dc None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:18.035916 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecce4a0-cdb3-42c2-b8ba-9934f226c5dc None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:18.036106 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecce4a0-cdb3-42c2-b8ba-9934f226c5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:18.059833 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-5ecce4a0-cdb3-42c2-b8ba-9934f226c5dc None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:48:18.061068 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-5ecce4a0-cdb3-42c2-b8ba-9934f226c5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:48:18.070003 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 560/1110] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:48:18 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:48:18.102993 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e33a3-fd72-4718-b3d6-9334116cd0c8 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:18.124309 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e33a3-fd72-4718-b3d6-9334116cd0c8 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:18.131185 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10587b-fc9d-4719-88bd-31f6984f9354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:18.132029 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10587b-fc9d-4719-88bd-31f6984f9354 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:18.132308 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10587b-fc9d-4719-88bd-31f6984f9354 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:18.132813 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10587b-fc9d-4719-88bd-31f6984f9354 admin admin] PATH_INFO: `/v3/roles/62790996bc274dda9199846ea736d771` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:18.135367 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c10587b-fc9d-4719-88bd-31f6984f9354 admin admin] RBAC: Authorizing `identity:get_role(role_id=62790996bc274dda9199846ea736d771)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:18.136431 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING py.warnings [None req-3c10587b-fc9d-4719-88bd-31f6984f9354 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:48:18.136431 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: warnings.warn(msg) Dec 24 04:48:18.136431 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: Dec 24 04:48:18.137330 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c10587b-fc9d-4719-88bd-31f6984f9354 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:18.138670 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 551/1111] 10.222.0.43 () {56 vars in 1198 bytes} [Fri Dec 24 04:48:18 2021] GET /identity/v3/roles/62790996bc274dda9199846ea736d771 => generated 223 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:18.145365 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecce4a0-cdb3-42c2-b8ba-9934f226c5dc None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:18.155867 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecce4a0-cdb3-42c2-b8ba-9934f226c5dc None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:18.161707 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f5daac-d414-4b5d-941e-209fc5c1d882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:18.162568 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5daac-d414-4b5d-941e-209fc5c1d882 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:18.162841 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5daac-d414-4b5d-941e-209fc5c1d882 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:18.163108 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5daac-d414-4b5d-941e-209fc5c1d882 admin admin] PATH_INFO: `/v3/users/a769b957cc8a4edcafd11a56b034ab51` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:18.177647 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f5daac-d414-4b5d-941e-209fc5c1d882 admin admin] RBAC: Authorizing `identity:get_user(user_id=a769b957cc8a4edcafd11a56b034ab51)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:18.179773 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f5daac-d414-4b5d-941e-209fc5c1d882 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:18.181400 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 561/1112] 10.222.0.43 () {56 vars in 1198 bytes} [Fri Dec 24 04:48:18 2021] GET /identity/v3/users/a769b957cc8a4edcafd11a56b034ab51 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:18.187777 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10587b-fc9d-4719-88bd-31f6984f9354 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:18.198210 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10587b-fc9d-4719-88bd-31f6984f9354 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:18.204840 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfa000d-b2b8-45f2-9535-306915728450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:18.205467 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa000d-b2b8-45f2-9535-306915728450 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:18.205745 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa000d-b2b8-45f2-9535-306915728450 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:18.206014 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa000d-b2b8-45f2-9535-306915728450 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:18.214965 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfa000d-b2b8-45f2-9535-306915728450 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:18.216731 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfa000d-b2b8-45f2-9535-306915728450 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:18.225525 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 552/1113] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:48:18 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:48:18.231936 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f5daac-d414-4b5d-941e-209fc5c1d882 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:18.242076 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f5daac-d414-4b5d-941e-209fc5c1d882 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:18.248592 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d057b-b858-4e84-9c56-a3c6ded5615e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:18.249431 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d057b-b858-4e84-9c56-a3c6ded5615e admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:18.249706 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d057b-b858-4e84-9c56-a3c6ded5615e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:18.249975 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d057b-b858-4e84-9c56-a3c6ded5615e admin admin] PATH_INFO: `/v3/projects/351a4cf1f2b149cd8d1bbc8d55cb0bc1` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:18.251368 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d057b-b858-4e84-9c56-a3c6ded5615e admin admin] RBAC: Authorizing `identity:get_project(project_id=351a4cf1f2b149cd8d1bbc8d55cb0bc1)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:18.253427 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d057b-b858-4e84-9c56-a3c6ded5615e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:18.255044 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 562/1114] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:48:18 2021] GET /identity/v3/projects/351a4cf1f2b149cd8d1bbc8d55cb0bc1 => generated 311 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:18.261669 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfa000d-b2b8-45f2-9535-306915728450 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:18.270426 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfa000d-b2b8-45f2-9535-306915728450 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:18.276187 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6623a7c-20df-4bd5-831a-a4fa3278bc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:18.276770 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6623a7c-20df-4bd5-831a-a4fa3278bc73 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:18.277144 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6623a7c-20df-4bd5-831a-a4fa3278bc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:18.277416 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6623a7c-20df-4bd5-831a-a4fa3278bc73 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:18.278259 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6623a7c-20df-4bd5-831a-a4fa3278bc73 admin admin] RBAC: Adding query filter params (role.id=62790996bc274dda9199846ea736d771, scope.project.id=351a4cf1f2b149cd8d1bbc8d55cb0bc1, user.id=a769b957cc8a4edcafd11a56b034ab51) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:48:18.278565 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6623a7c-20df-4bd5-831a-a4fa3278bc73 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:18.280366 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6623a7c-20df-4bd5-831a-a4fa3278bc73 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:18.285854 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 553/1115] 10.222.0.43 () {56 vars in 1395 bytes} [Fri Dec 24 04:48:18 2021] GET /identity/v3/role_assignments?user.id=a769b957cc8a4edcafd11a56b034ab51&scope.project.id=351a4cf1f2b149cd8d1bbc8d55cb0bc1&role.id=62790996bc274dda9199846ea736d771 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:48:20.586138 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df08dd-26d0-4806-a57a-440d28e97183 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:20.586664 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df08dd-26d0-4806-a57a-440d28e97183 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:20.586664 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df08dd-26d0-4806-a57a-440d28e97183 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:20.588371 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 563/1116] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:48:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:48:20.595355 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066545d7-eec7-48a1-9090-70e6258cdb3f None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:20.596022 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066545d7-eec7-48a1-9090-70e6258cdb3f None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:20.596176 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066545d7-eec7-48a1-9090-70e6258cdb3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:20.624548 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-066545d7-eec7-48a1-9090-70e6258cdb3f None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:48:20.625751 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-066545d7-eec7-48a1-9090-70e6258cdb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:48:20.635936 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 554/1117] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:48:20 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:48:20.666587 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df08dd-26d0-4806-a57a-440d28e97183 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:20.682005 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df08dd-26d0-4806-a57a-440d28e97183 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:20.688890 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb804698-1dc9-4ef1-8671-3b78e519ac28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:20.689724 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb804698-1dc9-4ef1-8671-3b78e519ac28 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:20.690006 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb804698-1dc9-4ef1-8671-3b78e519ac28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:20.690278 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb804698-1dc9-4ef1-8671-3b78e519ac28 admin admin] PATH_INFO: `/v3/roles/62790996bc274dda9199846ea736d771` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:20.691891 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb804698-1dc9-4ef1-8671-3b78e519ac28 admin admin] RBAC: Authorizing `identity:get_role(role_id=62790996bc274dda9199846ea736d771)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:20.692942 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING py.warnings [None req-cb804698-1dc9-4ef1-8671-3b78e519ac28 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:48:20.692942 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: warnings.warn(msg) Dec 24 04:48:20.692942 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: Dec 24 04:48:20.693804 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb804698-1dc9-4ef1-8671-3b78e519ac28 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:20.695109 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 564/1118] 10.222.0.43 () {56 vars in 1198 bytes} [Fri Dec 24 04:48:20 2021] GET /identity/v3/roles/62790996bc274dda9199846ea736d771 => generated 223 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:20.703076 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066545d7-eec7-48a1-9090-70e6258cdb3f None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:20.712564 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066545d7-eec7-48a1-9090-70e6258cdb3f None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:20.718201 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aaeaa6-12b5-49fa-b5aa-f9725c61be53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:20.719050 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aaeaa6-12b5-49fa-b5aa-f9725c61be53 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:20.719324 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aaeaa6-12b5-49fa-b5aa-f9725c61be53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:20.719591 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aaeaa6-12b5-49fa-b5aa-f9725c61be53 admin admin] PATH_INFO: `/v3/users/a769b957cc8a4edcafd11a56b034ab51` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:20.720870 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aaeaa6-12b5-49fa-b5aa-f9725c61be53 admin admin] RBAC: Authorizing `identity:get_user(user_id=a769b957cc8a4edcafd11a56b034ab51)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:20.722980 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aaeaa6-12b5-49fa-b5aa-f9725c61be53 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:20.724558 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 555/1119] 10.222.0.43 () {56 vars in 1198 bytes} [Fri Dec 24 04:48:20 2021] GET /identity/v3/users/a769b957cc8a4edcafd11a56b034ab51 => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:20.730778 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb804698-1dc9-4ef1-8671-3b78e519ac28 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:20.741172 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb804698-1dc9-4ef1-8671-3b78e519ac28 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:20.746992 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ea2386-09f0-42c9-a855-e2d9fefd9cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:20.747828 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea2386-09f0-42c9-a855-e2d9fefd9cff admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:20.748106 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea2386-09f0-42c9-a855-e2d9fefd9cff admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:20.748377 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea2386-09f0-42c9-a855-e2d9fefd9cff admin admin] PATH_INFO: `/v3/projects/351a4cf1f2b149cd8d1bbc8d55cb0bc1` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:20.749726 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ea2386-09f0-42c9-a855-e2d9fefd9cff admin admin] RBAC: Authorizing `identity:get_project(project_id=351a4cf1f2b149cd8d1bbc8d55cb0bc1)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:20.751753 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ea2386-09f0-42c9-a855-e2d9fefd9cff admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:20.753453 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 565/1120] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:48:20 2021] GET /identity/v3/projects/351a4cf1f2b149cd8d1bbc8d55cb0bc1 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:20.759492 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aaeaa6-12b5-49fa-b5aa-f9725c61be53 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:20.769697 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aaeaa6-12b5-49fa-b5aa-f9725c61be53 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:20.775431 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494083fb-6786-4d61-abce-1c366341f9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:20.776286 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494083fb-6786-4d61-abce-1c366341f9da admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:20.776566 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494083fb-6786-4d61-abce-1c366341f9da admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:20.776852 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494083fb-6786-4d61-abce-1c366341f9da admin admin] PATH_INFO: `/v3/projects/351a4cf1f2b149cd8d1bbc8d55cb0bc1/users/a769b957cc8a4edcafd11a56b034ab51/roles/62790996bc274dda9199846ea736d771` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:20.779479 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494083fb-6786-4d61-abce-1c366341f9da admin admin] RBAC: Authorizing `identity:create_grant(project_id=351a4cf1f2b149cd8d1bbc8d55cb0bc1, user_id=a769b957cc8a4edcafd11a56b034ab51, role_id=62790996bc274dda9199846ea736d771)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:20.782090 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494083fb-6786-4d61-abce-1c366341f9da admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:20.798908 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 556/1121] 10.222.0.43 () {58 vars in 1460 bytes} [Fri Dec 24 04:48:20 2021] PUT /identity/v3/projects/351a4cf1f2b149cd8d1bbc8d55cb0bc1/users/a769b957cc8a4edcafd11a56b034ab51/roles/62790996bc274dda9199846ea736d771 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 04:48:23.087523 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434450d-1d7b-4de9-9168-19b071ba1b92 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:23.088114 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434450d-1d7b-4de9-9168-19b071ba1b92 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:23.088114 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434450d-1d7b-4de9-9168-19b071ba1b92 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:23.089900 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 566/1122] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:48:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:48:23.096340 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed545b-b8cd-41d3-b6a5-6bfe7fab2933 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:23.097169 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed545b-b8cd-41d3-b6a5-6bfe7fab2933 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:23.097789 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed545b-b8cd-41d3-b6a5-6bfe7fab2933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:23.122559 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-efed545b-b8cd-41d3-b6a5-6bfe7fab2933 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:48:23.123753 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-efed545b-b8cd-41d3-b6a5-6bfe7fab2933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:48:23.188118 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 557/1123] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:48:23 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:48:23.216683 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c434450d-1d7b-4de9-9168-19b071ba1b92 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:23.230926 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c434450d-1d7b-4de9-9168-19b071ba1b92 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:23.236916 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a241551-34d5-4c7e-a1a1-a3fec3624e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:23.237757 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a241551-34d5-4c7e-a1a1-a3fec3624e42 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:23.238032 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a241551-34d5-4c7e-a1a1-a3fec3624e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:23.238299 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a241551-34d5-4c7e-a1a1-a3fec3624e42 admin admin] PATH_INFO: `/v3/roles/62790996bc274dda9199846ea736d771` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:23.239911 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a241551-34d5-4c7e-a1a1-a3fec3624e42 admin admin] RBAC: Authorizing `identity:get_role(role_id=62790996bc274dda9199846ea736d771)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:23.241547 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a241551-34d5-4c7e-a1a1-a3fec3624e42 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:23.242861 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 567/1124] 10.222.0.43 () {56 vars in 1198 bytes} [Fri Dec 24 04:48:23 2021] GET /identity/v3/roles/62790996bc274dda9199846ea736d771 => generated 223 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:23.250496 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed545b-b8cd-41d3-b6a5-6bfe7fab2933 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:23.263946 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed545b-b8cd-41d3-b6a5-6bfe7fab2933 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:23.270265 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659af075-e9b0-46a2-a9cc-6b6588962351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:23.271112 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659af075-e9b0-46a2-a9cc-6b6588962351 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:23.271385 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659af075-e9b0-46a2-a9cc-6b6588962351 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:23.271651 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659af075-e9b0-46a2-a9cc-6b6588962351 admin admin] PATH_INFO: `/v3/users/a769b957cc8a4edcafd11a56b034ab51` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:23.273112 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659af075-e9b0-46a2-a9cc-6b6588962351 admin admin] RBAC: Authorizing `identity:get_user(user_id=a769b957cc8a4edcafd11a56b034ab51)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:23.275230 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659af075-e9b0-46a2-a9cc-6b6588962351 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:23.276828 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 558/1125] 10.222.0.43 () {56 vars in 1198 bytes} [Fri Dec 24 04:48:23 2021] GET /identity/v3/users/a769b957cc8a4edcafd11a56b034ab51 => generated 286 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:23.282990 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a241551-34d5-4c7e-a1a1-a3fec3624e42 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:23.294042 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a241551-34d5-4c7e-a1a1-a3fec3624e42 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:23.301732 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee1138-e4ae-44d5-8ec6-83aa74c62a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:23.302615 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee1138-e4ae-44d5-8ec6-83aa74c62a9f admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:23.302944 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee1138-e4ae-44d5-8ec6-83aa74c62a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:23.303217 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee1138-e4ae-44d5-8ec6-83aa74c62a9f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:23.313005 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfee1138-e4ae-44d5-8ec6-83aa74c62a9f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:23.314755 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfee1138-e4ae-44d5-8ec6-83aa74c62a9f admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:23.324625 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 568/1126] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:48:23 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:48:23.331602 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659af075-e9b0-46a2-a9cc-6b6588962351 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:23.345650 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659af075-e9b0-46a2-a9cc-6b6588962351 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:23.351583 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53798d2-a081-4559-9005-6245eda0af28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:23.352419 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53798d2-a081-4559-9005-6245eda0af28 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:23.352755 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53798d2-a081-4559-9005-6245eda0af28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:23.353021 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53798d2-a081-4559-9005-6245eda0af28 admin admin] PATH_INFO: `/v3/projects/351a4cf1f2b149cd8d1bbc8d55cb0bc1` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:23.354352 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53798d2-a081-4559-9005-6245eda0af28 admin admin] RBAC: Authorizing `identity:get_project(project_id=351a4cf1f2b149cd8d1bbc8d55cb0bc1)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:23.356374 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53798d2-a081-4559-9005-6245eda0af28 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:23.358043 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 559/1127] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:48:23 2021] GET /identity/v3/projects/351a4cf1f2b149cd8d1bbc8d55cb0bc1 => generated 311 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:23.364445 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee1138-e4ae-44d5-8ec6-83aa74c62a9f admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:23.374087 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee1138-e4ae-44d5-8ec6-83aa74c62a9f admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:23.380662 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c67168-63a1-4128-95e3-cdfb271a106a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:23.381290 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c67168-63a1-4128-95e3-cdfb271a106a admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:23.381566 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c67168-63a1-4128-95e3-cdfb271a106a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:23.381837 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c67168-63a1-4128-95e3-cdfb271a106a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:23.382673 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c67168-63a1-4128-95e3-cdfb271a106a admin admin] RBAC: Adding query filter params (role.id=62790996bc274dda9199846ea736d771, scope.project.id=351a4cf1f2b149cd8d1bbc8d55cb0bc1, user.id=a769b957cc8a4edcafd11a56b034ab51) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:48:23.382977 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c67168-63a1-4128-95e3-cdfb271a106a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:23.384831 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c67168-63a1-4128-95e3-cdfb271a106a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:23.391154 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 569/1128] 10.222.0.43 () {56 vars in 1395 bytes} [Fri Dec 24 04:48:23 2021] GET /identity/v3/role_assignments?user.id=a769b957cc8a4edcafd11a56b034ab51&scope.project.id=351a4cf1f2b149cd8d1bbc8d55cb0bc1&role.id=62790996bc274dda9199846ea736d771 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:25.751499 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031814e-3660-47a6-b288-02f19f9bffe9 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:25.752303 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031814e-3660-47a6-b288-02f19f9bffe9 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:25.752303 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031814e-3660-47a6-b288-02f19f9bffe9 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:25.755307 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 560/1129] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:48:25 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:48:25.766493 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e5fd67-d151-4b69-8116-1d25274829d5 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:25.767184 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e5fd67-d151-4b69-8116-1d25274829d5 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:25.767318 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e5fd67-d151-4b69-8116-1d25274829d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:25.789856 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-d2e5fd67-d151-4b69-8116-1d25274829d5 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:48:25.791055 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-d2e5fd67-d151-4b69-8116-1d25274829d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:48:25.800466 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 570/1130] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:48:25 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:48:25.825992 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8031814e-3660-47a6-b288-02f19f9bffe9 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:25.847005 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8031814e-3660-47a6-b288-02f19f9bffe9 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:25.853398 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069241ff-ae3c-4b62-bdd6-a34a27c8862c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:25.854182 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069241ff-ae3c-4b62-bdd6-a34a27c8862c admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:25.854461 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069241ff-ae3c-4b62-bdd6-a34a27c8862c admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:25.854711 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069241ff-ae3c-4b62-bdd6-a34a27c8862c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:25.856501 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069241ff-ae3c-4b62-bdd6-a34a27c8862c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:25.858246 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069241ff-ae3c-4b62-bdd6-a34a27c8862c admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:25.859814 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 561/1131] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:48:25 2021] GET /identity/v3/domains/default => generated 199 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:25.865989 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e5fd67-d151-4b69-8116-1d25274829d5 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:25.875644 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e5fd67-d151-4b69-8116-1d25274829d5 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:25.880699 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832730b6-63b3-4837-a89a-ddbdc6e50a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:25.881315 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832730b6-63b3-4837-a89a-ddbdc6e50a0f admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:25.881591 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832730b6-63b3-4837-a89a-ddbdc6e50a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:25.881861 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832730b6-63b3-4837-a89a-ddbdc6e50a0f admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:25.882584 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832730b6-63b3-4837-a89a-ddbdc6e50a0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:25.884460 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832730b6-63b3-4837-a89a-ddbdc6e50a0f admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:25.918120 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 571/1132] 10.222.0.43 () {60 vars in 1162 bytes} [Fri Dec 24 04:48:25 2021] POST /identity/v3/projects => generated 311 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:48:28.289869 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b95847-3823-42c8-aefb-2cb9ac7cec28 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:28.290484 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b95847-3823-42c8-aefb-2cb9ac7cec28 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:28.290484 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b95847-3823-42c8-aefb-2cb9ac7cec28 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:28.293157 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 562/1133] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:48:28 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:48:28.299330 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab34cc-e60f-4d88-be80-79adab4e02a4 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:28.299818 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab34cc-e60f-4d88-be80-79adab4e02a4 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:28.299918 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab34cc-e60f-4d88-be80-79adab4e02a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:28.319479 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-f1ab34cc-e60f-4d88-be80-79adab4e02a4 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:48:28.320711 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-f1ab34cc-e60f-4d88-be80-79adab4e02a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:48:28.381339 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 572/1134] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:48:28 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 04:48:28.409821 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b95847-3823-42c8-aefb-2cb9ac7cec28 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:28.424716 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b95847-3823-42c8-aefb-2cb9ac7cec28 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:28.430278 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed0a7d-9bd9-45f3-b21c-45c3710aa40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:28.431051 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed0a7d-9bd9-45f3-b21c-45c3710aa40c admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:28.431328 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed0a7d-9bd9-45f3-b21c-45c3710aa40c admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:28.431597 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed0a7d-9bd9-45f3-b21c-45c3710aa40c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:28.432946 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afed0a7d-9bd9-45f3-b21c-45c3710aa40c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:28.434801 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afed0a7d-9bd9-45f3-b21c-45c3710aa40c admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:28.436365 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 563/1135] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:48:28 2021] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:28.443255 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab34cc-e60f-4d88-be80-79adab4e02a4 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:28.455333 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab34cc-e60f-4d88-be80-79adab4e02a4 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:28.461245 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f2330c-3de2-43cd-9624-0c01d2ab88a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:28.461896 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2330c-3de2-43cd-9624-0c01d2ab88a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:28.462169 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2330c-3de2-43cd-9624-0c01d2ab88a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:28.462434 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2330c-3de2-43cd-9624-0c01d2ab88a8 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:28.463145 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f2330c-3de2-43cd-9624-0c01d2ab88a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:28.465152 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f2330c-3de2-43cd-9624-0c01d2ab88a8 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:28.488266 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 573/1136] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Dec 24 04:48:28 2021] POST /identity/v3/users => generated 286 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:48:30.867109 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd610e4-dab4-4e30-96c3-82b90f8e169d None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:30.867993 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd610e4-dab4-4e30-96c3-82b90f8e169d None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:30.867993 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd610e4-dab4-4e30-96c3-82b90f8e169d None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:30.871414 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 564/1137] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:48:30 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:48:30.877485 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9e473-3b4d-4696-9ba0-d66df9a0e4cf None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:30.877921 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9e473-3b4d-4696-9ba0-d66df9a0e4cf None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:30.878019 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9e473-3b4d-4696-9ba0-d66df9a0e4cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:30.897517 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-ceb9e473-3b4d-4696-9ba0-d66df9a0e4cf None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:48:30.898703 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-ceb9e473-3b4d-4696-9ba0-d66df9a0e4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:48:30.908059 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 574/1138] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:48:30 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:48:30.933220 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd610e4-dab4-4e30-96c3-82b90f8e169d None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:30.955957 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd610e4-dab4-4e30-96c3-82b90f8e169d None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:30.965023 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70631260-46d0-4b0a-ad4e-991a69239c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:30.965793 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70631260-46d0-4b0a-ad4e-991a69239c0b admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:30.966070 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70631260-46d0-4b0a-ad4e-991a69239c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:30.966339 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70631260-46d0-4b0a-ad4e-991a69239c0b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:30.978405 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70631260-46d0-4b0a-ad4e-991a69239c0b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:48:30.985397 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-70631260-46d0-4b0a-ad4e-991a69239c0b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 24 04:48:30.986549 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 565/1139] 10.222.0.43 () {56 vars in 1117 bytes} [Fri Dec 24 04:48:30 2021] GET /identity/v3/roles/admin => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:48:30.996929 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9e473-3b4d-4696-9ba0-d66df9a0e4cf None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:31.011764 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9e473-3b4d-4696-9ba0-d66df9a0e4cf None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:31.020990 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097e33c-b5a7-45a1-950b-f38915f8524a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:31.021943 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097e33c-b5a7-45a1-950b-f38915f8524a admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:31.022307 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097e33c-b5a7-45a1-950b-f38915f8524a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:31.022648 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097e33c-b5a7-45a1-950b-f38915f8524a admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:31.023817 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097e33c-b5a7-45a1-950b-f38915f8524a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:48:31.024225 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097e33c-b5a7-45a1-950b-f38915f8524a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:31.026823 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097e33c-b5a7-45a1-950b-f38915f8524a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:31.035614 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 575/1140] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:48:30 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:31.045844 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70631260-46d0-4b0a-ad4e-991a69239c0b admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:31.061323 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70631260-46d0-4b0a-ad4e-991a69239c0b admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:31.067549 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91405c-5512-4a10-9abd-1a86d8cc3661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:31.068385 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91405c-5512-4a10-9abd-1a86d8cc3661 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:31.068695 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91405c-5512-4a10-9abd-1a86d8cc3661 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:31.068968 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91405c-5512-4a10-9abd-1a86d8cc3661 admin admin] PATH_INFO: `/v3/users/d13ef76b380245abb68b66a3f0ecb408` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:31.084520 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f91405c-5512-4a10-9abd-1a86d8cc3661 admin admin] RBAC: Authorizing `identity:get_user(user_id=d13ef76b380245abb68b66a3f0ecb408)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:31.086694 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f91405c-5512-4a10-9abd-1a86d8cc3661 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:31.088293 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 566/1141] 10.222.0.43 () {56 vars in 1198 bytes} [Fri Dec 24 04:48:31 2021] GET /identity/v3/users/d13ef76b380245abb68b66a3f0ecb408 => generated 286 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:31.095186 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097e33c-b5a7-45a1-950b-f38915f8524a admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:31.111192 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097e33c-b5a7-45a1-950b-f38915f8524a admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:31.120751 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b131df3-57fc-4158-b1fa-62b784083b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:31.121377 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b131df3-57fc-4158-b1fa-62b784083b82 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:31.121719 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b131df3-57fc-4158-b1fa-62b784083b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:31.121992 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b131df3-57fc-4158-b1fa-62b784083b82 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:31.130439 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b131df3-57fc-4158-b1fa-62b784083b82 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:31.132178 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b131df3-57fc-4158-b1fa-62b784083b82 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:31.141344 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 576/1142] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:48:31 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:48:31.151298 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91405c-5512-4a10-9abd-1a86d8cc3661 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:31.162315 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91405c-5512-4a10-9abd-1a86d8cc3661 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:31.168378 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732ed8f-eb28-4495-aaa3-182a8ce88f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:31.169251 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732ed8f-eb28-4495-aaa3-182a8ce88f91 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:31.169536 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732ed8f-eb28-4495-aaa3-182a8ce88f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:31.169792 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732ed8f-eb28-4495-aaa3-182a8ce88f91 admin admin] PATH_INFO: `/v3/projects/b5db3ce26e464d4da7c5b0767d590f3f` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:31.171107 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732ed8f-eb28-4495-aaa3-182a8ce88f91 admin admin] RBAC: Authorizing `identity:get_project(project_id=b5db3ce26e464d4da7c5b0767d590f3f)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:31.173179 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732ed8f-eb28-4495-aaa3-182a8ce88f91 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:31.174794 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 567/1143] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:48:31 2021] GET /identity/v3/projects/b5db3ce26e464d4da7c5b0767d590f3f => generated 311 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:31.181032 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b131df3-57fc-4158-b1fa-62b784083b82 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:31.190732 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b131df3-57fc-4158-b1fa-62b784083b82 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:31.196938 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3daf2-1994-438d-94cb-cdd42a6768dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:31.197560 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3daf2-1994-438d-94cb-cdd42a6768dc admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:31.197836 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3daf2-1994-438d-94cb-cdd42a6768dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:31.198105 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3daf2-1994-438d-94cb-cdd42a6768dc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:31.199075 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe3daf2-1994-438d-94cb-cdd42a6768dc admin admin] RBAC: Adding query filter params (role.id=d5e6fc257d8541d5a5ed1988eacd5be7, scope.project.id=b5db3ce26e464d4da7c5b0767d590f3f, user.id=d13ef76b380245abb68b66a3f0ecb408) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:48:31.199384 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe3daf2-1994-438d-94cb-cdd42a6768dc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:31.201226 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe3daf2-1994-438d-94cb-cdd42a6768dc admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:31.206948 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 577/1144] 10.222.0.43 () {56 vars in 1395 bytes} [Fri Dec 24 04:48:31 2021] GET /identity/v3/role_assignments?user.id=d13ef76b380245abb68b66a3f0ecb408&scope.project.id=b5db3ce26e464d4da7c5b0767d590f3f&role.id=d5e6fc257d8541d5a5ed1988eacd5be7 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:33.504837 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eea262-9e77-40fe-b260-153a78367fe1 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:33.505675 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eea262-9e77-40fe-b260-153a78367fe1 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:33.505675 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eea262-9e77-40fe-b260-153a78367fe1 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:33.508573 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 568/1145] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:48:33 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:48:33.515732 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3182eb-2fc9-4592-a963-498abe88a6ad None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:33.516195 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3182eb-2fc9-4592-a963-498abe88a6ad None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:33.516289 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3182eb-2fc9-4592-a963-498abe88a6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:33.540550 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-5b3182eb-2fc9-4592-a963-498abe88a6ad None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:48:33.541743 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-5b3182eb-2fc9-4592-a963-498abe88a6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:48:33.554466 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 578/1146] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:48:33 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 04:48:33.578290 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eea262-9e77-40fe-b260-153a78367fe1 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:33.593169 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eea262-9e77-40fe-b260-153a78367fe1 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:33.598776 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fa3fc-caa6-4550-ac12-b22c1f463a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:33.599545 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fa3fc-caa6-4550-ac12-b22c1f463a71 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:33.599824 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fa3fc-caa6-4550-ac12-b22c1f463a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:33.600091 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fa3fc-caa6-4550-ac12-b22c1f463a71 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:33.612017 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9fa3fc-caa6-4550-ac12-b22c1f463a71 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:48:33.618884 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-df9fa3fc-caa6-4550-ac12-b22c1f463a71 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 24 04:48:33.620032 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 569/1147] 10.222.0.43 () {56 vars in 1117 bytes} [Fri Dec 24 04:48:33 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:48:33.626493 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3182eb-2fc9-4592-a963-498abe88a6ad None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:33.635818 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3182eb-2fc9-4592-a963-498abe88a6ad None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:33.641911 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a88f6-4efa-43aa-922d-5911a0bf5f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:33.642569 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a88f6-4efa-43aa-922d-5911a0bf5f35 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:33.642844 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a88f6-4efa-43aa-922d-5911a0bf5f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:33.643113 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a88f6-4efa-43aa-922d-5911a0bf5f35 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:33.643869 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60a88f6-4efa-43aa-922d-5911a0bf5f35 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:48:33.644172 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60a88f6-4efa-43aa-922d-5911a0bf5f35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:33.645811 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60a88f6-4efa-43aa-922d-5911a0bf5f35 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:33.654667 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 579/1148] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:48:33 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:33.660858 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fa3fc-caa6-4550-ac12-b22c1f463a71 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:33.671373 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fa3fc-caa6-4550-ac12-b22c1f463a71 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:33.676463 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57118c52-6000-4b45-9fc2-771468dfe224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:33.677319 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57118c52-6000-4b45-9fc2-771468dfe224 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:33.677596 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57118c52-6000-4b45-9fc2-771468dfe224 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:33.677865 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57118c52-6000-4b45-9fc2-771468dfe224 admin admin] PATH_INFO: `/v3/users/d13ef76b380245abb68b66a3f0ecb408` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:33.679120 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57118c52-6000-4b45-9fc2-771468dfe224 admin admin] RBAC: Authorizing `identity:get_user(user_id=d13ef76b380245abb68b66a3f0ecb408)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:33.681285 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57118c52-6000-4b45-9fc2-771468dfe224 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:33.682839 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 570/1149] 10.222.0.43 () {56 vars in 1198 bytes} [Fri Dec 24 04:48:33 2021] GET /identity/v3/users/d13ef76b380245abb68b66a3f0ecb408 => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:33.689567 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a88f6-4efa-43aa-922d-5911a0bf5f35 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:33.703939 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a88f6-4efa-43aa-922d-5911a0bf5f35 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:33.710745 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32723019-6427-4a21-b2f8-100ba8a5cff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:33.711580 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32723019-6427-4a21-b2f8-100ba8a5cff6 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:33.711859 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32723019-6427-4a21-b2f8-100ba8a5cff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:33.712130 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32723019-6427-4a21-b2f8-100ba8a5cff6 admin admin] PATH_INFO: `/v3/projects/b5db3ce26e464d4da7c5b0767d590f3f` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:33.713560 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32723019-6427-4a21-b2f8-100ba8a5cff6 admin admin] RBAC: Authorizing `identity:get_project(project_id=b5db3ce26e464d4da7c5b0767d590f3f)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:33.716144 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32723019-6427-4a21-b2f8-100ba8a5cff6 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:33.717777 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 580/1150] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:48:33 2021] GET /identity/v3/projects/b5db3ce26e464d4da7c5b0767d590f3f => generated 311 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:33.727066 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57118c52-6000-4b45-9fc2-771468dfe224 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:33.737043 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57118c52-6000-4b45-9fc2-771468dfe224 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:33.742052 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71423a4-2731-4718-a4f3-7f52c1851d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:33.742896 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71423a4-2731-4718-a4f3-7f52c1851d6f admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:33.743172 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71423a4-2731-4718-a4f3-7f52c1851d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:33.743444 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71423a4-2731-4718-a4f3-7f52c1851d6f admin admin] PATH_INFO: `/v3/projects/b5db3ce26e464d4da7c5b0767d590f3f/users/d13ef76b380245abb68b66a3f0ecb408/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:33.745568 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71423a4-2731-4718-a4f3-7f52c1851d6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5db3ce26e464d4da7c5b0767d590f3f, user_id=d13ef76b380245abb68b66a3f0ecb408, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:33.748132 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71423a4-2731-4718-a4f3-7f52c1851d6f admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:33.765050 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 571/1151] 10.222.0.43 () {58 vars in 1460 bytes} [Fri Dec 24 04:48:33 2021] PUT /identity/v3/projects/b5db3ce26e464d4da7c5b0767d590f3f/users/d13ef76b380245abb68b66a3f0ecb408/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 04:48:36.160252 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5e0eb-381b-430c-9fde-fdb2fb2604cf None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:36.160963 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5e0eb-381b-430c-9fde-fdb2fb2604cf None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:36.160963 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5e0eb-381b-430c-9fde-fdb2fb2604cf None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:36.162620 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 581/1152] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:48:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:48:36.169567 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dcb7e6-6554-4715-8a51-ab38917a40bc None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:36.170471 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dcb7e6-6554-4715-8a51-ab38917a40bc None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:36.170471 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dcb7e6-6554-4715-8a51-ab38917a40bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:36.195953 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-31dcb7e6-6554-4715-8a51-ab38917a40bc None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:48:36.197278 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-31dcb7e6-6554-4715-8a51-ab38917a40bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:48:36.263179 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 572/1153] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:48:36 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:48:36.300578 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5e0eb-381b-430c-9fde-fdb2fb2604cf None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:36.313364 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5e0eb-381b-430c-9fde-fdb2fb2604cf None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:36.318869 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c8228-d98b-41a3-afeb-2421c50ee6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:36.319650 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c8228-d98b-41a3-afeb-2421c50ee6b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:36.319928 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c8228-d98b-41a3-afeb-2421c50ee6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:36.320190 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c8228-d98b-41a3-afeb-2421c50ee6b4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:36.332293 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33c8228-d98b-41a3-afeb-2421c50ee6b4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:48:36.339858 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-f33c8228-d98b-41a3-afeb-2421c50ee6b4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 24 04:48:36.341204 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 582/1154] 10.222.0.43 () {56 vars in 1117 bytes} [Fri Dec 24 04:48:36 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:48:36.348169 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dcb7e6-6554-4715-8a51-ab38917a40bc None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:36.357802 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dcb7e6-6554-4715-8a51-ab38917a40bc None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:36.363557 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc693d4-85fb-46d7-bc8b-7bda4e9dff13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:36.364212 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc693d4-85fb-46d7-bc8b-7bda4e9dff13 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:36.364489 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc693d4-85fb-46d7-bc8b-7bda4e9dff13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:36.364782 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc693d4-85fb-46d7-bc8b-7bda4e9dff13 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:36.365607 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc693d4-85fb-46d7-bc8b-7bda4e9dff13 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:48:36.365912 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc693d4-85fb-46d7-bc8b-7bda4e9dff13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:36.367528 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc693d4-85fb-46d7-bc8b-7bda4e9dff13 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:36.376749 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 573/1155] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:48:36 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:36.383411 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c8228-d98b-41a3-afeb-2421c50ee6b4 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:36.393849 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c8228-d98b-41a3-afeb-2421c50ee6b4 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:36.399337 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d057eca-4ee0-4e1c-8677-f24efb16e6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:36.400179 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d057eca-4ee0-4e1c-8677-f24efb16e6bd admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:36.400449 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d057eca-4ee0-4e1c-8677-f24efb16e6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:36.400732 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d057eca-4ee0-4e1c-8677-f24efb16e6bd admin admin] PATH_INFO: `/v3/users/d13ef76b380245abb68b66a3f0ecb408` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:36.402069 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d057eca-4ee0-4e1c-8677-f24efb16e6bd admin admin] RBAC: Authorizing `identity:get_user(user_id=d13ef76b380245abb68b66a3f0ecb408)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:36.404175 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d057eca-4ee0-4e1c-8677-f24efb16e6bd admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:36.405794 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 583/1156] 10.222.0.43 () {56 vars in 1198 bytes} [Fri Dec 24 04:48:36 2021] GET /identity/v3/users/d13ef76b380245abb68b66a3f0ecb408 => generated 286 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:36.411936 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc693d4-85fb-46d7-bc8b-7bda4e9dff13 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:36.421873 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc693d4-85fb-46d7-bc8b-7bda4e9dff13 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:36.427735 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14a186-55a6-4dd1-8819-d9a474fabf00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:36.428365 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14a186-55a6-4dd1-8819-d9a474fabf00 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:36.428681 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14a186-55a6-4dd1-8819-d9a474fabf00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:36.428952 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14a186-55a6-4dd1-8819-d9a474fabf00 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:36.437239 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a14a186-55a6-4dd1-8819-d9a474fabf00 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:36.438978 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a14a186-55a6-4dd1-8819-d9a474fabf00 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:36.447868 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 574/1157] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:48:36 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:48:36.455541 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d057eca-4ee0-4e1c-8677-f24efb16e6bd admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:36.466984 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d057eca-4ee0-4e1c-8677-f24efb16e6bd admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:36.472806 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396f189-7c5e-4fa1-98c4-02520832f575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:36.473653 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396f189-7c5e-4fa1-98c4-02520832f575 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:36.473926 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396f189-7c5e-4fa1-98c4-02520832f575 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:36.474193 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396f189-7c5e-4fa1-98c4-02520832f575 admin admin] PATH_INFO: `/v3/projects/b5db3ce26e464d4da7c5b0767d590f3f` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:36.475500 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1396f189-7c5e-4fa1-98c4-02520832f575 admin admin] RBAC: Authorizing `identity:get_project(project_id=b5db3ce26e464d4da7c5b0767d590f3f)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:36.477579 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1396f189-7c5e-4fa1-98c4-02520832f575 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:36.479323 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 584/1158] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:48:36 2021] GET /identity/v3/projects/b5db3ce26e464d4da7c5b0767d590f3f => generated 311 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:36.486660 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14a186-55a6-4dd1-8819-d9a474fabf00 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:36.500989 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14a186-55a6-4dd1-8819-d9a474fabf00 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:36.509142 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b85ccd-7965-4679-ae00-c703ad41be83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:36.510097 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b85ccd-7965-4679-ae00-c703ad41be83 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:36.511095 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b85ccd-7965-4679-ae00-c703ad41be83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:36.511095 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b85ccd-7965-4679-ae00-c703ad41be83 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:36.512084 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b85ccd-7965-4679-ae00-c703ad41be83 admin admin] RBAC: Adding query filter params (role.id=d5e6fc257d8541d5a5ed1988eacd5be7, scope.project.id=b5db3ce26e464d4da7c5b0767d590f3f, user.id=d13ef76b380245abb68b66a3f0ecb408) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:48:36.512394 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b85ccd-7965-4679-ae00-c703ad41be83 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:36.514307 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b85ccd-7965-4679-ae00-c703ad41be83 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:36.520850 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 575/1159] 10.222.0.43 () {56 vars in 1395 bytes} [Fri Dec 24 04:48:36 2021] GET /identity/v3/role_assignments?user.id=d13ef76b380245abb68b66a3f0ecb408&scope.project.id=b5db3ce26e464d4da7c5b0767d590f3f&role.id=d5e6fc257d8541d5a5ed1988eacd5be7 => generated 608 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:48:38.846724 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002cff6c-590f-4099-805f-0cb1d10751ac None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:38.847307 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002cff6c-590f-4099-805f-0cb1d10751ac None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:38.847307 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002cff6c-590f-4099-805f-0cb1d10751ac None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:38.850040 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 585/1160] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:48:38 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:48:38.858159 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139444d1-1019-4061-b2c7-9b45d06e0775 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:38.858626 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139444d1-1019-4061-b2c7-9b45d06e0775 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:38.858730 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139444d1-1019-4061-b2c7-9b45d06e0775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:38.879497 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-139444d1-1019-4061-b2c7-9b45d06e0775 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:48:38.881454 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-139444d1-1019-4061-b2c7-9b45d06e0775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:48:38.892775 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 576/1161] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:48:38 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 04:48:38.915520 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002cff6c-590f-4099-805f-0cb1d10751ac None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:38.929723 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002cff6c-590f-4099-805f-0cb1d10751ac None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:38.935209 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9d724-4dc9-4bf5-99ef-e07e349b887a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:38.935825 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9d724-4dc9-4bf5-99ef-e07e349b887a admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:38.936100 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9d724-4dc9-4bf5-99ef-e07e349b887a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:38.936369 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9d724-4dc9-4bf5-99ef-e07e349b887a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:38.944843 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c9d724-4dc9-4bf5-99ef-e07e349b887a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:38.946580 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c9d724-4dc9-4bf5-99ef-e07e349b887a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:38.955663 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 586/1162] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:48:38 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:48:38.962931 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139444d1-1019-4061-b2c7-9b45d06e0775 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:38.977888 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139444d1-1019-4061-b2c7-9b45d06e0775 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:38.985058 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b488262-8b03-4853-885b-adc3f9bf6e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:38.985840 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b488262-8b03-4853-885b-adc3f9bf6e5d admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:38.986118 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b488262-8b03-4853-885b-adc3f9bf6e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:38.986390 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b488262-8b03-4853-885b-adc3f9bf6e5d admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:38.994677 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b488262-8b03-4853-885b-adc3f9bf6e5d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:38.996547 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b488262-8b03-4853-885b-adc3f9bf6e5d admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:39.012387 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-6b488262-8b03-4853-885b-adc3f9bf6e5d admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Dec 24 04:48:39.013553 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 577/1163] 10.222.0.43 () {56 vars in 1138 bytes} [Fri Dec 24 04:48:38 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:48:39.023222 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9d724-4dc9-4bf5-99ef-e07e349b887a admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:39.037951 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9d724-4dc9-4bf5-99ef-e07e349b887a admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:39.045585 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee7a65-b5c1-4822-9305-e0ce727427d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:39.046223 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee7a65-b5c1-4822-9305-e0ce727427d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:39.046497 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee7a65-b5c1-4822-9305-e0ce727427d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:39.046782 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee7a65-b5c1-4822-9305-e0ce727427d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:39.047483 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee7a65-b5c1-4822-9305-e0ce727427d5 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:48:39.047781 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee7a65-b5c1-4822-9305-e0ce727427d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:39.049391 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee7a65-b5c1-4822-9305-e0ce727427d5 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:39.057014 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 587/1164] 10.222.0.43 () {56 vars in 1136 bytes} [Fri Dec 24 04:48:39 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:41.374638 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd5f52-5177-42b9-9fbb-ce9426d8a97c None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:41.375192 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd5f52-5177-42b9-9fbb-ce9426d8a97c None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:41.375192 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd5f52-5177-42b9-9fbb-ce9426d8a97c None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:41.377037 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 578/1165] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:48:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:48:41.383929 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa8dfa-d1a9-443d-b269-ff1100014157 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:41.384707 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa8dfa-d1a9-443d-b269-ff1100014157 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:41.384885 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa8dfa-d1a9-443d-b269-ff1100014157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:41.410223 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-53fa8dfa-d1a9-443d-b269-ff1100014157 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:48:41.411423 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-53fa8dfa-d1a9-443d-b269-ff1100014157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:48:41.421213 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 588/1166] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:48:41 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:48:41.445259 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd5f52-5177-42b9-9fbb-ce9426d8a97c None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:41.460037 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd5f52-5177-42b9-9fbb-ce9426d8a97c None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:41.465461 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee73fd-4169-4de5-8d07-50570cd991b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:41.466102 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee73fd-4169-4de5-8d07-50570cd991b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:41.466386 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee73fd-4169-4de5-8d07-50570cd991b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:41.466661 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee73fd-4169-4de5-8d07-50570cd991b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:41.467429 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ee73fd-4169-4de5-8d07-50570cd991b9 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:41.468458 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING py.warnings [None req-95ee73fd-4169-4de5-8d07-50570cd991b9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:48:41.468458 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: warnings.warn(msg) Dec 24 04:48:41.468458 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: Dec 24 04:48:41.469362 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ee73fd-4169-4de5-8d07-50570cd991b9 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:41.491015 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 579/1167] 10.222.0.43 () {60 vars in 1159 bytes} [Fri Dec 24 04:48:41 2021] POST /identity/v3/domains => generated 267 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:48:43.813244 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7043f-5c19-4377-be3d-b1be9d7583b9 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:43.813784 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7043f-5c19-4377-be3d-b1be9d7583b9 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:43.813784 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7043f-5c19-4377-be3d-b1be9d7583b9 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:43.815562 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 589/1168] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:48:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:48:43.822482 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088da3fd-de62-4e27-9472-c6562a9425e5 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:43.823238 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088da3fd-de62-4e27-9472-c6562a9425e5 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:43.823763 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088da3fd-de62-4e27-9472-c6562a9425e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:43.848182 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-088da3fd-de62-4e27-9472-c6562a9425e5 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:48:43.849409 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-088da3fd-de62-4e27-9472-c6562a9425e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:48:43.907583 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 580/1169] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:48:43 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:48:43.932292 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b7043f-5c19-4377-be3d-b1be9d7583b9 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:43.951548 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b7043f-5c19-4377-be3d-b1be9d7583b9 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:43.956729 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7206e21a-6961-46d0-ac91-22dd7d8ca06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:43.957573 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206e21a-6961-46d0-ac91-22dd7d8ca06d admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:43.957849 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206e21a-6961-46d0-ac91-22dd7d8ca06d admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:43.958116 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206e21a-6961-46d0-ac91-22dd7d8ca06d admin admin] PATH_INFO: `/v3/domains/08259ce676074955991228480b4712cc` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:43.969246 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7206e21a-6961-46d0-ac91-22dd7d8ca06d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=08259ce676074955991228480b4712cc)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:43.971191 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7206e21a-6961-46d0-ac91-22dd7d8ca06d admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:43.972792 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 590/1170] 10.222.0.43 () {56 vars in 1204 bytes} [Fri Dec 24 04:48:43 2021] GET /identity/v3/domains/08259ce676074955991228480b4712cc => generated 267 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:43.981887 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088da3fd-de62-4e27-9472-c6562a9425e5 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:43.990947 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088da3fd-de62-4e27-9472-c6562a9425e5 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:43.997508 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e248c-4962-4ad4-8657-dd897052787c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:43.998155 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e248c-4962-4ad4-8657-dd897052787c admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:43.998430 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e248c-4962-4ad4-8657-dd897052787c admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:43.998697 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e248c-4962-4ad4-8657-dd897052787c admin admin] PATH_INFO: `/v3/projects` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:43.999424 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898e248c-4962-4ad4-8657-dd897052787c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:44.001379 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898e248c-4962-4ad4-8657-dd897052787c admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:44.031048 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 581/1171] 10.222.0.43 () {60 vars in 1162 bytes} [Fri Dec 24 04:48:43 2021] POST /identity/v3/projects => generated 361 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:48:46.421241 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8720fd0a-bbd2-447e-932a-0e9c0244b108 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:46.422106 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8720fd0a-bbd2-447e-932a-0e9c0244b108 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:46.422106 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8720fd0a-bbd2-447e-932a-0e9c0244b108 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:46.425110 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 591/1172] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:48:46 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:48:46.432037 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a5e81-578e-4a11-a42d-ff8510c09885 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:46.432787 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a5e81-578e-4a11-a42d-ff8510c09885 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:46.433162 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a5e81-578e-4a11-a42d-ff8510c09885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:46.458058 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-335a5e81-578e-4a11-a42d-ff8510c09885 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:48:46.459566 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-335a5e81-578e-4a11-a42d-ff8510c09885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:48:46.520906 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 582/1173] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:48:46 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:48:46.556024 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8720fd0a-bbd2-447e-932a-0e9c0244b108 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:46.571350 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8720fd0a-bbd2-447e-932a-0e9c0244b108 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:46.576267 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1976d43-0257-4940-94d0-8bf8270e180f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:46.577143 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1976d43-0257-4940-94d0-8bf8270e180f admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:46.577424 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1976d43-0257-4940-94d0-8bf8270e180f admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:46.577698 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1976d43-0257-4940-94d0-8bf8270e180f admin admin] PATH_INFO: `/v3/domains/08259ce676074955991228480b4712cc` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:46.578914 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1976d43-0257-4940-94d0-8bf8270e180f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=08259ce676074955991228480b4712cc)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:46.580915 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1976d43-0257-4940-94d0-8bf8270e180f admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:46.582524 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 592/1174] 10.222.0.43 () {56 vars in 1204 bytes} [Fri Dec 24 04:48:46 2021] GET /identity/v3/domains/08259ce676074955991228480b4712cc => generated 267 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:46.589590 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335a5e81-578e-4a11-a42d-ff8510c09885 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:46.603808 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335a5e81-578e-4a11-a42d-ff8510c09885 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:46.612084 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090bf69-0095-485d-b4b1-009b4172262b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:46.613093 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090bf69-0095-485d-b4b1-009b4172262b admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:46.613454 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090bf69-0095-485d-b4b1-009b4172262b admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:46.613805 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090bf69-0095-485d-b4b1-009b4172262b admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:46.614890 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a090bf69-0095-485d-b4b1-009b4172262b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:46.617881 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a090bf69-0095-485d-b4b1-009b4172262b admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:46.643994 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 583/1175] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Dec 24 04:48:46 2021] POST /identity/v3/users => generated 311 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:48:49.001986 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a03e1-5668-444d-bc4e-1975e91cb638 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:49.002885 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a03e1-5668-444d-bc4e-1975e91cb638 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:49.002885 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a03e1-5668-444d-bc4e-1975e91cb638 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:49.005810 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 593/1176] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:48:48 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:48:49.011784 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5218a-e9df-499a-b7cc-b029657cea7b None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:49.012230 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5218a-e9df-499a-b7cc-b029657cea7b None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:49.012328 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5218a-e9df-499a-b7cc-b029657cea7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:49.031506 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-61e5218a-e9df-499a-b7cc-b029657cea7b None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:48:49.032725 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-61e5218a-e9df-499a-b7cc-b029657cea7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:48:49.041741 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 584/1177] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:48:49 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:48:49.066779 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9a03e1-5668-444d-bc4e-1975e91cb638 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:49.089532 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9a03e1-5668-444d-bc4e-1975e91cb638 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:49.095254 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19861231-442b-4aec-bf41-db550d6fa28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:49.096030 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19861231-442b-4aec-bf41-db550d6fa28c admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:49.096314 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19861231-442b-4aec-bf41-db550d6fa28c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:49.096609 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19861231-442b-4aec-bf41-db550d6fa28c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:49.107758 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19861231-442b-4aec-bf41-db550d6fa28c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:48:49.114650 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-19861231-442b-4aec-bf41-db550d6fa28c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 24 04:48:49.115785 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 594/1178] 10.222.0.43 () {56 vars in 1117 bytes} [Fri Dec 24 04:48:49 2021] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:48:49.122251 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e5218a-e9df-499a-b7cc-b029657cea7b None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:49.132017 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e5218a-e9df-499a-b7cc-b029657cea7b None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:49.138050 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd6a5aa-5927-4ef7-ba1b-4baa531a76d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:49.138688 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd6a5aa-5927-4ef7-ba1b-4baa531a76d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:49.138962 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd6a5aa-5927-4ef7-ba1b-4baa531a76d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:49.139224 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd6a5aa-5927-4ef7-ba1b-4baa531a76d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:49.139987 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd6a5aa-5927-4ef7-ba1b-4baa531a76d2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:48:49.140285 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd6a5aa-5927-4ef7-ba1b-4baa531a76d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:49.141898 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd6a5aa-5927-4ef7-ba1b-4baa531a76d2 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:49.151358 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 585/1179] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:48:49 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:49.158046 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19861231-442b-4aec-bf41-db550d6fa28c admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:49.174981 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19861231-442b-4aec-bf41-db550d6fa28c admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:49.184444 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e12e7-7460-4e0c-9b25-592caf940806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:49.185306 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e12e7-7460-4e0c-9b25-592caf940806 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:49.185586 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e12e7-7460-4e0c-9b25-592caf940806 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:49.185856 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e12e7-7460-4e0c-9b25-592caf940806 admin admin] PATH_INFO: `/v3/users/56d290a3e3ff4b418db8f29801358b89` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:49.201248 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812e12e7-7460-4e0c-9b25-592caf940806 admin admin] RBAC: Authorizing `identity:get_user(user_id=56d290a3e3ff4b418db8f29801358b89)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:49.203379 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812e12e7-7460-4e0c-9b25-592caf940806 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:49.205006 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 595/1180] 10.222.0.43 () {56 vars in 1198 bytes} [Fri Dec 24 04:48:49 2021] GET /identity/v3/users/56d290a3e3ff4b418db8f29801358b89 => generated 311 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:49.215580 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd6a5aa-5927-4ef7-ba1b-4baa531a76d2 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:49.230906 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd6a5aa-5927-4ef7-ba1b-4baa531a76d2 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:49.237340 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b1fe30-1f27-41cc-9ecc-931895396252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:49.237982 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1fe30-1f27-41cc-9ecc-931895396252 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:49.238266 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1fe30-1f27-41cc-9ecc-931895396252 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:49.238541 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1fe30-1f27-41cc-9ecc-931895396252 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:49.247226 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b1fe30-1f27-41cc-9ecc-931895396252 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:49.249034 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b1fe30-1f27-41cc-9ecc-931895396252 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:49.257973 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 586/1181] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:48:49 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:48:49.265518 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e12e7-7460-4e0c-9b25-592caf940806 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:49.282758 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e12e7-7460-4e0c-9b25-592caf940806 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:49.292836 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436703e6-dab1-4e48-88df-c637c730004c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:49.293690 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436703e6-dab1-4e48-88df-c637c730004c admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:49.293972 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436703e6-dab1-4e48-88df-c637c730004c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:49.294247 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436703e6-dab1-4e48-88df-c637c730004c admin admin] PATH_INFO: `/v3/projects/25c02cc8c74e4f539602ec5166673705` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:49.295563 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436703e6-dab1-4e48-88df-c637c730004c admin admin] RBAC: Authorizing `identity:get_project(project_id=25c02cc8c74e4f539602ec5166673705)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:49.297632 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436703e6-dab1-4e48-88df-c637c730004c admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:49.299263 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 596/1182] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:48:49 2021] GET /identity/v3/projects/25c02cc8c74e4f539602ec5166673705 => generated 361 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:49.305738 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b1fe30-1f27-41cc-9ecc-931895396252 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:49.316010 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b1fe30-1f27-41cc-9ecc-931895396252 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:49.321617 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e02c2ae-c9fb-4325-9d9a-dc465734c7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:49.322259 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02c2ae-c9fb-4325-9d9a-dc465734c7d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:49.322538 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02c2ae-c9fb-4325-9d9a-dc465734c7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:49.322806 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02c2ae-c9fb-4325-9d9a-dc465734c7d6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:49.324232 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e02c2ae-c9fb-4325-9d9a-dc465734c7d6 admin admin] RBAC: Adding query filter params (role.id=d5e6fc257d8541d5a5ed1988eacd5be7, scope.project.id=25c02cc8c74e4f539602ec5166673705, user.id=56d290a3e3ff4b418db8f29801358b89) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:48:49.324557 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e02c2ae-c9fb-4325-9d9a-dc465734c7d6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:49.326418 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e02c2ae-c9fb-4325-9d9a-dc465734c7d6 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:49.332314 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 587/1183] 10.222.0.43 () {56 vars in 1395 bytes} [Fri Dec 24 04:48:49 2021] GET /identity/v3/role_assignments?user.id=56d290a3e3ff4b418db8f29801358b89&scope.project.id=25c02cc8c74e4f539602ec5166673705&role.id=d5e6fc257d8541d5a5ed1988eacd5be7 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:51.676906 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df4098-4c04-427a-8369-50a4a3b18525 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:51.677730 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df4098-4c04-427a-8369-50a4a3b18525 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:51.677730 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df4098-4c04-427a-8369-50a4a3b18525 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:51.680430 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 597/1184] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:48:51 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:48:51.689369 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3048b6-b177-4cd6-9c18-8e5bfaaa9bc3 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:51.689831 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3048b6-b177-4cd6-9c18-8e5bfaaa9bc3 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:51.689923 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3048b6-b177-4cd6-9c18-8e5bfaaa9bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:51.715631 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-ea3048b6-b177-4cd6-9c18-8e5bfaaa9bc3 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:48:51.717467 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-ea3048b6-b177-4cd6-9c18-8e5bfaaa9bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:48:51.731091 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 588/1185] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:48:51 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 04:48:51.768043 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1df4098-4c04-427a-8369-50a4a3b18525 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:51.782737 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1df4098-4c04-427a-8369-50a4a3b18525 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:51.788366 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ac40af-225b-4920-9aa1-c6360563e487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:51.789170 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac40af-225b-4920-9aa1-c6360563e487 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:51.789449 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac40af-225b-4920-9aa1-c6360563e487 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:51.789721 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac40af-225b-4920-9aa1-c6360563e487 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:51.801009 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ac40af-225b-4920-9aa1-c6360563e487 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:48:51.808098 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-f1ac40af-225b-4920-9aa1-c6360563e487 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 24 04:48:51.809391 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 598/1186] 10.222.0.43 () {56 vars in 1117 bytes} [Fri Dec 24 04:48:51 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:48:51.816449 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3048b6-b177-4cd6-9c18-8e5bfaaa9bc3 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:51.831297 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3048b6-b177-4cd6-9c18-8e5bfaaa9bc3 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:51.840263 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f7f12-2df2-479d-aa24-799029f80265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:51.840947 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f7f12-2df2-479d-aa24-799029f80265 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:51.841225 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f7f12-2df2-479d-aa24-799029f80265 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:51.841489 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f7f12-2df2-479d-aa24-799029f80265 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:51.842255 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727f7f12-2df2-479d-aa24-799029f80265 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:48:51.842553 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727f7f12-2df2-479d-aa24-799029f80265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:51.844164 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727f7f12-2df2-479d-aa24-799029f80265 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:51.853649 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 589/1187] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:48:51 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:51.861387 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ac40af-225b-4920-9aa1-c6360563e487 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:51.878700 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ac40af-225b-4920-9aa1-c6360563e487 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:51.884504 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690450ff-6a25-4bec-b474-52db5af2f8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:51.885386 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690450ff-6a25-4bec-b474-52db5af2f8a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:51.885765 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690450ff-6a25-4bec-b474-52db5af2f8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:51.886196 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690450ff-6a25-4bec-b474-52db5af2f8a7 admin admin] PATH_INFO: `/v3/users/56d290a3e3ff4b418db8f29801358b89` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:51.887609 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690450ff-6a25-4bec-b474-52db5af2f8a7 admin admin] RBAC: Authorizing `identity:get_user(user_id=56d290a3e3ff4b418db8f29801358b89)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:51.889776 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690450ff-6a25-4bec-b474-52db5af2f8a7 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:51.891364 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 599/1188] 10.222.0.43 () {56 vars in 1198 bytes} [Fri Dec 24 04:48:51 2021] GET /identity/v3/users/56d290a3e3ff4b418db8f29801358b89 => generated 311 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:51.901074 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f7f12-2df2-479d-aa24-799029f80265 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:51.911330 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f7f12-2df2-479d-aa24-799029f80265 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:51.916990 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad6224-2b7e-402e-a869-ad1b2ff649cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:51.917922 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad6224-2b7e-402e-a869-ad1b2ff649cd admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:51.918203 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad6224-2b7e-402e-a869-ad1b2ff649cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:51.918474 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad6224-2b7e-402e-a869-ad1b2ff649cd admin admin] PATH_INFO: `/v3/projects/25c02cc8c74e4f539602ec5166673705` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:51.919818 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ad6224-2b7e-402e-a869-ad1b2ff649cd admin admin] RBAC: Authorizing `identity:get_project(project_id=25c02cc8c74e4f539602ec5166673705)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:51.921908 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ad6224-2b7e-402e-a869-ad1b2ff649cd admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:51.923560 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 590/1189] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:48:51 2021] GET /identity/v3/projects/25c02cc8c74e4f539602ec5166673705 => generated 361 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:51.929626 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690450ff-6a25-4bec-b474-52db5af2f8a7 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:51.939867 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690450ff-6a25-4bec-b474-52db5af2f8a7 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:51.945565 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ef965-60c8-4696-97c3-89e67b54619c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:51.946411 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ef965-60c8-4696-97c3-89e67b54619c admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:51.946695 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ef965-60c8-4696-97c3-89e67b54619c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:51.946960 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ef965-60c8-4696-97c3-89e67b54619c admin admin] PATH_INFO: `/v3/projects/25c02cc8c74e4f539602ec5166673705/users/56d290a3e3ff4b418db8f29801358b89/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:51.949261 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ef965-60c8-4696-97c3-89e67b54619c admin admin] RBAC: Authorizing `identity:create_grant(project_id=25c02cc8c74e4f539602ec5166673705, user_id=56d290a3e3ff4b418db8f29801358b89, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:51.951839 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ef965-60c8-4696-97c3-89e67b54619c admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:51.968249 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 600/1190] 10.222.0.43 () {58 vars in 1460 bytes} [Fri Dec 24 04:48:51 2021] PUT /identity/v3/projects/25c02cc8c74e4f539602ec5166673705/users/56d290a3e3ff4b418db8f29801358b89/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:48:54.291533 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16bf414-45d9-4c3f-b675-889b05b8ffe4 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:54.292259 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16bf414-45d9-4c3f-b675-889b05b8ffe4 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:54.292259 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16bf414-45d9-4c3f-b675-889b05b8ffe4 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:54.297432 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 591/1191] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:48:54 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:48:54.304089 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2198b5fc-729e-4a04-b269-c4a7af54c4cf None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:54.304853 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2198b5fc-729e-4a04-b269-c4a7af54c4cf None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:54.304963 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2198b5fc-729e-4a04-b269-c4a7af54c4cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:54.324725 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-2198b5fc-729e-4a04-b269-c4a7af54c4cf None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:48:54.326596 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-2198b5fc-729e-4a04-b269-c4a7af54c4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:48:54.387119 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 601/1192] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:48:54 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:48:54.417585 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16bf414-45d9-4c3f-b675-889b05b8ffe4 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:54.431793 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16bf414-45d9-4c3f-b675-889b05b8ffe4 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:54.437482 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d745cad-27a5-4b62-8eaf-20846e326409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:54.438255 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d745cad-27a5-4b62-8eaf-20846e326409 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:54.438535 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d745cad-27a5-4b62-8eaf-20846e326409 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:54.438803 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d745cad-27a5-4b62-8eaf-20846e326409 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:54.450610 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d745cad-27a5-4b62-8eaf-20846e326409 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:48:54.457367 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-9d745cad-27a5-4b62-8eaf-20846e326409 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 24 04:48:54.458512 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 592/1193] 10.222.0.43 () {56 vars in 1117 bytes} [Fri Dec 24 04:48:54 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:48:54.466010 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2198b5fc-729e-4a04-b269-c4a7af54c4cf None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:54.480651 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2198b5fc-729e-4a04-b269-c4a7af54c4cf None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:54.486133 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99139683-e3fa-4c7c-966e-00f63d67ad62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:54.486786 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99139683-e3fa-4c7c-966e-00f63d67ad62 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:54.487070 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99139683-e3fa-4c7c-966e-00f63d67ad62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:54.487346 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99139683-e3fa-4c7c-966e-00f63d67ad62 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:54.488110 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99139683-e3fa-4c7c-966e-00f63d67ad62 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:48:54.488414 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99139683-e3fa-4c7c-966e-00f63d67ad62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:54.490056 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99139683-e3fa-4c7c-966e-00f63d67ad62 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:54.498835 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 602/1194] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:48:54 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:54.505017 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d745cad-27a5-4b62-8eaf-20846e326409 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:54.515812 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d745cad-27a5-4b62-8eaf-20846e326409 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:54.521037 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3a4a6-1036-4fcd-af11-4e44955b6eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:54.521863 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3a4a6-1036-4fcd-af11-4e44955b6eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:54.522140 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3a4a6-1036-4fcd-af11-4e44955b6eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:54.522408 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3a4a6-1036-4fcd-af11-4e44955b6eb7 admin admin] PATH_INFO: `/v3/users/56d290a3e3ff4b418db8f29801358b89` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:54.523678 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f3a4a6-1036-4fcd-af11-4e44955b6eb7 admin admin] RBAC: Authorizing `identity:get_user(user_id=56d290a3e3ff4b418db8f29801358b89)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:54.525831 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f3a4a6-1036-4fcd-af11-4e44955b6eb7 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:54.527421 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 593/1195] 10.222.0.43 () {56 vars in 1198 bytes} [Fri Dec 24 04:48:54 2021] GET /identity/v3/users/56d290a3e3ff4b418db8f29801358b89 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:54.533276 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99139683-e3fa-4c7c-966e-00f63d67ad62 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:54.543154 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99139683-e3fa-4c7c-966e-00f63d67ad62 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:54.548174 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4578a291-c1dd-4f68-89b8-4009598ede6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:54.548829 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578a291-c1dd-4f68-89b8-4009598ede6a admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:54.549108 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578a291-c1dd-4f68-89b8-4009598ede6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:54.549385 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578a291-c1dd-4f68-89b8-4009598ede6a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:54.557288 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4578a291-c1dd-4f68-89b8-4009598ede6a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:54.559221 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4578a291-c1dd-4f68-89b8-4009598ede6a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:54.568427 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 603/1196] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:48:54 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 24 04:48:54.574613 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3a4a6-1036-4fcd-af11-4e44955b6eb7 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:54.585516 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3a4a6-1036-4fcd-af11-4e44955b6eb7 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:54.591466 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca24d8bb-1e16-450f-b32d-c914c797eedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:54.592280 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24d8bb-1e16-450f-b32d-c914c797eedb admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:54.592560 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24d8bb-1e16-450f-b32d-c914c797eedb admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:54.592887 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24d8bb-1e16-450f-b32d-c914c797eedb admin admin] PATH_INFO: `/v3/projects/25c02cc8c74e4f539602ec5166673705` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:54.594203 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca24d8bb-1e16-450f-b32d-c914c797eedb admin admin] RBAC: Authorizing `identity:get_project(project_id=25c02cc8c74e4f539602ec5166673705)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:54.596201 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca24d8bb-1e16-450f-b32d-c914c797eedb admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:54.597849 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 594/1197] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:48:54 2021] GET /identity/v3/projects/25c02cc8c74e4f539602ec5166673705 => generated 361 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:48:54.603957 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4578a291-c1dd-4f68-89b8-4009598ede6a admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:48:54.618432 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4578a291-c1dd-4f68-89b8-4009598ede6a admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:48:54.628416 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8042a26a-ac7e-465b-998f-5bb3f73ec08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:48:54.629392 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8042a26a-ac7e-465b-998f-5bb3f73ec08b admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:48:54.629780 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8042a26a-ac7e-465b-998f-5bb3f73ec08b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:48:54.630159 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8042a26a-ac7e-465b-998f-5bb3f73ec08b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:48:54.631447 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8042a26a-ac7e-465b-998f-5bb3f73ec08b admin admin] RBAC: Adding query filter params (role.id=d5e6fc257d8541d5a5ed1988eacd5be7, scope.project.id=25c02cc8c74e4f539602ec5166673705, user.id=56d290a3e3ff4b418db8f29801358b89) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:48:54.631875 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8042a26a-ac7e-465b-998f-5bb3f73ec08b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:48:54.634767 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8042a26a-ac7e-465b-998f-5bb3f73ec08b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:48:54.642474 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 604/1198] 10.222.0.43 () {56 vars in 1395 bytes} [Fri Dec 24 04:48:54 2021] GET /identity/v3/role_assignments?user.id=56d290a3e3ff4b418db8f29801358b89&scope.project.id=25c02cc8c74e4f539602ec5166673705&role.id=d5e6fc257d8541d5a5ed1988eacd5be7 => generated 608 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:49:53.280633 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f0b21-d87e-41fa-a4d5-a230f53ae97f None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:49:53.281319 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f0b21-d87e-41fa-a4d5-a230f53ae97f None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:49:53.281319 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f0b21-d87e-41fa-a4d5-a230f53ae97f None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:49:53.282905 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 595/1199] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:49:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 24 04:49:53.290437 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d5128-4405-420f-83b4-eea4fc3dac8e None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:49:53.291077 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d5128-4405-420f-83b4-eea4fc3dac8e None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:49:53.292556 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d5128-4405-420f-83b4-eea4fc3dac8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:49:53.316911 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-8c3d5128-4405-420f-83b4-eea4fc3dac8e None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:49:53.318175 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-8c3d5128-4405-420f-83b4-eea4fc3dac8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:49:53.332571 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 605/1200] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:49:53 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:49:53.359160 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f0b21-d87e-41fa-a4d5-a230f53ae97f None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:49:53.372862 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f0b21-d87e-41fa-a4d5-a230f53ae97f None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:49:53.377523 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be03e7c-a766-4a8d-a114-db25910a3e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:49:53.378310 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be03e7c-a766-4a8d-a114-db25910a3e2e admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:49:53.378588 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be03e7c-a766-4a8d-a114-db25910a3e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:49:53.378857 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be03e7c-a766-4a8d-a114-db25910a3e2e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:49:53.393760 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be03e7c-a766-4a8d-a114-db25910a3e2e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:49:53.395608 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be03e7c-a766-4a8d-a114-db25910a3e2e admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:49:53.414529 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-3be03e7c-a766-4a8d-a114-db25910a3e2e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:49:53.416278 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 596/1201] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:49:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:49:53.423235 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d5128-4405-420f-83b4-eea4fc3dac8e None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:49:53.433906 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d5128-4405-420f-83b4-eea4fc3dac8e None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:49:53.440581 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b3f55b-f628-4265-adf6-fa549b0c3c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:49:53.441503 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3f55b-f628-4265-adf6-fa549b0c3c11 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:49:53.441976 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3f55b-f628-4265-adf6-fa549b0c3c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:49:53.442245 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3f55b-f628-4265-adf6-fa549b0c3c11 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:49:53.442983 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b3f55b-f628-4265-adf6-fa549b0c3c11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:49:53.443289 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b3f55b-f628-4265-adf6-fa549b0c3c11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:49:53.444958 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b3f55b-f628-4265-adf6-fa549b0c3c11 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:49:53.464676 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 606/1202] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:49:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:49:53.471188 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be03e7c-a766-4a8d-a114-db25910a3e2e admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:49:53.482508 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be03e7c-a766-4a8d-a114-db25910a3e2e admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:49:53.488104 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9e73a-8455-4e10-b401-5466b1596f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:49:53.489072 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9e73a-8455-4e10-b401-5466b1596f01 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:49:53.489456 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9e73a-8455-4e10-b401-5466b1596f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:49:53.489729 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9e73a-8455-4e10-b401-5466b1596f01 admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:49:53.490511 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd9e73a-8455-4e10-b401-5466b1596f01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:49:53.492865 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd9e73a-8455-4e10-b401-5466b1596f01 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:49:53.528558 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 597/1203] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Dec 24 04:49:53 2021] POST /identity/v3/users => generated 251 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:49:56.137541 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abf925-15fa-4835-8e58-05625e132064 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:49:56.138415 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abf925-15fa-4835-8e58-05625e132064 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:49:56.138415 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abf925-15fa-4835-8e58-05625e132064 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:49:56.142576 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 607/1204] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:49:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:49:56.146188 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31fa19e-0591-477a-9691-2ad7dc954435 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:49:56.146634 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31fa19e-0591-477a-9691-2ad7dc954435 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:49:56.146738 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31fa19e-0591-477a-9691-2ad7dc954435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:49:56.165390 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-b31fa19e-0591-477a-9691-2ad7dc954435 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:49:56.166735 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-b31fa19e-0591-477a-9691-2ad7dc954435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:49:56.174681 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 598/1205] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:49:56 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 04:49:56.199083 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6abf925-15fa-4835-8e58-05625e132064 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:49:56.212411 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6abf925-15fa-4835-8e58-05625e132064 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:49:56.218871 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a1484-f189-4310-980d-718dca179ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:49:56.220062 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a1484-f189-4310-980d-718dca179ded admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:49:56.220299 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a1484-f189-4310-980d-718dca179ded admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:49:56.220629 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a1484-f189-4310-980d-718dca179ded admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:49:56.236056 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3a1484-f189-4310-980d-718dca179ded admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:49:56.245042 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-2d3a1484-f189-4310-980d-718dca179ded admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 24 04:49:56.246631 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 608/1206] 10.222.0.43 () {56 vars in 1123 bytes} [Fri Dec 24 04:49:56 2021] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:49:56.255712 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31fa19e-0591-477a-9691-2ad7dc954435 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:49:56.268103 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31fa19e-0591-477a-9691-2ad7dc954435 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:49:56.273782 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46174c05-0926-4cc5-aab2-279df3f76383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:49:56.274941 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46174c05-0926-4cc5-aab2-279df3f76383 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:49:56.274941 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46174c05-0926-4cc5-aab2-279df3f76383 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:49:56.275112 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46174c05-0926-4cc5-aab2-279df3f76383 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:49:56.275824 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46174c05-0926-4cc5-aab2-279df3f76383 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:49:56.276126 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46174c05-0926-4cc5-aab2-279df3f76383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:49:56.277935 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46174c05-0926-4cc5-aab2-279df3f76383 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:49:56.288612 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 599/1207] 10.222.0.43 () {56 vars in 1124 bytes} [Fri Dec 24 04:49:56 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:49:56.295609 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a1484-f189-4310-980d-718dca179ded admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:49:56.308956 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a1484-f189-4310-980d-718dca179ded admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:49:56.316892 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d98d44-3e37-4491-99d0-b34c815afe9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:49:56.317688 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d98d44-3e37-4491-99d0-b34c815afe9e admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:49:56.317970 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d98d44-3e37-4491-99d0-b34c815afe9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:49:56.318242 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d98d44-3e37-4491-99d0-b34c815afe9e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:49:56.333193 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d98d44-3e37-4491-99d0-b34c815afe9e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:49:56.336064 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d98d44-3e37-4491-99d0-b34c815afe9e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:49:56.361784 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-d1d98d44-3e37-4491-99d0-b34c815afe9e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:49:56.363446 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 609/1208] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:49:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:49:56.370220 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46174c05-0926-4cc5-aab2-279df3f76383 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:49:56.380456 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46174c05-0926-4cc5-aab2-279df3f76383 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:49:56.385114 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7590a2f-2eeb-41d9-9c78-05dc023ec5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:49:56.385728 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7590a2f-2eeb-41d9-9c78-05dc023ec5ca admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:49:56.385999 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7590a2f-2eeb-41d9-9c78-05dc023ec5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:49:56.386325 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7590a2f-2eeb-41d9-9c78-05dc023ec5ca admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:49:56.387103 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7590a2f-2eeb-41d9-9c78-05dc023ec5ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:49:56.387401 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7590a2f-2eeb-41d9-9c78-05dc023ec5ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:49:56.389083 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7590a2f-2eeb-41d9-9c78-05dc023ec5ca admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:49:56.401775 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 600/1209] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:49:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:49:56.408272 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d98d44-3e37-4491-99d0-b34c815afe9e admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:49:56.419315 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d98d44-3e37-4491-99d0-b34c815afe9e admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:49:56.424227 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a48774-e6be-4a96-990c-f290b10750c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:49:56.425082 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a48774-e6be-4a96-990c-f290b10750c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:49:56.425360 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a48774-e6be-4a96-990c-f290b10750c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:49:56.425628 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a48774-e6be-4a96-990c-f290b10750c7 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:49:56.433613 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a48774-e6be-4a96-990c-f290b10750c7 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:49:56.435786 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a48774-e6be-4a96-990c-f290b10750c7 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:49:56.451766 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-57a48774-e6be-4a96-990c-f290b10750c7 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 24 04:49:56.453066 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 610/1210] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:49:56 2021] GET /identity/v3/users/placement => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:49:56.459753 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7590a2f-2eeb-41d9-9c78-05dc023ec5ca admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:49:56.469934 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7590a2f-2eeb-41d9-9c78-05dc023ec5ca admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:49:56.475103 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d215a0-d173-4b01-bec7-d5686914f83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:49:56.475848 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d215a0-d173-4b01-bec7-d5686914f83f admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:49:56.476132 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d215a0-d173-4b01-bec7-d5686914f83f admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:49:56.476421 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d215a0-d173-4b01-bec7-d5686914f83f admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:49:56.477346 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d215a0-d173-4b01-bec7-d5686914f83f admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:49:56.477683 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d215a0-d173-4b01-bec7-d5686914f83f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:49:56.479854 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d215a0-d173-4b01-bec7-d5686914f83f admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:49:56.498781 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 601/1211] 10.222.0.43 () {56 vars in 1164 bytes} [Fri Dec 24 04:49:56 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:49:56.505451 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a48774-e6be-4a96-990c-f290b10750c7 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:49:56.516296 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a48774-e6be-4a96-990c-f290b10750c7 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:49:56.522087 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea89a7b-4910-489d-9f35-ef1d96ca3b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:49:56.522753 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea89a7b-4910-489d-9f35-ef1d96ca3b4a admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:49:56.523039 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea89a7b-4910-489d-9f35-ef1d96ca3b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:49:56.523305 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea89a7b-4910-489d-9f35-ef1d96ca3b4a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:49:56.532925 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea89a7b-4910-489d-9f35-ef1d96ca3b4a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:49:56.534744 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea89a7b-4910-489d-9f35-ef1d96ca3b4a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:49:56.544876 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 611/1212] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:49:56 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:49:56.551905 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d215a0-d173-4b01-bec7-d5686914f83f admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:49:56.563506 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d215a0-d173-4b01-bec7-d5686914f83f admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:49:56.568689 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f0946-22f3-42de-b054-bc37ad582af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:49:56.569574 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f0946-22f3-42de-b054-bc37ad582af4 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:49:56.569925 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f0946-22f3-42de-b054-bc37ad582af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:49:56.570206 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f0946-22f3-42de-b054-bc37ad582af4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:49:56.582092 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f0946-22f3-42de-b054-bc37ad582af4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:49:56.584926 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f0946-22f3-42de-b054-bc37ad582af4 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:49:56.608218 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-f43f0946-22f3-42de-b054-bc37ad582af4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:49:56.610075 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 602/1213] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:49:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:49:56.616966 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea89a7b-4910-489d-9f35-ef1d96ca3b4a admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:49:56.630564 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea89a7b-4910-489d-9f35-ef1d96ca3b4a admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:49:56.636077 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc9a0f1-63d4-4620-9473-e8a25c2303ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:49:56.636928 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc9a0f1-63d4-4620-9473-e8a25c2303ee admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:49:56.637388 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc9a0f1-63d4-4620-9473-e8a25c2303ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:49:56.637802 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc9a0f1-63d4-4620-9473-e8a25c2303ee admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:49:56.638708 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc9a0f1-63d4-4620-9473-e8a25c2303ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:49:56.639151 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc9a0f1-63d4-4620-9473-e8a25c2303ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:49:56.641010 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc9a0f1-63d4-4620-9473-e8a25c2303ee admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:49:56.656590 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 612/1214] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:49:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:49:56.662146 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f0946-22f3-42de-b054-bc37ad582af4 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:49:56.674049 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f0946-22f3-42de-b054-bc37ad582af4 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:49:56.680094 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e40e85-97da-49fa-8ef7-e09f2841da77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:49:56.681155 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e40e85-97da-49fa-8ef7-e09f2841da77 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:49:56.681506 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e40e85-97da-49fa-8ef7-e09f2841da77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:49:56.681832 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e40e85-97da-49fa-8ef7-e09f2841da77 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:49:56.693640 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e40e85-97da-49fa-8ef7-e09f2841da77 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:49:56.696038 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e40e85-97da-49fa-8ef7-e09f2841da77 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:49:56.713659 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-a1e40e85-97da-49fa-8ef7-e09f2841da77 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 24 04:49:56.720360 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 603/1215] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Dec 24 04:49:56 2021] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:49:56.721781 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc9a0f1-63d4-4620-9473-e8a25c2303ee admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:49:56.732380 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc9a0f1-63d4-4620-9473-e8a25c2303ee admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:49:56.736903 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b383e2be-d817-4ab7-9e86-5f5e93c87c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:49:56.737575 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383e2be-d817-4ab7-9e86-5f5e93c87c49 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:49:56.737923 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383e2be-d817-4ab7-9e86-5f5e93c87c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:49:56.738281 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383e2be-d817-4ab7-9e86-5f5e93c87c49 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:49:56.739178 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b383e2be-d817-4ab7-9e86-5f5e93c87c49 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:49:56.739515 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b383e2be-d817-4ab7-9e86-5f5e93c87c49 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:49:56.741548 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b383e2be-d817-4ab7-9e86-5f5e93c87c49 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:49:56.756397 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 613/1216] 10.222.0.43 () {56 vars in 1169 bytes} [Fri Dec 24 04:49:56 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:49:56.763639 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e40e85-97da-49fa-8ef7-e09f2841da77 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:49:56.780218 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e40e85-97da-49fa-8ef7-e09f2841da77 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:49:56.786497 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c072e29-fcc6-43fc-92fa-7a63ddf84879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:49:56.787401 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c072e29-fcc6-43fc-92fa-7a63ddf84879 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:49:56.787790 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c072e29-fcc6-43fc-92fa-7a63ddf84879 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:49:56.788192 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c072e29-fcc6-43fc-92fa-7a63ddf84879 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:49:56.789633 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c072e29-fcc6-43fc-92fa-7a63ddf84879 admin admin] RBAC: Adding query filter params (role.id=81b14dd0538e44b4bfa9bb906718914a, scope.project.id=c19ba4a2c0224c079c5a8a6a56569fd6, user.id=430d6177e74c4dbda7fb83d04c75617e) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:49:56.790101 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c072e29-fcc6-43fc-92fa-7a63ddf84879 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:49:56.793342 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c072e29-fcc6-43fc-92fa-7a63ddf84879 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:49:56.804599 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 604/1217] 10.222.0.43 () {56 vars in 1395 bytes} [Fri Dec 24 04:49:56 2021] GET /identity/v3/role_assignments?user.id=430d6177e74c4dbda7fb83d04c75617e&scope.project.id=c19ba4a2c0224c079c5a8a6a56569fd6&role.id=81b14dd0538e44b4bfa9bb906718914a => generated 259 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:49:59.197648 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba86b18-8323-472a-9603-1a734e262455 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:49:59.198290 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba86b18-8323-472a-9603-1a734e262455 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:49:59.198290 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba86b18-8323-472a-9603-1a734e262455 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:49:59.200079 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 614/1218] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:49:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:49:59.206484 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba3d49-debb-4811-9c87-6ada20336602 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:49:59.207040 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba3d49-debb-4811-9c87-6ada20336602 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:49:59.207391 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba3d49-debb-4811-9c87-6ada20336602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:49:59.230383 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-74ba3d49-debb-4811-9c87-6ada20336602 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:49:59.231970 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-74ba3d49-debb-4811-9c87-6ada20336602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:49:59.243054 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 605/1219] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:49:59 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 04:49:59.273801 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba86b18-8323-472a-9603-1a734e262455 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:49:59.286892 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba86b18-8323-472a-9603-1a734e262455 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:49:59.292544 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4180da-23ce-4a1c-bc9d-b05577be53c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:49:59.293341 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4180da-23ce-4a1c-bc9d-b05577be53c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:49:59.293630 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4180da-23ce-4a1c-bc9d-b05577be53c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:49:59.293939 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4180da-23ce-4a1c-bc9d-b05577be53c3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:49:59.305676 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4180da-23ce-4a1c-bc9d-b05577be53c3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:49:59.314118 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-7e4180da-23ce-4a1c-bc9d-b05577be53c3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 24 04:49:59.321090 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 615/1220] 10.222.0.43 () {56 vars in 1123 bytes} [Fri Dec 24 04:49:59 2021] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:49:59.322292 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba3d49-debb-4811-9c87-6ada20336602 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:49:59.332591 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba3d49-debb-4811-9c87-6ada20336602 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:49:59.338373 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0bdbb4-5fc0-4e71-af43-7a44144309c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:49:59.339172 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0bdbb4-5fc0-4e71-af43-7a44144309c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:49:59.339427 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0bdbb4-5fc0-4e71-af43-7a44144309c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:49:59.339800 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0bdbb4-5fc0-4e71-af43-7a44144309c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:49:59.340632 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0bdbb4-5fc0-4e71-af43-7a44144309c1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:49:59.340990 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0bdbb4-5fc0-4e71-af43-7a44144309c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:49:59.342790 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0bdbb4-5fc0-4e71-af43-7a44144309c1 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:49:59.351780 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 606/1221] 10.222.0.43 () {56 vars in 1124 bytes} [Fri Dec 24 04:49:59 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:49:59.358322 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4180da-23ce-4a1c-bc9d-b05577be53c3 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:49:59.370092 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4180da-23ce-4a1c-bc9d-b05577be53c3 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:49:59.375279 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01054093-b5cd-453d-a7f8-832fc48c903e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:49:59.376073 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01054093-b5cd-453d-a7f8-832fc48c903e admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:49:59.376350 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01054093-b5cd-453d-a7f8-832fc48c903e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:49:59.376701 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01054093-b5cd-453d-a7f8-832fc48c903e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:49:59.386980 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01054093-b5cd-453d-a7f8-832fc48c903e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:49:59.388851 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01054093-b5cd-453d-a7f8-832fc48c903e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:49:59.407094 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-01054093-b5cd-453d-a7f8-832fc48c903e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:49:59.408549 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 616/1222] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:49:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:49:59.415499 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0bdbb4-5fc0-4e71-af43-7a44144309c1 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:49:59.426998 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0bdbb4-5fc0-4e71-af43-7a44144309c1 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:49:59.432955 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a04914f-998f-4211-9fe3-da1170446872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:49:59.433930 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04914f-998f-4211-9fe3-da1170446872 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:49:59.434473 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04914f-998f-4211-9fe3-da1170446872 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:49:59.434937 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04914f-998f-4211-9fe3-da1170446872 admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:49:59.436258 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a04914f-998f-4211-9fe3-da1170446872 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:49:59.436790 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a04914f-998f-4211-9fe3-da1170446872 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:49:59.439061 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a04914f-998f-4211-9fe3-da1170446872 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:49:59.455106 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 607/1223] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:49:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:49:59.461732 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01054093-b5cd-453d-a7f8-832fc48c903e admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:49:59.473017 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01054093-b5cd-453d-a7f8-832fc48c903e admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:49:59.478660 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb2c231-f413-45fe-9798-9f03d48963bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:49:59.479558 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2c231-f413-45fe-9798-9f03d48963bc admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:49:59.479873 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2c231-f413-45fe-9798-9f03d48963bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:49:59.480195 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2c231-f413-45fe-9798-9f03d48963bc admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:49:59.488700 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb2c231-f413-45fe-9798-9f03d48963bc admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:49:59.490849 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb2c231-f413-45fe-9798-9f03d48963bc admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:49:59.506318 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-8bb2c231-f413-45fe-9798-9f03d48963bc admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 24 04:49:59.507536 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 617/1224] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:49:59 2021] GET /identity/v3/users/placement => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:49:59.515039 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a04914f-998f-4211-9fe3-da1170446872 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:49:59.528320 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a04914f-998f-4211-9fe3-da1170446872 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:49:59.533856 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb0fa57-8140-4971-a79e-effe770c3d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:49:59.534673 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0fa57-8140-4971-a79e-effe770c3d34 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:49:59.534992 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0fa57-8140-4971-a79e-effe770c3d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:49:59.535302 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0fa57-8140-4971-a79e-effe770c3d34 admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:49:59.536453 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb0fa57-8140-4971-a79e-effe770c3d34 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:49:59.536983 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb0fa57-8140-4971-a79e-effe770c3d34 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:49:59.539583 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb0fa57-8140-4971-a79e-effe770c3d34 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:49:59.560354 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 608/1225] 10.222.0.43 () {56 vars in 1164 bytes} [Fri Dec 24 04:49:59 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:49:59.566787 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb2c231-f413-45fe-9798-9f03d48963bc admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:49:59.578803 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb2c231-f413-45fe-9798-9f03d48963bc admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:49:59.585157 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e960503-b4dd-478c-95ea-85692985f371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:49:59.585966 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e960503-b4dd-478c-95ea-85692985f371 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:49:59.586305 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e960503-b4dd-478c-95ea-85692985f371 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:49:59.586624 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e960503-b4dd-478c-95ea-85692985f371 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:49:59.598126 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e960503-b4dd-478c-95ea-85692985f371 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:49:59.599972 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e960503-b4dd-478c-95ea-85692985f371 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:49:59.617374 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-9e960503-b4dd-478c-95ea-85692985f371 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:49:59.618583 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 618/1226] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:49:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:49:59.625362 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb0fa57-8140-4971-a79e-effe770c3d34 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:49:59.639756 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb0fa57-8140-4971-a79e-effe770c3d34 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:49:59.645630 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b63d0-0f05-44ae-8b08-9f5b0550df58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:49:59.646407 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b63d0-0f05-44ae-8b08-9f5b0550df58 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:49:59.646672 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b63d0-0f05-44ae-8b08-9f5b0550df58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:49:59.646944 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b63d0-0f05-44ae-8b08-9f5b0550df58 admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:49:59.647685 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b63d0-0f05-44ae-8b08-9f5b0550df58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:49:59.647984 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b63d0-0f05-44ae-8b08-9f5b0550df58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:49:59.650210 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b63d0-0f05-44ae-8b08-9f5b0550df58 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:49:59.664205 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 609/1227] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:49:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:49:59.670686 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e960503-b4dd-478c-95ea-85692985f371 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:49:59.682588 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e960503-b4dd-478c-95ea-85692985f371 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:49:59.688295 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a9e34-a95b-4c08-94da-9259818947ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:49:59.689169 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a9e34-a95b-4c08-94da-9259818947ae admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:49:59.689486 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a9e34-a95b-4c08-94da-9259818947ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:49:59.689800 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a9e34-a95b-4c08-94da-9259818947ae admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:49:59.697071 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11a9e34-a95b-4c08-94da-9259818947ae admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:49:59.699097 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11a9e34-a95b-4c08-94da-9259818947ae admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:49:59.713266 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-d11a9e34-a95b-4c08-94da-9259818947ae admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 24 04:49:59.714839 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 619/1228] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Dec 24 04:49:59 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:49:59.722100 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b63d0-0f05-44ae-8b08-9f5b0550df58 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:49:59.737262 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b63d0-0f05-44ae-8b08-9f5b0550df58 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:49:59.743443 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3400b35-2936-4923-afbd-b02eeb1425e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:49:59.744854 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3400b35-2936-4923-afbd-b02eeb1425e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:49:59.745347 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3400b35-2936-4923-afbd-b02eeb1425e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:49:59.745724 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3400b35-2936-4923-afbd-b02eeb1425e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:49:59.746674 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3400b35-2936-4923-afbd-b02eeb1425e7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:49:59.747198 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3400b35-2936-4923-afbd-b02eeb1425e7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:49:59.750223 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3400b35-2936-4923-afbd-b02eeb1425e7 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:49:59.767190 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 610/1229] 10.222.0.43 () {56 vars in 1169 bytes} [Fri Dec 24 04:49:59 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:49:59.775239 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a9e34-a95b-4c08-94da-9259818947ae admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:49:59.793315 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a9e34-a95b-4c08-94da-9259818947ae admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:49:59.798937 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d70f58-f6d2-427a-806d-d6889cf269f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:49:59.800097 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d70f58-f6d2-427a-806d-d6889cf269f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:49:59.800513 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d70f58-f6d2-427a-806d-d6889cf269f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:49:59.800823 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d70f58-f6d2-427a-806d-d6889cf269f4 admin admin] PATH_INFO: `/v3/projects/c19ba4a2c0224c079c5a8a6a56569fd6/users/430d6177e74c4dbda7fb83d04c75617e/roles/81b14dd0538e44b4bfa9bb906718914a` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:49:59.817158 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d70f58-f6d2-427a-806d-d6889cf269f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c19ba4a2c0224c079c5a8a6a56569fd6, user_id=430d6177e74c4dbda7fb83d04c75617e, role_id=81b14dd0538e44b4bfa9bb906718914a)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:49:59.820151 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d70f58-f6d2-427a-806d-d6889cf269f4 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:49:59.833633 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 620/1230] 10.222.0.43 () {58 vars in 1460 bytes} [Fri Dec 24 04:49:59 2021] PUT /identity/v3/projects/c19ba4a2c0224c079c5a8a6a56569fd6/users/430d6177e74c4dbda7fb83d04c75617e/roles/81b14dd0538e44b4bfa9bb906718914a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 04:50:02.451814 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f22765-d0ca-4304-8fca-cb472764f0eb None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:02.452436 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f22765-d0ca-4304-8fca-cb472764f0eb None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:02.452436 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f22765-d0ca-4304-8fca-cb472764f0eb None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:02.454359 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 611/1231] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:50:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:50:02.462840 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce9a89-a026-448b-ad17-dbc3b7a81552 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:02.463344 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce9a89-a026-448b-ad17-dbc3b7a81552 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:02.463583 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce9a89-a026-448b-ad17-dbc3b7a81552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:02.483944 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-01ce9a89-a026-448b-ad17-dbc3b7a81552 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:50:02.485320 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-01ce9a89-a026-448b-ad17-dbc3b7a81552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:50:02.546680 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 621/1232] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:50:02 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 04:50:02.572454 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f22765-d0ca-4304-8fca-cb472764f0eb None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:50:02.585634 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f22765-d0ca-4304-8fca-cb472764f0eb None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:50:02.591356 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccbb100-b154-4923-815b-145bab9c1a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:50:02.592261 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbb100-b154-4923-815b-145bab9c1a78 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:02.592572 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbb100-b154-4923-815b-145bab9c1a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:02.592852 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbb100-b154-4923-815b-145bab9c1a78 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:02.605023 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccbb100-b154-4923-815b-145bab9c1a78 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:50:02.612750 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-4ccbb100-b154-4923-815b-145bab9c1a78 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 24 04:50:02.613981 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 612/1233] 10.222.0.43 () {56 vars in 1123 bytes} [Fri Dec 24 04:50:02 2021] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:50:02.621136 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce9a89-a026-448b-ad17-dbc3b7a81552 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:50:02.630246 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce9a89-a026-448b-ad17-dbc3b7a81552 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:50:02.635443 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200f125-7a8a-4706-bfde-b2b5ce27ed19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:50:02.636109 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200f125-7a8a-4706-bfde-b2b5ce27ed19 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:02.636383 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200f125-7a8a-4706-bfde-b2b5ce27ed19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:02.636683 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200f125-7a8a-4706-bfde-b2b5ce27ed19 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:02.637450 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7200f125-7a8a-4706-bfde-b2b5ce27ed19 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:50:02.637750 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7200f125-7a8a-4706-bfde-b2b5ce27ed19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:50:02.639337 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7200f125-7a8a-4706-bfde-b2b5ce27ed19 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:50:02.647630 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 622/1234] 10.222.0.43 () {56 vars in 1124 bytes} [Fri Dec 24 04:50:02 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:50:02.655082 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccbb100-b154-4923-815b-145bab9c1a78 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:50:02.669678 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccbb100-b154-4923-815b-145bab9c1a78 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:50:02.675315 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece3820-0e16-44d6-a134-90cbe25478f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:50:02.676152 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece3820-0e16-44d6-a134-90cbe25478f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:02.676407 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece3820-0e16-44d6-a134-90cbe25478f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:02.676752 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece3820-0e16-44d6-a134-90cbe25478f7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:02.689694 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ece3820-0e16-44d6-a134-90cbe25478f7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:50:02.691945 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ece3820-0e16-44d6-a134-90cbe25478f7 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:50:02.709243 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-7ece3820-0e16-44d6-a134-90cbe25478f7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:50:02.710472 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 613/1235] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:50:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:50:02.717538 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200f125-7a8a-4706-bfde-b2b5ce27ed19 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:50:02.729249 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200f125-7a8a-4706-bfde-b2b5ce27ed19 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:50:02.735016 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f65f6d-edba-4362-bc39-65ff538c1059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:50:02.735790 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f65f6d-edba-4362-bc39-65ff538c1059 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:02.736323 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f65f6d-edba-4362-bc39-65ff538c1059 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:02.736652 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f65f6d-edba-4362-bc39-65ff538c1059 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:02.737493 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f65f6d-edba-4362-bc39-65ff538c1059 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:50:02.737822 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f65f6d-edba-4362-bc39-65ff538c1059 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:50:02.739706 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f65f6d-edba-4362-bc39-65ff538c1059 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:50:02.757436 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 623/1236] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:50:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:50:02.758642 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece3820-0e16-44d6-a134-90cbe25478f7 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:50:02.777470 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece3820-0e16-44d6-a134-90cbe25478f7 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:50:02.782218 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a265c9a-9267-4b79-9df5-c35593c29ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:50:02.783100 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a265c9a-9267-4b79-9df5-c35593c29ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:02.783383 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a265c9a-9267-4b79-9df5-c35593c29ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:02.783657 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a265c9a-9267-4b79-9df5-c35593c29ea2 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:02.793782 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a265c9a-9267-4b79-9df5-c35593c29ea2 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:50:02.795981 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a265c9a-9267-4b79-9df5-c35593c29ea2 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:50:02.818323 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-6a265c9a-9267-4b79-9df5-c35593c29ea2 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 24 04:50:02.820188 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 614/1237] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:50:02 2021] GET /identity/v3/users/placement => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:50:02.826837 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f65f6d-edba-4362-bc39-65ff538c1059 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:50:02.839448 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f65f6d-edba-4362-bc39-65ff538c1059 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:50:02.844499 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f9b31-b088-457f-bd7a-961d0d34cca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:50:02.845241 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f9b31-b088-457f-bd7a-961d0d34cca3 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:02.845549 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f9b31-b088-457f-bd7a-961d0d34cca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:02.845868 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f9b31-b088-457f-bd7a-961d0d34cca3 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:02.846783 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f9b31-b088-457f-bd7a-961d0d34cca3 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:50:02.848187 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f9b31-b088-457f-bd7a-961d0d34cca3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:50:02.850900 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f9b31-b088-457f-bd7a-961d0d34cca3 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:50:02.870101 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 624/1238] 10.222.0.43 () {56 vars in 1164 bytes} [Fri Dec 24 04:50:02 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:50:02.877265 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a265c9a-9267-4b79-9df5-c35593c29ea2 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:50:02.887516 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a265c9a-9267-4b79-9df5-c35593c29ea2 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:50:02.892042 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72eb6a8-b7ca-4fe0-81b0-045fe884d261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:50:02.892702 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72eb6a8-b7ca-4fe0-81b0-045fe884d261 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:02.892979 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72eb6a8-b7ca-4fe0-81b0-045fe884d261 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:02.893248 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72eb6a8-b7ca-4fe0-81b0-045fe884d261 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:02.901368 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72eb6a8-b7ca-4fe0-81b0-045fe884d261 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:50:02.903294 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72eb6a8-b7ca-4fe0-81b0-045fe884d261 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:50:02.917723 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 615/1239] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:50:02 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:50:02.919266 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f9b31-b088-457f-bd7a-961d0d34cca3 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:50:02.930669 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f9b31-b088-457f-bd7a-961d0d34cca3 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:50:02.937574 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b9d41f-1911-449c-86c1-0c81d63acf5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:50:02.938528 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b9d41f-1911-449c-86c1-0c81d63acf5b admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:02.938957 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b9d41f-1911-449c-86c1-0c81d63acf5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:02.939379 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b9d41f-1911-449c-86c1-0c81d63acf5b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:02.951019 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b9d41f-1911-449c-86c1-0c81d63acf5b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:50:02.953204 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b9d41f-1911-449c-86c1-0c81d63acf5b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:50:02.972031 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-14b9d41f-1911-449c-86c1-0c81d63acf5b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:50:02.973287 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 625/1240] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:50:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:50:02.980236 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72eb6a8-b7ca-4fe0-81b0-045fe884d261 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:50:02.990273 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72eb6a8-b7ca-4fe0-81b0-045fe884d261 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:50:02.996168 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d70c8-1e73-42e4-9a00-7db56b0c0abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:50:02.996872 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d70c8-1e73-42e4-9a00-7db56b0c0abb admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:02.997137 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d70c8-1e73-42e4-9a00-7db56b0c0abb admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:02.997415 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d70c8-1e73-42e4-9a00-7db56b0c0abb admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:02.998165 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d70c8-1e73-42e4-9a00-7db56b0c0abb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:50:02.998489 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d70c8-1e73-42e4-9a00-7db56b0c0abb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:50:03.000126 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d70c8-1e73-42e4-9a00-7db56b0c0abb admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:50:03.013117 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 616/1241] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:50:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:50:03.024344 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b9d41f-1911-449c-86c1-0c81d63acf5b admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:50:03.037873 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b9d41f-1911-449c-86c1-0c81d63acf5b admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:50:03.043295 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc13be-e2f6-4e44-a67a-572612bd0280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:50:03.044288 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc13be-e2f6-4e44-a67a-572612bd0280 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:03.044655 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc13be-e2f6-4e44-a67a-572612bd0280 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:03.044955 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc13be-e2f6-4e44-a67a-572612bd0280 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:03.053170 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddc13be-e2f6-4e44-a67a-572612bd0280 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:50:03.055171 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddc13be-e2f6-4e44-a67a-572612bd0280 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:50:03.070514 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-eddc13be-e2f6-4e44-a67a-572612bd0280 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 24 04:50:03.071815 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 626/1242] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Dec 24 04:50:03 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:50:03.079627 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d70c8-1e73-42e4-9a00-7db56b0c0abb admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:50:03.090919 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d70c8-1e73-42e4-9a00-7db56b0c0abb admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:50:03.095685 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d854b-717a-4423-92c9-802b8cc40c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:50:03.096355 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d854b-717a-4423-92c9-802b8cc40c65 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:03.096743 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d854b-717a-4423-92c9-802b8cc40c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:03.097031 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d854b-717a-4423-92c9-802b8cc40c65 admin admin] PATH_INFO: `/v3/projects` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:03.097980 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4d854b-717a-4423-92c9-802b8cc40c65 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:50:03.098283 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4d854b-717a-4423-92c9-802b8cc40c65 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:50:03.100259 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4d854b-717a-4423-92c9-802b8cc40c65 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:50:03.112909 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 617/1243] 10.222.0.43 () {56 vars in 1169 bytes} [Fri Dec 24 04:50:03 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:50:03.120500 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc13be-e2f6-4e44-a67a-572612bd0280 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:50:03.136648 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc13be-e2f6-4e44-a67a-572612bd0280 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:50:03.141120 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7def56a-87a2-432a-8e70-416edb516c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:50:03.141767 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7def56a-87a2-432a-8e70-416edb516c5d admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:03.142040 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7def56a-87a2-432a-8e70-416edb516c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:03.142309 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7def56a-87a2-432a-8e70-416edb516c5d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:03.143144 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7def56a-87a2-432a-8e70-416edb516c5d admin admin] RBAC: Adding query filter params (role.id=81b14dd0538e44b4bfa9bb906718914a, scope.project.id=c19ba4a2c0224c079c5a8a6a56569fd6, user.id=430d6177e74c4dbda7fb83d04c75617e) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:50:03.143444 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7def56a-87a2-432a-8e70-416edb516c5d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:50:03.145297 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7def56a-87a2-432a-8e70-416edb516c5d admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:50:03.151677 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 627/1244] 10.222.0.43 () {56 vars in 1395 bytes} [Fri Dec 24 04:50:03 2021] GET /identity/v3/role_assignments?user.id=430d6177e74c4dbda7fb83d04c75617e&scope.project.id=c19ba4a2c0224c079c5a8a6a56569fd6&role.id=81b14dd0538e44b4bfa9bb906718914a => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:50:05.695966 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831eec94-16e7-456c-a469-521b43dd7dd0 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:05.696647 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831eec94-16e7-456c-a469-521b43dd7dd0 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:05.696647 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831eec94-16e7-456c-a469-521b43dd7dd0 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:05.698636 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 618/1245] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:50:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:50:05.706269 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a0454-5b32-4199-ac94-5065931a3d53 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:05.706818 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a0454-5b32-4199-ac94-5065931a3d53 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:05.706818 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a0454-5b32-4199-ac94-5065931a3d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:05.731316 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-9c0a0454-5b32-4199-ac94-5065931a3d53 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:50:05.732626 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-9c0a0454-5b32-4199-ac94-5065931a3d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:50:05.745251 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 628/1246] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:50:05 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 04:50:05.772261 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831eec94-16e7-456c-a469-521b43dd7dd0 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:50:05.787118 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831eec94-16e7-456c-a469-521b43dd7dd0 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:50:05.792810 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ff48d-e8d4-4870-87b0-4dc661a490fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:50:05.793657 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ff48d-e8d4-4870-87b0-4dc661a490fa admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:05.793965 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ff48d-e8d4-4870-87b0-4dc661a490fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:05.794269 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ff48d-e8d4-4870-87b0-4dc661a490fa admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:05.806081 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894ff48d-e8d4-4870-87b0-4dc661a490fa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:50:05.814282 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-894ff48d-e8d4-4870-87b0-4dc661a490fa admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 24 04:50:05.815633 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 619/1247] 10.222.0.43 () {56 vars in 1117 bytes} [Fri Dec 24 04:50:05 2021] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:50:05.823712 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a0454-5b32-4199-ac94-5065931a3d53 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:50:05.833637 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a0454-5b32-4199-ac94-5065931a3d53 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:50:05.839605 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3a3d6-78bb-4b06-b6d6-ecfce6af6b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:50:05.840272 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3a3d6-78bb-4b06-b6d6-ecfce6af6b7b admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:05.840579 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3a3d6-78bb-4b06-b6d6-ecfce6af6b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:05.840857 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3a3d6-78bb-4b06-b6d6-ecfce6af6b7b admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:05.841621 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa3a3d6-78bb-4b06-b6d6-ecfce6af6b7b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:50:05.841926 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa3a3d6-78bb-4b06-b6d6-ecfce6af6b7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:50:05.843551 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa3a3d6-78bb-4b06-b6d6-ecfce6af6b7b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:50:05.853770 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 629/1248] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:50:05 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:50:05.860853 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ff48d-e8d4-4870-87b0-4dc661a490fa admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:50:05.873005 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ff48d-e8d4-4870-87b0-4dc661a490fa admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:50:05.878758 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c0c3f-f294-443e-ba7e-e7f0929adda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:50:05.879812 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c0c3f-f294-443e-ba7e-e7f0929adda2 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:05.880104 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c0c3f-f294-443e-ba7e-e7f0929adda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:05.880612 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c0c3f-f294-443e-ba7e-e7f0929adda2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:05.893229 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4c0c3f-f294-443e-ba7e-e7f0929adda2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:50:05.895294 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4c0c3f-f294-443e-ba7e-e7f0929adda2 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:50:05.913118 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-2e4c0c3f-f294-443e-ba7e-e7f0929adda2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:50:05.914521 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 620/1249] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:50:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:50:05.921455 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3a3d6-78bb-4b06-b6d6-ecfce6af6b7b admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:50:05.931748 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3a3d6-78bb-4b06-b6d6-ecfce6af6b7b admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:50:05.937292 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e2299-e638-40b1-a7f7-52153bc336af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:50:05.937977 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e2299-e638-40b1-a7f7-52153bc336af admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:05.938279 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e2299-e638-40b1-a7f7-52153bc336af admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:05.938581 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e2299-e638-40b1-a7f7-52153bc336af admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:05.939392 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23e2299-e638-40b1-a7f7-52153bc336af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:50:05.939728 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23e2299-e638-40b1-a7f7-52153bc336af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:50:05.941701 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23e2299-e638-40b1-a7f7-52153bc336af admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:50:05.962812 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 630/1250] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:50:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:50:05.969340 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c0c3f-f294-443e-ba7e-e7f0929adda2 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:50:05.979721 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c0c3f-f294-443e-ba7e-e7f0929adda2 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:50:05.984329 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9648be3-8179-40c6-8eec-385a6faed5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:50:05.985150 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9648be3-8179-40c6-8eec-385a6faed5a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:05.985425 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9648be3-8179-40c6-8eec-385a6faed5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:05.985691 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9648be3-8179-40c6-8eec-385a6faed5a9 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:05.992967 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9648be3-8179-40c6-8eec-385a6faed5a9 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:50:05.995360 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9648be3-8179-40c6-8eec-385a6faed5a9 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:50:06.008830 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-e9648be3-8179-40c6-8eec-385a6faed5a9 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 24 04:50:06.010019 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 621/1251] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:50:05 2021] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 24 04:50:06.016452 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e2299-e638-40b1-a7f7-52153bc336af admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:50:06.028380 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e2299-e638-40b1-a7f7-52153bc336af admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:50:06.033408 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced03ed2-a31e-4508-8113-0fd65bf939f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:50:06.034063 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced03ed2-a31e-4508-8113-0fd65bf939f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:06.034364 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced03ed2-a31e-4508-8113-0fd65bf939f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:06.034716 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced03ed2-a31e-4508-8113-0fd65bf939f0 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:06.035605 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced03ed2-a31e-4508-8113-0fd65bf939f0 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:50:06.035925 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced03ed2-a31e-4508-8113-0fd65bf939f0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:50:06.037995 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced03ed2-a31e-4508-8113-0fd65bf939f0 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:50:06.057842 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 631/1252] 10.222.0.43 () {56 vars in 1164 bytes} [Fri Dec 24 04:50:06 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:50:06.064414 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9648be3-8179-40c6-8eec-385a6faed5a9 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:50:06.079337 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9648be3-8179-40c6-8eec-385a6faed5a9 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:50:06.087101 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e284dd2-59b6-4bdc-b2e1-a32795ff1fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:50:06.088071 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e284dd2-59b6-4bdc-b2e1-a32795ff1fde admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:06.088884 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e284dd2-59b6-4bdc-b2e1-a32795ff1fde admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:06.089232 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e284dd2-59b6-4bdc-b2e1-a32795ff1fde admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:06.101997 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e284dd2-59b6-4bdc-b2e1-a32795ff1fde admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:50:06.103964 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e284dd2-59b6-4bdc-b2e1-a32795ff1fde admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:50:06.115666 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 622/1253] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:50:06 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:50:06.123256 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced03ed2-a31e-4508-8113-0fd65bf939f0 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:50:06.134179 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced03ed2-a31e-4508-8113-0fd65bf939f0 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:50:06.139958 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07365543-786d-45c7-baaf-64268c433c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:50:06.140962 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07365543-786d-45c7-baaf-64268c433c70 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:06.141252 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07365543-786d-45c7-baaf-64268c433c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:06.141538 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07365543-786d-45c7-baaf-64268c433c70 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:06.154275 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07365543-786d-45c7-baaf-64268c433c70 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:50:06.156477 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07365543-786d-45c7-baaf-64268c433c70 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:50:06.175778 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-07365543-786d-45c7-baaf-64268c433c70 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:50:06.176995 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 632/1254] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:50:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:50:06.183790 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e284dd2-59b6-4bdc-b2e1-a32795ff1fde admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:50:06.193585 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e284dd2-59b6-4bdc-b2e1-a32795ff1fde admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:50:06.199861 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f4999-9c9c-4120-a8ea-86f98dda047c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:50:06.200643 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f4999-9c9c-4120-a8ea-86f98dda047c admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:06.200990 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f4999-9c9c-4120-a8ea-86f98dda047c admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:06.201331 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f4999-9c9c-4120-a8ea-86f98dda047c admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:06.202180 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f4999-9c9c-4120-a8ea-86f98dda047c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:50:06.202570 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f4999-9c9c-4120-a8ea-86f98dda047c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:50:06.204338 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f4999-9c9c-4120-a8ea-86f98dda047c admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:50:06.218292 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 623/1255] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:50:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:50:06.226253 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07365543-786d-45c7-baaf-64268c433c70 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:50:06.236922 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07365543-786d-45c7-baaf-64268c433c70 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:50:06.242009 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eaeca4-9955-4147-8ca7-eb049cf83778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:50:06.242791 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eaeca4-9955-4147-8ca7-eb049cf83778 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:06.243087 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eaeca4-9955-4147-8ca7-eb049cf83778 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:06.243363 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eaeca4-9955-4147-8ca7-eb049cf83778 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:06.250427 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eaeca4-9955-4147-8ca7-eb049cf83778 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:50:06.252357 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eaeca4-9955-4147-8ca7-eb049cf83778 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:50:06.265636 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-c9eaeca4-9955-4147-8ca7-eb049cf83778 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 24 04:50:06.267080 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 633/1256] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Dec 24 04:50:06 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:50:06.273534 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f4999-9c9c-4120-a8ea-86f98dda047c admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:50:06.285410 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f4999-9c9c-4120-a8ea-86f98dda047c admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:50:06.292042 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54e03d1-62f2-4111-9a61-c753675e15c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:50:06.292783 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e03d1-62f2-4111-9a61-c753675e15c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:06.293062 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e03d1-62f2-4111-9a61-c753675e15c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:06.293420 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e03d1-62f2-4111-9a61-c753675e15c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:06.294534 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54e03d1-62f2-4111-9a61-c753675e15c1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:50:06.294835 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54e03d1-62f2-4111-9a61-c753675e15c1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:50:06.296803 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54e03d1-62f2-4111-9a61-c753675e15c1 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:50:06.311497 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 624/1257] 10.222.0.43 () {56 vars in 1169 bytes} [Fri Dec 24 04:50:06 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:50:06.320079 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eaeca4-9955-4147-8ca7-eb049cf83778 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:50:06.333679 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eaeca4-9955-4147-8ca7-eb049cf83778 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:50:06.339855 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d1d81d-38a1-4004-9838-c8a898c56b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:50:06.340717 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d1d81d-38a1-4004-9838-c8a898c56b5f admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:06.341003 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d1d81d-38a1-4004-9838-c8a898c56b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:06.341363 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d1d81d-38a1-4004-9838-c8a898c56b5f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:06.342316 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d1d81d-38a1-4004-9838-c8a898c56b5f admin admin] RBAC: Adding query filter params (role.id=d5e6fc257d8541d5a5ed1988eacd5be7, scope.project.id=c19ba4a2c0224c079c5a8a6a56569fd6, user.id=430d6177e74c4dbda7fb83d04c75617e) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:50:06.342730 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d1d81d-38a1-4004-9838-c8a898c56b5f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:50:06.344776 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d1d81d-38a1-4004-9838-c8a898c56b5f admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:50:06.351043 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 634/1258] 10.222.0.43 () {56 vars in 1395 bytes} [Fri Dec 24 04:50:06 2021] GET /identity/v3/role_assignments?user.id=430d6177e74c4dbda7fb83d04c75617e&scope.project.id=c19ba4a2c0224c079c5a8a6a56569fd6&role.id=d5e6fc257d8541d5a5ed1988eacd5be7 => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:50:08.887446 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2f0710-bc1d-4291-a079-d10b1584ab6d None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:08.888115 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2f0710-bc1d-4291-a079-d10b1584ab6d None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:08.888115 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2f0710-bc1d-4291-a079-d10b1584ab6d None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:08.889915 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 625/1259] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:50:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:50:08.896548 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230df748-6b7d-4dd4-9c82-399e6d4d5444 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:08.897100 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230df748-6b7d-4dd4-9c82-399e6d4d5444 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:08.897213 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230df748-6b7d-4dd4-9c82-399e6d4d5444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:08.917450 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-230df748-6b7d-4dd4-9c82-399e6d4d5444 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:50:08.919031 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-230df748-6b7d-4dd4-9c82-399e6d4d5444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:50:08.930210 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 635/1260] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:50:08 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:50:08.958351 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2f0710-bc1d-4291-a079-d10b1584ab6d None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:50:08.973097 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2f0710-bc1d-4291-a079-d10b1584ab6d None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:50:08.979277 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721dcc3b-48d0-4ab7-bf53-e2f8d0cf12c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:50:08.980062 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721dcc3b-48d0-4ab7-bf53-e2f8d0cf12c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:08.980338 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721dcc3b-48d0-4ab7-bf53-e2f8d0cf12c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:08.980631 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721dcc3b-48d0-4ab7-bf53-e2f8d0cf12c1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:08.992578 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721dcc3b-48d0-4ab7-bf53-e2f8d0cf12c1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:50:09.000053 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-721dcc3b-48d0-4ab7-bf53-e2f8d0cf12c1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 24 04:50:09.001619 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 626/1261] 10.222.0.43 () {56 vars in 1117 bytes} [Fri Dec 24 04:50:08 2021] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:50:09.008249 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230df748-6b7d-4dd4-9c82-399e6d4d5444 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:50:09.019520 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230df748-6b7d-4dd4-9c82-399e6d4d5444 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:50:09.025077 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ab46b-6bdb-49b3-a9ac-aebf7c2fc517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:50:09.025752 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ab46b-6bdb-49b3-a9ac-aebf7c2fc517 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:09.026035 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ab46b-6bdb-49b3-a9ac-aebf7c2fc517 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:09.026310 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ab46b-6bdb-49b3-a9ac-aebf7c2fc517 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:09.027083 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0ab46b-6bdb-49b3-a9ac-aebf7c2fc517 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:50:09.027389 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0ab46b-6bdb-49b3-a9ac-aebf7c2fc517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:50:09.029086 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0ab46b-6bdb-49b3-a9ac-aebf7c2fc517 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:50:09.038249 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 636/1262] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:50:09 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:50:09.044769 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721dcc3b-48d0-4ab7-bf53-e2f8d0cf12c1 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:50:09.056226 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721dcc3b-48d0-4ab7-bf53-e2f8d0cf12c1 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:50:09.061701 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626ebabe-5bb1-4079-b02b-f2403a3339b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:50:09.062650 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ebabe-5bb1-4079-b02b-f2403a3339b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:09.062958 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ebabe-5bb1-4079-b02b-f2403a3339b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:09.063369 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ebabe-5bb1-4079-b02b-f2403a3339b1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:09.076981 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626ebabe-5bb1-4079-b02b-f2403a3339b1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:50:09.079029 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626ebabe-5bb1-4079-b02b-f2403a3339b1 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:50:09.097418 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-626ebabe-5bb1-4079-b02b-f2403a3339b1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:50:09.098676 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 627/1263] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:50:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:50:09.105308 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ab46b-6bdb-49b3-a9ac-aebf7c2fc517 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:50:09.116491 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ab46b-6bdb-49b3-a9ac-aebf7c2fc517 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:50:09.122411 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e90a912-ccc1-4658-a57d-d15666823a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:50:09.123326 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90a912-ccc1-4658-a57d-d15666823a98 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:09.123606 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90a912-ccc1-4658-a57d-d15666823a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:09.123880 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90a912-ccc1-4658-a57d-d15666823a98 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:09.124656 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e90a912-ccc1-4658-a57d-d15666823a98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:50:09.124994 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e90a912-ccc1-4658-a57d-d15666823a98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:50:09.127285 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e90a912-ccc1-4658-a57d-d15666823a98 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:50:09.140492 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 637/1264] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:50:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:50:09.146817 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626ebabe-5bb1-4079-b02b-f2403a3339b1 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:50:09.157496 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626ebabe-5bb1-4079-b02b-f2403a3339b1 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:50:09.162947 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4058f-8102-4407-b7ca-7aedf2755ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:50:09.163913 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4058f-8102-4407-b7ca-7aedf2755ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:09.164238 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4058f-8102-4407-b7ca-7aedf2755ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:09.164644 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4058f-8102-4407-b7ca-7aedf2755ed2 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:09.173081 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c4058f-8102-4407-b7ca-7aedf2755ed2 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:50:09.175118 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c4058f-8102-4407-b7ca-7aedf2755ed2 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:50:09.191726 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-f0c4058f-8102-4407-b7ca-7aedf2755ed2 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 24 04:50:09.193385 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 628/1265] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:50:09 2021] GET /identity/v3/users/placement => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:50:09.200328 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e90a912-ccc1-4658-a57d-d15666823a98 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:50:09.211494 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e90a912-ccc1-4658-a57d-d15666823a98 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:50:09.217511 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd59e9-f983-49e2-a2d7-89d0d7e6d560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:50:09.218353 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd59e9-f983-49e2-a2d7-89d0d7e6d560 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:09.218733 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd59e9-f983-49e2-a2d7-89d0d7e6d560 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:09.219061 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd59e9-f983-49e2-a2d7-89d0d7e6d560 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:09.219943 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd59e9-f983-49e2-a2d7-89d0d7e6d560 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:50:09.220251 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd59e9-f983-49e2-a2d7-89d0d7e6d560 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:50:09.222163 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd59e9-f983-49e2-a2d7-89d0d7e6d560 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:50:09.242112 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 638/1266] 10.222.0.43 () {56 vars in 1164 bytes} [Fri Dec 24 04:50:09 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:50:09.249707 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4058f-8102-4407-b7ca-7aedf2755ed2 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:50:09.261655 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4058f-8102-4407-b7ca-7aedf2755ed2 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:50:09.266735 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a855d-acb6-470c-b58f-8a7b6abb3add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:50:09.267580 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a855d-acb6-470c-b58f-8a7b6abb3add admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:09.267868 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a855d-acb6-470c-b58f-8a7b6abb3add admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:09.268193 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a855d-acb6-470c-b58f-8a7b6abb3add admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:09.279292 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a855d-acb6-470c-b58f-8a7b6abb3add admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:50:09.281258 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a855d-acb6-470c-b58f-8a7b6abb3add admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:50:09.301621 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-1d8a855d-acb6-470c-b58f-8a7b6abb3add admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:50:09.302925 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 629/1267] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:50:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:50:09.309558 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd59e9-f983-49e2-a2d7-89d0d7e6d560 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:50:09.320468 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd59e9-f983-49e2-a2d7-89d0d7e6d560 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:50:09.325261 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0aaff-2893-4b88-ad61-1ad729c36f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:50:09.325920 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0aaff-2893-4b88-ad61-1ad729c36f1f admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:09.326202 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0aaff-2893-4b88-ad61-1ad729c36f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:09.326482 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0aaff-2893-4b88-ad61-1ad729c36f1f admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:09.327226 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd0aaff-2893-4b88-ad61-1ad729c36f1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:50:09.327535 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd0aaff-2893-4b88-ad61-1ad729c36f1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:50:09.329182 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd0aaff-2893-4b88-ad61-1ad729c36f1f admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:50:09.341340 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 639/1268] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:50:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:50:09.347257 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a855d-acb6-470c-b58f-8a7b6abb3add admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:50:09.358425 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a855d-acb6-470c-b58f-8a7b6abb3add admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:50:09.363193 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93243761-6245-407a-b0d1-6ae4d570d9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:50:09.364192 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93243761-6245-407a-b0d1-6ae4d570d9a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:09.364506 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93243761-6245-407a-b0d1-6ae4d570d9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:09.364802 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93243761-6245-407a-b0d1-6ae4d570d9a5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:09.373514 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93243761-6245-407a-b0d1-6ae4d570d9a5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:50:09.376050 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93243761-6245-407a-b0d1-6ae4d570d9a5 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:50:09.391592 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-93243761-6245-407a-b0d1-6ae4d570d9a5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 24 04:50:09.392759 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 630/1269] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Dec 24 04:50:09 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:50:09.399991 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0aaff-2893-4b88-ad61-1ad729c36f1f admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:50:09.412349 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0aaff-2893-4b88-ad61-1ad729c36f1f admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:50:09.417680 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60418abb-5462-4a56-aa2f-db96a48282d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:50:09.418416 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60418abb-5462-4a56-aa2f-db96a48282d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:09.418695 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60418abb-5462-4a56-aa2f-db96a48282d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:09.418967 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60418abb-5462-4a56-aa2f-db96a48282d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:09.419764 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60418abb-5462-4a56-aa2f-db96a48282d1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:50:09.420068 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60418abb-5462-4a56-aa2f-db96a48282d1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:50:09.421934 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60418abb-5462-4a56-aa2f-db96a48282d1 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:50:09.433983 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 640/1270] 10.222.0.43 () {56 vars in 1169 bytes} [Fri Dec 24 04:50:09 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:50:09.441046 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93243761-6245-407a-b0d1-6ae4d570d9a5 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:50:09.452952 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93243761-6245-407a-b0d1-6ae4d570d9a5 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:50:09.457664 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af39a5-6df2-4683-a4a5-cba8f05cc4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:50:09.458539 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af39a5-6df2-4683-a4a5-cba8f05cc4c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:09.458824 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af39a5-6df2-4683-a4a5-cba8f05cc4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:09.459409 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af39a5-6df2-4683-a4a5-cba8f05cc4c7 admin admin] PATH_INFO: `/v3/projects/c19ba4a2c0224c079c5a8a6a56569fd6/users/430d6177e74c4dbda7fb83d04c75617e/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:09.461420 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af39a5-6df2-4683-a4a5-cba8f05cc4c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c19ba4a2c0224c079c5a8a6a56569fd6, user_id=430d6177e74c4dbda7fb83d04c75617e, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:50:09.464237 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af39a5-6df2-4683-a4a5-cba8f05cc4c7 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:50:09.478009 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 631/1271] 10.222.0.43 () {58 vars in 1460 bytes} [Fri Dec 24 04:50:09 2021] PUT /identity/v3/projects/c19ba4a2c0224c079c5a8a6a56569fd6/users/430d6177e74c4dbda7fb83d04c75617e/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 04:50:11.871417 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edbe82e-4ab6-4a5e-8864-8450110d9619 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:11.872315 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edbe82e-4ab6-4a5e-8864-8450110d9619 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:11.872315 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edbe82e-4ab6-4a5e-8864-8450110d9619 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:11.875127 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 641/1272] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:50:11 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:50:11.882004 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6cc4b-449e-4a74-b878-f456a03479ed None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:11.882724 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6cc4b-449e-4a74-b878-f456a03479ed None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:11.882897 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6cc4b-449e-4a74-b878-f456a03479ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:11.901896 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-ace6cc4b-449e-4a74-b878-f456a03479ed None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:50:11.903194 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-ace6cc4b-449e-4a74-b878-f456a03479ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:50:11.965163 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 632/1273] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:50:11 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:50:11.996388 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edbe82e-4ab6-4a5e-8864-8450110d9619 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:50:12.015663 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edbe82e-4ab6-4a5e-8864-8450110d9619 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:50:12.021045 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052249db-bb10-449e-a4a8-a787dc55eafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:50:12.021818 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052249db-bb10-449e-a4a8-a787dc55eafc admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:12.022095 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052249db-bb10-449e-a4a8-a787dc55eafc admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:12.022363 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052249db-bb10-449e-a4a8-a787dc55eafc admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:12.033837 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052249db-bb10-449e-a4a8-a787dc55eafc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 24 04:50:12.040661 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-052249db-bb10-449e-a4a8-a787dc55eafc admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 24 04:50:12.041795 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 642/1274] 10.222.0.43 () {56 vars in 1117 bytes} [Fri Dec 24 04:50:11 2021] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:50:12.051783 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6cc4b-449e-4a74-b878-f456a03479ed None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:50:12.063130 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6cc4b-449e-4a74-b878-f456a03479ed None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:50:12.068919 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be3541-5067-453b-8b69-220d20e58859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:50:12.069569 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be3541-5067-453b-8b69-220d20e58859 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:12.069843 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be3541-5067-453b-8b69-220d20e58859 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:12.070106 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be3541-5067-453b-8b69-220d20e58859 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:12.070871 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57be3541-5067-453b-8b69-220d20e58859 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:50:12.071167 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57be3541-5067-453b-8b69-220d20e58859 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:50:12.072786 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57be3541-5067-453b-8b69-220d20e58859 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:50:12.081883 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 633/1275] 10.222.0.43 () {56 vars in 1120 bytes} [Fri Dec 24 04:50:12 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:50:12.088792 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052249db-bb10-449e-a4a8-a787dc55eafc admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:50:12.105605 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052249db-bb10-449e-a4a8-a787dc55eafc admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:50:12.114755 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ed755-027d-4991-9814-d02b0dcbb544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:50:12.115877 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ed755-027d-4991-9814-d02b0dcbb544 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:12.116254 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ed755-027d-4991-9814-d02b0dcbb544 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:12.116599 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ed755-027d-4991-9814-d02b0dcbb544 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:12.128369 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ed755-027d-4991-9814-d02b0dcbb544 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:50:12.130162 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ed755-027d-4991-9814-d02b0dcbb544 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:50:12.146668 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-cc9ed755-027d-4991-9814-d02b0dcbb544 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:50:12.147773 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 643/1276] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:50:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:50:12.157785 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be3541-5067-453b-8b69-220d20e58859 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:50:12.173760 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be3541-5067-453b-8b69-220d20e58859 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:50:12.182483 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488a6587-dc32-4930-9b2c-e1458a143249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:50:12.183117 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a6587-dc32-4930-9b2c-e1458a143249 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:12.183392 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a6587-dc32-4930-9b2c-e1458a143249 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:12.183658 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a6587-dc32-4930-9b2c-e1458a143249 admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:12.184395 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488a6587-dc32-4930-9b2c-e1458a143249 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:50:12.184728 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488a6587-dc32-4930-9b2c-e1458a143249 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:50:12.186295 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488a6587-dc32-4930-9b2c-e1458a143249 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:50:12.198445 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 634/1277] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:50:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:50:12.204987 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ed755-027d-4991-9814-d02b0dcbb544 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:50:12.218202 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ed755-027d-4991-9814-d02b0dcbb544 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:50:12.222956 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabae65a-aea2-4e46-9dff-0328817d7502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:50:12.223728 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabae65a-aea2-4e46-9dff-0328817d7502 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:12.224013 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabae65a-aea2-4e46-9dff-0328817d7502 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:12.224270 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabae65a-aea2-4e46-9dff-0328817d7502 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:12.232261 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabae65a-aea2-4e46-9dff-0328817d7502 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:50:12.234330 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabae65a-aea2-4e46-9dff-0328817d7502 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:50:12.248566 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-dabae65a-aea2-4e46-9dff-0328817d7502 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 24 04:50:12.249701 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 644/1278] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:50:12 2021] GET /identity/v3/users/placement => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:50:12.259276 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488a6587-dc32-4930-9b2c-e1458a143249 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:50:12.275300 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488a6587-dc32-4930-9b2c-e1458a143249 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:50:12.281783 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01e65c-81d5-418d-815e-49f2b9eae453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:50:12.282433 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01e65c-81d5-418d-815e-49f2b9eae453 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:12.282709 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01e65c-81d5-418d-815e-49f2b9eae453 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:12.282979 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01e65c-81d5-418d-815e-49f2b9eae453 admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:12.283831 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff01e65c-81d5-418d-815e-49f2b9eae453 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:50:12.284134 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff01e65c-81d5-418d-815e-49f2b9eae453 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:50:12.285998 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff01e65c-81d5-418d-815e-49f2b9eae453 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:50:12.309001 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 635/1279] 10.222.0.43 () {56 vars in 1164 bytes} [Fri Dec 24 04:50:12 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:50:12.316106 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabae65a-aea2-4e46-9dff-0328817d7502 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:50:12.326369 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabae65a-aea2-4e46-9dff-0328817d7502 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:50:12.332129 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a7c7e8-06c0-4fdc-bb23-2ac7f984ce71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:50:12.332789 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7c7e8-06c0-4fdc-bb23-2ac7f984ce71 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:12.333060 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7c7e8-06c0-4fdc-bb23-2ac7f984ce71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:12.333308 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7c7e8-06c0-4fdc-bb23-2ac7f984ce71 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:12.341970 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a7c7e8-06c0-4fdc-bb23-2ac7f984ce71 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:50:12.343707 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a7c7e8-06c0-4fdc-bb23-2ac7f984ce71 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:50:12.352860 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 645/1280] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Dec 24 04:50:12 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:50:12.359031 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01e65c-81d5-418d-815e-49f2b9eae453 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:50:12.369694 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01e65c-81d5-418d-815e-49f2b9eae453 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:50:12.375352 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531e9f8-b20a-4180-a76e-37acfa3a30ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:50:12.376123 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531e9f8-b20a-4180-a76e-37acfa3a30ef admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:12.376400 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531e9f8-b20a-4180-a76e-37acfa3a30ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:12.376700 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531e9f8-b20a-4180-a76e-37acfa3a30ef admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:12.388018 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0531e9f8-b20a-4180-a76e-37acfa3a30ef admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:50:12.389817 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0531e9f8-b20a-4180-a76e-37acfa3a30ef admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:50:12.407299 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-0531e9f8-b20a-4180-a76e-37acfa3a30ef admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 24 04:50:12.408416 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 636/1281] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Dec 24 04:50:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:50:12.414421 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a7c7e8-06c0-4fdc-bb23-2ac7f984ce71 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:50:12.423885 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a7c7e8-06c0-4fdc-bb23-2ac7f984ce71 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:50:12.429675 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fac9d2-9e46-4f3f-8f1c-8bdbe547399b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:50:12.430332 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fac9d2-9e46-4f3f-8f1c-8bdbe547399b admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:12.430606 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fac9d2-9e46-4f3f-8f1c-8bdbe547399b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:12.431018 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fac9d2-9e46-4f3f-8f1c-8bdbe547399b admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:12.431745 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fac9d2-9e46-4f3f-8f1c-8bdbe547399b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:50:12.432042 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fac9d2-9e46-4f3f-8f1c-8bdbe547399b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:50:12.433633 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fac9d2-9e46-4f3f-8f1c-8bdbe547399b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:50:12.445992 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 646/1282] 10.222.0.43 () {56 vars in 1130 bytes} [Fri Dec 24 04:50:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:50:12.452070 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531e9f8-b20a-4180-a76e-37acfa3a30ef admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:50:12.462806 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531e9f8-b20a-4180-a76e-37acfa3a30ef admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:50:12.468553 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066689c0-531b-4b8a-8ec0-3958522c6b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:50:12.469314 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066689c0-531b-4b8a-8ec0-3958522c6b71 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:12.469585 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066689c0-531b-4b8a-8ec0-3958522c6b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:12.469844 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066689c0-531b-4b8a-8ec0-3958522c6b71 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:12.477233 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066689c0-531b-4b8a-8ec0-3958522c6b71 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:50:12.479283 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066689c0-531b-4b8a-8ec0-3958522c6b71 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:50:12.492033 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING keystone.server.flask.application [None req-066689c0-531b-4b8a-8ec0-3958522c6b71 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 24 04:50:12.493151 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 637/1283] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Dec 24 04:50:12 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:50:12.499600 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fac9d2-9e46-4f3f-8f1c-8bdbe547399b admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:50:12.513829 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fac9d2-9e46-4f3f-8f1c-8bdbe547399b admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:50:12.520313 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f26ea-5105-4f88-b666-e3b35033f973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:50:12.520983 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f26ea-5105-4f88-b666-e3b35033f973 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:12.521258 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f26ea-5105-4f88-b666-e3b35033f973 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:12.521528 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f26ea-5105-4f88-b666-e3b35033f973 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:12.522314 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431f26ea-5105-4f88-b666-e3b35033f973 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:50:12.522610 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431f26ea-5105-4f88-b666-e3b35033f973 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:50:12.524423 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431f26ea-5105-4f88-b666-e3b35033f973 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:50:12.538186 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 647/1284] 10.222.0.43 () {56 vars in 1169 bytes} [Fri Dec 24 04:50:12 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:50:12.546664 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066689c0-531b-4b8a-8ec0-3958522c6b71 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:50:12.563175 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066689c0-531b-4b8a-8ec0-3958522c6b71 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:50:12.571563 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82afd549-7b3d-4456-a391-e087a9f7c2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:50:12.572219 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82afd549-7b3d-4456-a391-e087a9f7c2e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:12.572489 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82afd549-7b3d-4456-a391-e087a9f7c2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:12.572783 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82afd549-7b3d-4456-a391-e087a9f7c2e7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:12.573623 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82afd549-7b3d-4456-a391-e087a9f7c2e7 admin admin] RBAC: Adding query filter params (role.id=d5e6fc257d8541d5a5ed1988eacd5be7, scope.project.id=c19ba4a2c0224c079c5a8a6a56569fd6, user.id=430d6177e74c4dbda7fb83d04c75617e) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:50:12.573922 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82afd549-7b3d-4456-a391-e087a9f7c2e7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:50:12.575741 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82afd549-7b3d-4456-a391-e087a9f7c2e7 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:50:12.582179 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 638/1285] 10.222.0.43 () {56 vars in 1395 bytes} [Fri Dec 24 04:50:12 2021] GET /identity/v3/role_assignments?user.id=430d6177e74c4dbda7fb83d04c75617e&scope.project.id=c19ba4a2c0224c079c5a8a6a56569fd6&role.id=d5e6fc257d8541d5a5ed1988eacd5be7 => generated 608 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:50:14.981436 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a5423-c605-47c9-8ac1-490c0f9289ee None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:14.982069 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a5423-c605-47c9-8ac1-490c0f9289ee None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:14.982069 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a5423-c605-47c9-8ac1-490c0f9289ee None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:14.984924 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 648/1286] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:50:14 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 24 04:50:14.991836 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc445c71-2373-433c-b900-2f79ef8fa1e0 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:14.992272 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc445c71-2373-433c-b900-2f79ef8fa1e0 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:14.992384 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc445c71-2373-433c-b900-2f79ef8fa1e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:15.016342 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-fc445c71-2373-433c-b900-2f79ef8fa1e0 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:50:15.017566 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-fc445c71-2373-433c-b900-2f79ef8fa1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:50:15.027113 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 639/1287] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:50:14 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:50:15.050899 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a5423-c605-47c9-8ac1-490c0f9289ee None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:50:15.068028 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a5423-c605-47c9-8ac1-490c0f9289ee None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:50:15.074382 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec8e7b4-a8ac-4ba5-817c-e57fe2123640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:50:15.075165 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8e7b4-a8ac-4ba5-817c-e57fe2123640 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:15.075444 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8e7b4-a8ac-4ba5-817c-e57fe2123640 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:15.075720 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8e7b4-a8ac-4ba5-817c-e57fe2123640 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:15.076403 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec8e7b4-a8ac-4ba5-817c-e57fe2123640 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:50:15.078037 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec8e7b4-a8ac-4ba5-817c-e57fe2123640 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:50:15.090712 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-3ec8e7b4-a8ac-4ba5-817c-e57fe2123640 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Dec 24 04:50:15.091932 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 649/1288] 10.222.0.43 () {56 vars in 1138 bytes} [Fri Dec 24 04:50:15 2021] GET /identity/v3/services/placement => generated 90 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:50:15.101575 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc445c71-2373-433c-b900-2f79ef8fa1e0 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:50:15.115763 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc445c71-2373-433c-b900-2f79ef8fa1e0 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:50:15.122131 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f328337e-9f2d-4377-a24e-b6b82ed9ad78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:50:15.122766 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328337e-9f2d-4377-a24e-b6b82ed9ad78 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:15.123048 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328337e-9f2d-4377-a24e-b6b82ed9ad78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:15.123313 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328337e-9f2d-4377-a24e-b6b82ed9ad78 admin admin] PATH_INFO: `/v3/services` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:15.124042 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f328337e-9f2d-4377-a24e-b6b82ed9ad78 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:50:15.124354 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f328337e-9f2d-4377-a24e-b6b82ed9ad78 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:50:15.125981 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f328337e-9f2d-4377-a24e-b6b82ed9ad78 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:50:15.130914 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 640/1289] 10.222.0.43 () {56 vars in 1137 bytes} [Fri Dec 24 04:50:15 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:50:15.137158 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec8e7b4-a8ac-4ba5-817c-e57fe2123640 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:50:15.151877 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec8e7b4-a8ac-4ba5-817c-e57fe2123640 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:50:15.157669 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a8fa10-7a06-40bf-ae42-f38e50c6b9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:50:15.158294 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8fa10-7a06-40bf-ae42-f38e50c6b9f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:15.158569 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8fa10-7a06-40bf-ae42-f38e50c6b9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:15.158834 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8fa10-7a06-40bf-ae42-f38e50c6b9f4 admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:15.159541 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a8fa10-7a06-40bf-ae42-f38e50c6b9f4 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:50:15.159840 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a8fa10-7a06-40bf-ae42-f38e50c6b9f4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:50:15.161432 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a8fa10-7a06-40bf-ae42-f38e50c6b9f4 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:50:15.166160 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 650/1290] 10.222.0.43 () {56 vars in 1137 bytes} [Fri Dec 24 04:50:15 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:50:17.513682 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76182c-4b97-4a08-a2d7-7d20a96e56db None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:17.514277 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76182c-4b97-4a08-a2d7-7d20a96e56db None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:17.514277 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76182c-4b97-4a08-a2d7-7d20a96e56db None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:17.516440 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 641/1291] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:50:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:50:17.525920 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b7b9c-d312-437e-859a-5be666622766 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:17.526330 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b7b9c-d312-437e-859a-5be666622766 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:17.526510 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b7b9c-d312-437e-859a-5be666622766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:17.555000 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-162b7b9c-d312-437e-859a-5be666622766 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:50:17.556583 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-162b7b9c-d312-437e-859a-5be666622766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:50:17.566827 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 651/1292] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:50:17 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:50:17.590654 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb76182c-4b97-4a08-a2d7-7d20a96e56db None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:50:17.605520 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb76182c-4b97-4a08-a2d7-7d20a96e56db None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:50:17.611485 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f234b-8bfa-44ae-8d36-2c81d0ddb380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:50:17.612124 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f234b-8bfa-44ae-8d36-2c81d0ddb380 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:17.612399 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f234b-8bfa-44ae-8d36-2c81d0ddb380 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:17.612691 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f234b-8bfa-44ae-8d36-2c81d0ddb380 admin admin] PATH_INFO: `/v3/services` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:17.613421 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7f234b-8bfa-44ae-8d36-2c81d0ddb380 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:50:17.615019 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7f234b-8bfa-44ae-8d36-2c81d0ddb380 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:50:17.630285 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 642/1293] 10.222.0.43 () {60 vars in 1162 bytes} [Fri Dec 24 04:50:17 2021] POST /identity/v3/services => generated 246 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:50:19.997367 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae487344-441f-43dc-81e3-6b7d58b5397c None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:19.998226 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae487344-441f-43dc-81e3-6b7d58b5397c None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:19.998226 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae487344-441f-43dc-81e3-6b7d58b5397c None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:20.001069 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 652/1294] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:50:19 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:50:20.010060 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94070fd-5fdf-42ba-9559-582b7fec8784 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:20.010459 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94070fd-5fdf-42ba-9559-582b7fec8784 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:20.010600 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94070fd-5fdf-42ba-9559-582b7fec8784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:20.028683 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-e94070fd-5fdf-42ba-9559-582b7fec8784 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:50:20.029873 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-e94070fd-5fdf-42ba-9559-582b7fec8784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:50:20.047414 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 643/1295] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:50:20 2021] POST /identity/v3/auth/tokens => generated 3076 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:50:20.070653 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae487344-441f-43dc-81e3-6b7d58b5397c None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:50:20.082549 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae487344-441f-43dc-81e3-6b7d58b5397c None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:50:20.087668 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c5fd4-9296-4198-bfd9-54402ab1236b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:50:20.088436 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c5fd4-9296-4198-bfd9-54402ab1236b admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:20.088743 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c5fd4-9296-4198-bfd9-54402ab1236b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:20.089014 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c5fd4-9296-4198-bfd9-54402ab1236b admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:20.089661 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25c5fd4-9296-4198-bfd9-54402ab1236b admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:50:20.091239 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25c5fd4-9296-4198-bfd9-54402ab1236b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:50:20.102139 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-c25c5fd4-9296-4198-bfd9-54402ab1236b admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Dec 24 04:50:20.103394 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 653/1296] 10.222.0.43 () {56 vars in 1138 bytes} [Fri Dec 24 04:50:20 2021] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:50:20.110084 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94070fd-5fdf-42ba-9559-582b7fec8784 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:50:20.124820 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94070fd-5fdf-42ba-9559-582b7fec8784 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:50:20.134092 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63576f42-8b44-4bb0-a368-1d8f9a910f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:50:20.134737 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63576f42-8b44-4bb0-a368-1d8f9a910f6c admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:20.135021 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63576f42-8b44-4bb0-a368-1d8f9a910f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:20.135289 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63576f42-8b44-4bb0-a368-1d8f9a910f6c admin admin] PATH_INFO: `/v3/services` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:20.136016 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63576f42-8b44-4bb0-a368-1d8f9a910f6c admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:50:20.136314 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63576f42-8b44-4bb0-a368-1d8f9a910f6c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:50:20.137952 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63576f42-8b44-4bb0-a368-1d8f9a910f6c admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:50:20.143504 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 644/1297] 10.222.0.43 () {56 vars in 1137 bytes} [Fri Dec 24 04:50:20 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:50:20.149390 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c5fd4-9296-4198-bfd9-54402ab1236b admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:50:20.158839 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c5fd4-9296-4198-bfd9-54402ab1236b admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:50:20.163771 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002701a-4ca7-4f22-895b-e78f62bf7b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:50:20.164380 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002701a-4ca7-4f22-895b-e78f62bf7b5a admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:20.164687 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002701a-4ca7-4f22-895b-e78f62bf7b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:20.164948 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002701a-4ca7-4f22-895b-e78f62bf7b5a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:20.166122 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0002701a-4ca7-4f22-895b-e78f62bf7b5a admin admin] RBAC: Adding query filter params (interface=public, service_id=0058f0619a5748868a26842d16f42a52, region_id=RegionOne) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:50:20.166423 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0002701a-4ca7-4f22-895b-e78f62bf7b5a admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:50:20.167971 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0002701a-4ca7-4f22-895b-e78f62bf7b5a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:50:20.172974 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 654/1298] 10.222.0.43 () {56 vars in 1272 bytes} [Fri Dec 24 04:50:20 2021] GET /identity/v3/endpoints?service_id=0058f0619a5748868a26842d16f42a52&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:50:20.178565 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63576f42-8b44-4bb0-a368-1d8f9a910f6c admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:50:20.188505 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63576f42-8b44-4bb0-a368-1d8f9a910f6c admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:50:20.194348 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec46fc-bd75-4517-9b59-f70c3f302a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:50:20.194972 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec46fc-bd75-4517-9b59-f70c3f302a73 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:20.195254 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec46fc-bd75-4517-9b59-f70c3f302a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:20.195522 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec46fc-bd75-4517-9b59-f70c3f302a73 admin admin] PATH_INFO: `/v3/services` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:20.196399 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eec46fc-bd75-4517-9b59-f70c3f302a73 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:50:20.197864 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eec46fc-bd75-4517-9b59-f70c3f302a73 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:50:20.205355 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 645/1299] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Dec 24 04:50:20 2021] GET /identity/v3/services => generated 2191 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 04:50:22.594565 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c7ccf-93a6-49bb-883c-f2b98f68895f None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:22.595418 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c7ccf-93a6-49bb-883c-f2b98f68895f None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:22.595418 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c7ccf-93a6-49bb-883c-f2b98f68895f None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:22.598135 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 655/1300] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:50:22 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:50:22.606909 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5d6b6-56eb-4921-b7ce-905b7a94db12 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:22.607373 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5d6b6-56eb-4921-b7ce-905b7a94db12 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:22.607466 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5d6b6-56eb-4921-b7ce-905b7a94db12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:22.626998 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-46a5d6b6-56eb-4921-b7ce-905b7a94db12 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:50:22.628166 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-46a5d6b6-56eb-4921-b7ce-905b7a94db12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:50:22.636876 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 646/1301] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:50:22 2021] POST /identity/v3/auth/tokens => generated 3076 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 04:50:22.660724 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c7ccf-93a6-49bb-883c-f2b98f68895f None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:50:22.675665 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c7ccf-93a6-49bb-883c-f2b98f68895f None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:50:22.681393 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad55ffd-ba79-4d31-936e-9ca81b9f4562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:50:22.682190 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad55ffd-ba79-4d31-936e-9ca81b9f4562 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:22.682470 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad55ffd-ba79-4d31-936e-9ca81b9f4562 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:22.682740 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad55ffd-ba79-4d31-936e-9ca81b9f4562 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:22.683405 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad55ffd-ba79-4d31-936e-9ca81b9f4562 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:50:22.685019 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad55ffd-ba79-4d31-936e-9ca81b9f4562 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:50:22.695839 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-dad55ffd-ba79-4d31-936e-9ca81b9f4562 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Dec 24 04:50:22.697012 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 656/1302] 10.222.0.43 () {56 vars in 1138 bytes} [Fri Dec 24 04:50:22 2021] GET /identity/v3/services/placement => generated 90 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 24 04:50:22.704090 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5d6b6-56eb-4921-b7ce-905b7a94db12 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:50:22.717381 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5d6b6-56eb-4921-b7ce-905b7a94db12 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:50:22.724074 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1999ad73-7a08-430a-b674-4bf65be90c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:50:22.724757 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999ad73-7a08-430a-b674-4bf65be90c7b admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:22.725039 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999ad73-7a08-430a-b674-4bf65be90c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:22.725304 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999ad73-7a08-430a-b674-4bf65be90c7b admin admin] PATH_INFO: `/v3/services` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:22.726035 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1999ad73-7a08-430a-b674-4bf65be90c7b admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:50:22.726336 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1999ad73-7a08-430a-b674-4bf65be90c7b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:50:22.727948 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1999ad73-7a08-430a-b674-4bf65be90c7b admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:50:22.733601 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 647/1303] 10.222.0.43 () {56 vars in 1137 bytes} [Fri Dec 24 04:50:22 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:50:22.739823 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad55ffd-ba79-4d31-936e-9ca81b9f4562 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:50:22.750628 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad55ffd-ba79-4d31-936e-9ca81b9f4562 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:50:22.756487 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9c8b5-1a70-4993-a1f4-0d59e1f25c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:50:22.757133 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9c8b5-1a70-4993-a1f4-0d59e1f25c31 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:50:22.757406 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9c8b5-1a70-4993-a1f4-0d59e1f25c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:50:22.757674 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9c8b5-1a70-4993-a1f4-0d59e1f25c31 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:50:22.758415 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e9c8b5-1a70-4993-a1f4-0d59e1f25c31 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:50:22.760197 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e9c8b5-1a70-4993-a1f4-0d59e1f25c31 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:50:22.790534 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 657/1304] 10.222.0.43 () {60 vars in 1165 bytes} [Fri Dec 24 04:50:22 2021] POST /identity/v3/endpoints => generated 331 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:51:26.152998 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d2773-c753-408f-8dbf-dbe117e7d28b None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:51:26.154053 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d2773-c753-408f-8dbf-dbe117e7d28b None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:51:26.154625 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d2773-c753-408f-8dbf-dbe117e7d28b None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:51:26.167665 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5b327-7313-4dff-a263-7212bf766b2d None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:51:26.167665 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5b327-7313-4dff-a263-7212bf766b2d None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:51:26.167665 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5b327-7313-4dff-a263-7212bf766b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:51:26.170933 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 648/1305] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:51:26 2021] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:51:26.350054 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-68f5b327-7313-4dff-a263-7212bf766b2d None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:51:26.353759 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-68f5b327-7313-4dff-a263-7212bf766b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:51:26.504906 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 658/1306] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:51:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 04:51:26.522817 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d2773-c753-408f-8dbf-dbe117e7d28b None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:51:26.524743 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-d84d2773-c753-408f-8dbf-dbe117e7d28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:51:26.653913 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d2773-c753-408f-8dbf-dbe117e7d28b None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:51:26.749759 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0d967-a6e7-40f6-a749-115187cc7024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:51:26.750309 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0d967-a6e7-40f6-a749-115187cc7024 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:51:26.750584 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0d967-a6e7-40f6-a749-115187cc7024 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:51:26.750850 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0d967-a6e7-40f6-a749-115187cc7024 admin admin] PATH_INFO: `/v3/projects` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:51:26.751589 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e0d967-a6e7-40f6-a749-115187cc7024 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:51:26.753543 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e0d967-a6e7-40f6-a749-115187cc7024 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:51:26.772583 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 649/1307] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Dec 24 04:51:26 2021] GET /identity/v3/projects => generated 2553 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 24 04:51:29.162075 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935379c-dd1b-40af-b5a2-cf68872cb279 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:51:29.162598 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935379c-dd1b-40af-b5a2-cf68872cb279 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:51:29.162598 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935379c-dd1b-40af-b5a2-cf68872cb279 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:51:29.164355 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 659/1308] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:51:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:51:29.170269 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea322a-9550-4e43-a273-b47f74124c25 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:51:29.170705 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea322a-9550-4e43-a273-b47f74124c25 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:51:29.170814 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea322a-9550-4e43-a273-b47f74124c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:51:29.241984 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-daea322a-9550-4e43-a273-b47f74124c25 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:51:29.243191 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-daea322a-9550-4e43-a273-b47f74124c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:51:29.345173 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 650/1309] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:51:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:51:29.369298 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5935379c-dd1b-40af-b5a2-cf68872cb279 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:51:29.370924 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-5935379c-dd1b-40af-b5a2-cf68872cb279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:51:29.496576 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5935379c-dd1b-40af-b5a2-cf68872cb279 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:51:29.590200 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444b4a97-26bc-4262-9f3f-687a19c936c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:51:29.590425 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b4a97-26bc-4262-9f3f-687a19c936c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:51:29.590728 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b4a97-26bc-4262-9f3f-687a19c936c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:51:29.591001 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b4a97-26bc-4262-9f3f-687a19c936c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:51:29.591747 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444b4a97-26bc-4262-9f3f-687a19c936c1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:51:29.593729 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444b4a97-26bc-4262-9f3f-687a19c936c1 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:51:29.612276 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 660/1310] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Dec 24 04:51:29 2021] GET /identity/v3/projects => generated 2553 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 04:51:32.002863 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15334dc5-0bb6-41ff-a686-61fa1682af9b None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:51:32.003454 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15334dc5-0bb6-41ff-a686-61fa1682af9b None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:51:32.003454 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15334dc5-0bb6-41ff-a686-61fa1682af9b None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:51:32.005548 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 651/1311] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:51:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:51:32.011712 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb70b7-8852-4211-8252-5bda56b7ff36 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:51:32.012155 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb70b7-8852-4211-8252-5bda56b7ff36 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:51:32.012247 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb70b7-8852-4211-8252-5bda56b7ff36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:51:32.078209 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-afdb70b7-8852-4211-8252-5bda56b7ff36 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:51:32.079416 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-afdb70b7-8852-4211-8252-5bda56b7ff36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:51:32.184004 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 661/1312] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:51:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:51:32.238640 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd08e5-189b-45c1-a85c-0bf42cf2b429 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:51:32.238928 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd08e5-189b-45c1-a85c-0bf42cf2b429 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:51:32.239240 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd08e5-189b-45c1-a85c-0bf42cf2b429 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:51:32.241078 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 652/1313] 10.222.0.43 () {54 vars in 964 bytes} [Fri Dec 24 04:51:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:51:32.247595 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff284b5-2bbc-4388-aef4-dc486e908036 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:51:32.247892 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff284b5-2bbc-4388-aef4-dc486e908036 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:51:32.248170 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff284b5-2bbc-4388-aef4-dc486e908036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:51:32.326188 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-3ff284b5-2bbc-4388-aef4-dc486e908036 None None] MFA Rules not processed for user `b36f253fbce04e9ea028f02ff57fb272`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:51:32.327433 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-3ff284b5-2bbc-4388-aef4-dc486e908036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:51:32.408015 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 662/1314] 10.222.0.43 () {58 vars in 1061 bytes} [Fri Dec 24 04:51:32 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:51:32.417508 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd08e5-189b-45c1-a85c-0bf42cf2b429 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:51:32.419031 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-5afd08e5-189b-45c1-a85c-0bf42cf2b429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:51:32.521464 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd08e5-189b-45c1-a85c-0bf42cf2b429 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:51:32.596499 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ffe0e1-fec0-44cc-baf1-56ab7071b612 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:51:32.597180 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ffe0e1-fec0-44cc-baf1-56ab7071b612 service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:51:32.597457 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ffe0e1-fec0-44cc-baf1-56ab7071b612 service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:51:32.597721 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ffe0e1-fec0-44cc-baf1-56ab7071b612 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:51:32.599392 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-22ffe0e1-fec0-44cc-baf1-56ab7071b612 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:51:32.712156 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ffe0e1-fec0-44cc-baf1-56ab7071b612 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:51:32.713639 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ffe0e1-fec0-44cc-baf1-56ab7071b612 service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:51:32.732664 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 653/1315] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:51:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:51:35.485571 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729175e-9b4a-4a49-8d41-43df4e1e2c97 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:51:35.486160 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729175e-9b4a-4a49-8d41-43df4e1e2c97 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:51:35.486478 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729175e-9b4a-4a49-8d41-43df4e1e2c97 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:51:35.489568 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 663/1316] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:51:35 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:51:35.498542 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06034cef-161a-4453-95e4-e2826c889473 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:51:35.499362 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06034cef-161a-4453-95e4-e2826c889473 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:51:35.499552 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06034cef-161a-4453-95e4-e2826c889473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:51:35.597425 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-06034cef-161a-4453-95e4-e2826c889473 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:51:35.598672 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-06034cef-161a-4453-95e4-e2826c889473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:51:35.735007 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 654/1317] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:51:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:51:35.771458 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e729175e-9b4a-4a49-8d41-43df4e1e2c97 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:51:35.773089 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-e729175e-9b4a-4a49-8d41-43df4e1e2c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:51:35.932849 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e729175e-9b4a-4a49-8d41-43df4e1e2c97 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:51:36.036034 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b070ee-df30-4979-b1c5-a426d66ae0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:51:36.036999 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b070ee-df30-4979-b1c5-a426d66ae0f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:51:36.037288 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b070ee-df30-4979-b1c5-a426d66ae0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:51:36.037530 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b070ee-df30-4979-b1c5-a426d66ae0f5 admin admin] PATH_INFO: `/v3/projects/49af853a7d674e84987f8788493d4239` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:51:36.038617 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b070ee-df30-4979-b1c5-a426d66ae0f5 admin admin] RBAC: Authorizing `identity:get_project(project_id=49af853a7d674e84987f8788493d4239)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:51:36.040568 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b070ee-df30-4979-b1c5-a426d66ae0f5 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:51:36.042243 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 664/1318] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:51:35 2021] GET /identity/v3/projects/49af853a7d674e84987f8788493d4239 => generated 344 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:51:36.057230 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06034cef-161a-4453-95e4-e2826c889473 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:51:36.058454 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-06034cef-161a-4453-95e4-e2826c889473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:51:36.167985 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06034cef-161a-4453-95e4-e2826c889473 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:51:36.246790 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9914f-af8b-4466-b59f-e20b2c9dee14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:51:36.247338 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9914f-af8b-4466-b59f-e20b2c9dee14 service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:51:36.247615 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9914f-af8b-4466-b59f-e20b2c9dee14 service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:51:36.247885 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9914f-af8b-4466-b59f-e20b2c9dee14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:51:36.249550 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-f2e9914f-af8b-4466-b59f-e20b2c9dee14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:51:36.371226 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e9914f-af8b-4466-b59f-e20b2c9dee14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:51:36.372730 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e9914f-af8b-4466-b59f-e20b2c9dee14 service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:51:36.392273 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 655/1319] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:51:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 24 04:51:39.077288 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b730df2e-b739-489e-9d7b-03bc959f1583 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:51:39.078144 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b730df2e-b739-489e-9d7b-03bc959f1583 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:51:39.078560 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b730df2e-b739-489e-9d7b-03bc959f1583 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:51:39.081558 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 665/1320] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:51:39 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:51:39.089065 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6055e30-c89a-44c7-94eb-03f624c27bf5 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:51:39.089507 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6055e30-c89a-44c7-94eb-03f624c27bf5 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:51:39.089629 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6055e30-c89a-44c7-94eb-03f624c27bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:51:39.164484 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-f6055e30-c89a-44c7-94eb-03f624c27bf5 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:51:39.165748 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-f6055e30-c89a-44c7-94eb-03f624c27bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:51:39.271835 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 656/1321] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:51:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:51:39.314433 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b730df2e-b739-489e-9d7b-03bc959f1583 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:51:39.315953 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-b730df2e-b739-489e-9d7b-03bc959f1583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:51:39.458943 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b730df2e-b739-489e-9d7b-03bc959f1583 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:51:39.571941 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6841f632-1c3f-469f-b2b3-f704e3a58f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:51:39.572866 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841f632-1c3f-469f-b2b3-f704e3a58f2b admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:51:39.573143 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841f632-1c3f-469f-b2b3-f704e3a58f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:51:39.573415 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841f632-1c3f-469f-b2b3-f704e3a58f2b admin admin] PATH_INFO: `/v3/projects/036a37ec848b4c9bb369e71b5c2453c7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:51:39.583820 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6841f632-1c3f-469f-b2b3-f704e3a58f2b admin admin] RBAC: Authorizing `identity:get_project(project_id=036a37ec848b4c9bb369e71b5c2453c7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:51:39.586319 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6841f632-1c3f-469f-b2b3-f704e3a58f2b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:51:39.588006 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 666/1322] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:51:39 2021] GET /identity/v3/projects/036a37ec848b4c9bb369e71b5c2453c7 => generated 298 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 04:51:39.603163 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6055e30-c89a-44c7-94eb-03f624c27bf5 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:51:39.604385 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-f6055e30-c89a-44c7-94eb-03f624c27bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:51:39.697776 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6055e30-c89a-44c7-94eb-03f624c27bf5 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:51:39.771545 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914f4a8d-094c-4342-a069-3d43435e2e36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:51:39.772118 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f4a8d-094c-4342-a069-3d43435e2e36 service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:51:39.772397 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f4a8d-094c-4342-a069-3d43435e2e36 service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:51:39.772929 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f4a8d-094c-4342-a069-3d43435e2e36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:51:39.774619 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-914f4a8d-094c-4342-a069-3d43435e2e36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:51:39.894931 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914f4a8d-094c-4342-a069-3d43435e2e36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:51:39.897407 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914f4a8d-094c-4342-a069-3d43435e2e36 service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:51:39.916594 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 657/1323] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:51:39 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:51:42.815819 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ba2de-bdc4-4fb9-8e11-8ae2922d885b None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:51:42.816501 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ba2de-bdc4-4fb9-8e11-8ae2922d885b None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:51:42.816501 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ba2de-bdc4-4fb9-8e11-8ae2922d885b None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:51:42.819130 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 667/1324] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:51:42 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:51:42.825351 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f88db9-8c15-4775-886c-264433fdef85 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:51:42.825781 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f88db9-8c15-4775-886c-264433fdef85 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:51:42.825904 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f88db9-8c15-4775-886c-264433fdef85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:51:42.889554 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-34f88db9-8c15-4775-886c-264433fdef85 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:51:42.890741 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-34f88db9-8c15-4775-886c-264433fdef85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:51:43.004300 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 658/1325] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:51:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:51:43.038803 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ba2de-bdc4-4fb9-8e11-8ae2922d885b None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:51:43.040322 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-0c7ba2de-bdc4-4fb9-8e11-8ae2922d885b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:51:43.176818 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ba2de-bdc4-4fb9-8e11-8ae2922d885b None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:51:43.271369 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f0bd3-b9c2-4218-a02d-710bf1489c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:51:43.272608 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f0bd3-b9c2-4218-a02d-710bf1489c51 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:51:43.272993 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f0bd3-b9c2-4218-a02d-710bf1489c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:51:43.273482 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f0bd3-b9c2-4218-a02d-710bf1489c51 admin admin] PATH_INFO: `/v3/projects/036a37ec848b4c9bb369e71b5c2453c7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:51:43.290475 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f0bd3-b9c2-4218-a02d-710bf1489c51 admin admin] RBAC: Authorizing `identity:get_project(project_id=036a37ec848b4c9bb369e71b5c2453c7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:51:43.293897 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f0bd3-b9c2-4218-a02d-710bf1489c51 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:51:43.296453 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 668/1326] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:51:43 2021] GET /identity/v3/projects/036a37ec848b4c9bb369e71b5c2453c7 => generated 298 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:51:43.312204 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f88db9-8c15-4775-886c-264433fdef85 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:51:43.313467 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-34f88db9-8c15-4775-886c-264433fdef85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:51:43.406144 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f88db9-8c15-4775-886c-264433fdef85 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:51:43.494989 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74bd7e9-6e9c-4638-a131-9911b57f78de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:51:43.495542 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bd7e9-6e9c-4638-a131-9911b57f78de service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:51:43.495820 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bd7e9-6e9c-4638-a131-9911b57f78de service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:51:43.496086 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bd7e9-6e9c-4638-a131-9911b57f78de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:51:43.497778 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-d74bd7e9-6e9c-4638-a131-9911b57f78de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:51:43.616664 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74bd7e9-6e9c-4638-a131-9911b57f78de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:51:43.618114 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74bd7e9-6e9c-4638-a131-9911b57f78de service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:51:43.635312 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 659/1327] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:51:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:51:46.618968 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f24167d-618b-4c0b-b106-10fe4ecb7771 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:51:46.619501 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f24167d-618b-4c0b-b106-10fe4ecb7771 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:51:46.619501 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f24167d-618b-4c0b-b106-10fe4ecb7771 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:51:46.621358 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 669/1328] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:51:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:51:46.627791 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4c14b-fe89-47ca-b3b0-6e8bd34c381d None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:51:46.628328 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4c14b-fe89-47ca-b3b0-6e8bd34c381d None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:51:46.628328 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4c14b-fe89-47ca-b3b0-6e8bd34c381d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:51:46.694563 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-48a4c14b-fe89-47ca-b3b0-6e8bd34c381d None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:51:46.695904 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-48a4c14b-fe89-47ca-b3b0-6e8bd34c381d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:51:46.790189 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 660/1329] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:51:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 04:51:46.839670 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8cc17-06ee-4408-b459-72d450811838 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:51:46.839928 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8cc17-06ee-4408-b459-72d450811838 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:51:46.840273 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8cc17-06ee-4408-b459-72d450811838 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:51:46.842175 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 670/1330] 10.222.0.43 () {54 vars in 964 bytes} [Fri Dec 24 04:51:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:51:46.848371 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3c47b-df37-45f6-83ef-ebe75381599b None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:51:46.848700 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3c47b-df37-45f6-83ef-ebe75381599b None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:51:46.848977 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3c47b-df37-45f6-83ef-ebe75381599b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:51:46.928159 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-ebd3c47b-df37-45f6-83ef-ebe75381599b None None] MFA Rules not processed for user `b36f253fbce04e9ea028f02ff57fb272`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:51:46.930017 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-ebd3c47b-df37-45f6-83ef-ebe75381599b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:51:47.005891 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 661/1331] 10.222.0.43 () {58 vars in 1061 bytes} [Fri Dec 24 04:51:46 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:51:47.015707 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8cc17-06ee-4408-b459-72d450811838 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:51:47.017283 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-89d8cc17-06ee-4408-b459-72d450811838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:51:47.123428 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8cc17-06ee-4408-b459-72d450811838 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:51:47.196776 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64714d0f-1008-4ba2-9f54-4b6b535dcc0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:51:47.197435 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64714d0f-1008-4ba2-9f54-4b6b535dcc0d service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:51:47.197716 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64714d0f-1008-4ba2-9f54-4b6b535dcc0d service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:51:47.197991 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64714d0f-1008-4ba2-9f54-4b6b535dcc0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:51:47.199652 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-64714d0f-1008-4ba2-9f54-4b6b535dcc0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:51:47.324952 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64714d0f-1008-4ba2-9f54-4b6b535dcc0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:51:47.326406 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64714d0f-1008-4ba2-9f54-4b6b535dcc0d service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:51:47.344865 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 671/1332] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:51:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:51:50.029881 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837bbb1d-93f8-4191-92d8-7b27da1ee142 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:51:50.030430 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837bbb1d-93f8-4191-92d8-7b27da1ee142 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:51:50.030430 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837bbb1d-93f8-4191-92d8-7b27da1ee142 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:51:50.032203 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 662/1333] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:51:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:51:50.038008 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d3ae0-21fd-4063-8bb5-fe4e576087af None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:51:50.038566 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d3ae0-21fd-4063-8bb5-fe4e576087af None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:51:50.039248 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d3ae0-21fd-4063-8bb5-fe4e576087af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:51:50.105305 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-919d3ae0-21fd-4063-8bb5-fe4e576087af None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:51:50.106545 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-919d3ae0-21fd-4063-8bb5-fe4e576087af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:51:50.203447 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 672/1334] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:51:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:51:50.248358 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837bbb1d-93f8-4191-92d8-7b27da1ee142 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:51:50.249945 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-837bbb1d-93f8-4191-92d8-7b27da1ee142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:51:50.355466 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837bbb1d-93f8-4191-92d8-7b27da1ee142 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:51:50.427312 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa0fa15-31bd-4343-a833-90062a3efc7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:51:50.427964 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0fa15-31bd-4343-a833-90062a3efc7f service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:51:50.428219 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0fa15-31bd-4343-a833-90062a3efc7f service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:51:50.428511 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0fa15-31bd-4343-a833-90062a3efc7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:51:50.430487 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-8fa0fa15-31bd-4343-a833-90062a3efc7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:51:50.536402 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa0fa15-31bd-4343-a833-90062a3efc7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:51:50.537797 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa0fa15-31bd-4343-a833-90062a3efc7f service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:51:50.555925 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 663/1335] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:51:50 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:51:52.948732 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf3d75-922b-4a96-a406-538b9ed8672d None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:51:52.949256 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf3d75-922b-4a96-a406-538b9ed8672d None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:51:52.949256 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf3d75-922b-4a96-a406-538b9ed8672d None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:51:52.950998 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 673/1336] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:51:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:51:52.956852 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a06c6-938c-4124-a2d4-529104851abe None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:51:52.957293 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a06c6-938c-4124-a2d4-529104851abe None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:51:52.957389 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a06c6-938c-4124-a2d4-529104851abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:51:53.024567 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-7f4a06c6-938c-4124-a2d4-529104851abe None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:51:53.025811 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-7f4a06c6-938c-4124-a2d4-529104851abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:51:53.134550 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 664/1337] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:51:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:51:53.167132 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf3d75-922b-4a96-a406-538b9ed8672d None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:51:53.168703 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-cddf3d75-922b-4a96-a406-538b9ed8672d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:51:53.295133 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf3d75-922b-4a96-a406-538b9ed8672d None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:51:53.404082 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc6267-a990-49b5-aece-4129996ef73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:51:53.404999 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc6267-a990-49b5-aece-4129996ef73c admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:51:53.405284 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc6267-a990-49b5-aece-4129996ef73c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:51:53.405557 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc6267-a990-49b5-aece-4129996ef73c admin admin] PATH_INFO: `/v3/projects/036a37ec848b4c9bb369e71b5c2453c7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:51:53.416352 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc6267-a990-49b5-aece-4129996ef73c admin admin] RBAC: Authorizing `identity:get_project(project_id=036a37ec848b4c9bb369e71b5c2453c7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:51:53.418609 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc6267-a990-49b5-aece-4129996ef73c admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:51:53.420791 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 674/1338] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:51:53 2021] GET /identity/v3/projects/036a37ec848b4c9bb369e71b5c2453c7 => generated 298 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:51:53.433392 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a06c6-938c-4124-a2d4-529104851abe None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:51:53.434629 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-7f4a06c6-938c-4124-a2d4-529104851abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:51:53.526966 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a06c6-938c-4124-a2d4-529104851abe None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:51:53.609363 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e613f9-8cd1-4896-9ce7-7584a415dee3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:51:53.610016 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e613f9-8cd1-4896-9ce7-7584a415dee3 service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:51:53.610294 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e613f9-8cd1-4896-9ce7-7584a415dee3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:51:53.611253 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e613f9-8cd1-4896-9ce7-7584a415dee3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:51:53.613104 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-d3e613f9-8cd1-4896-9ce7-7584a415dee3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:51:53.733845 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e613f9-8cd1-4896-9ce7-7584a415dee3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:51:53.735339 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e613f9-8cd1-4896-9ce7-7584a415dee3 service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:51:53.755771 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 665/1339] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:51:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:51:56.535109 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b787a-2404-46bd-9263-5a64da3b7849 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:51:56.535532 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b787a-2404-46bd-9263-5a64da3b7849 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:51:56.535640 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b787a-2404-46bd-9263-5a64da3b7849 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:51:56.538531 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 675/1340] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:51:56 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:51:56.544462 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcba3bf-fea0-4867-9df5-952a55bfe002 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:51:56.544880 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcba3bf-fea0-4867-9df5-952a55bfe002 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:51:56.545152 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcba3bf-fea0-4867-9df5-952a55bfe002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:51:56.615644 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-bbcba3bf-fea0-4867-9df5-952a55bfe002 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:51:56.616941 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-bbcba3bf-fea0-4867-9df5-952a55bfe002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:51:56.734905 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 666/1341] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:51:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:51:56.774459 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b787a-2404-46bd-9263-5a64da3b7849 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:51:56.776893 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-2c2b787a-2404-46bd-9263-5a64da3b7849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:51:56.891099 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b787a-2404-46bd-9263-5a64da3b7849 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:51:56.895334 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e93776-41c0-4848-aeee-5baf023e28ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:51:56.895979 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e93776-41c0-4848-aeee-5baf023e28ad service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:51:56.896260 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e93776-41c0-4848-aeee-5baf023e28ad service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:51:56.896542 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e93776-41c0-4848-aeee-5baf023e28ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:51:56.906430 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e93776-41c0-4848-aeee-5baf023e28ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:51:56.907862 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e93776-41c0-4848-aeee-5baf023e28ad service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:51:56.917648 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 676/1342] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:51:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:51:59.310293 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a7c6f-7e70-4a10-aced-b02cc091f383 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:51:59.310956 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a7c6f-7e70-4a10-aced-b02cc091f383 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:51:59.311474 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a7c6f-7e70-4a10-aced-b02cc091f383 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:51:59.313315 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 667/1343] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:51:59 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:51:59.322196 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0459e06-feaf-43f8-9821-f1b3c5c40773 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:51:59.322666 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0459e06-feaf-43f8-9821-f1b3c5c40773 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:51:59.322759 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0459e06-feaf-43f8-9821-f1b3c5c40773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:51:59.341767 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-e0459e06-feaf-43f8-9821-f1b3c5c40773 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:51:59.342966 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-e0459e06-feaf-43f8-9821-f1b3c5c40773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:51:59.351595 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 677/1344] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:51:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 04:51:59.392403 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a7c6f-7e70-4a10-aced-b02cc091f383 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:51:59.412413 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a7c6f-7e70-4a10-aced-b02cc091f383 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:51:59.422644 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50e9e7-facb-4c50-af38-dfcf5c79a008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:51:59.423977 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50e9e7-facb-4c50-af38-dfcf5c79a008 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:51:59.424425 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50e9e7-facb-4c50-af38-dfcf5c79a008 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:51:59.424917 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50e9e7-facb-4c50-af38-dfcf5c79a008 admin admin] PATH_INFO: `/v3/projects/49af853a7d674e84987f8788493d4239` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:51:59.427058 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed50e9e7-facb-4c50-af38-dfcf5c79a008 admin admin] RBAC: Authorizing `identity:get_project(project_id=49af853a7d674e84987f8788493d4239)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:51:59.430176 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed50e9e7-facb-4c50-af38-dfcf5c79a008 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:51:59.431846 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 668/1345] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:51:59 2021] GET /identity/v3/projects/49af853a7d674e84987f8788493d4239 => generated 344 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:51:59.447097 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0459e06-feaf-43f8-9821-f1b3c5c40773 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:51:59.462340 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0459e06-feaf-43f8-9821-f1b3c5c40773 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:51:59.467262 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa8c884-95ce-499f-9111-33271603f651 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:51:59.467899 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8c884-95ce-499f-9111-33271603f651 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:51:59.468171 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8c884-95ce-499f-9111-33271603f651 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:51:59.468439 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8c884-95ce-499f-9111-33271603f651 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:51:59.480670 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa8c884-95ce-499f-9111-33271603f651 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:51:59.482104 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa8c884-95ce-499f-9111-33271603f651 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:51:59.492182 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 678/1346] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:51:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:52:02.149695 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8aa46-536d-408a-8271-e3fe2548a7d2 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:02.150289 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8aa46-536d-408a-8271-e3fe2548a7d2 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:02.150289 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8aa46-536d-408a-8271-e3fe2548a7d2 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:02.152017 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 669/1347] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:52:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:52:02.158863 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c48a7a-0005-4e48-abe8-3c23ff045ec7 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:02.159650 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c48a7a-0005-4e48-abe8-3c23ff045ec7 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:02.159782 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c48a7a-0005-4e48-abe8-3c23ff045ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:02.181410 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-65c48a7a-0005-4e48-abe8-3c23ff045ec7 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:52:02.182597 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-65c48a7a-0005-4e48-abe8-3c23ff045ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:52:02.191707 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 679/1348] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:52:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:52:02.228572 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea8aa46-536d-408a-8271-e3fe2548a7d2 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:52:02.240772 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea8aa46-536d-408a-8271-e3fe2548a7d2 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:52:02.245076 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a7f3e-50d0-45e8-aebc-bd24493d4f14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:52:02.245696 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a7f3e-50d0-45e8-aebc-bd24493d4f14 service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:02.245974 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a7f3e-50d0-45e8-aebc-bd24493d4f14 service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:02.246240 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a7f3e-50d0-45e8-aebc-bd24493d4f14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:02.255750 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29a7f3e-50d0-45e8-aebc-bd24493d4f14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:52:02.257337 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29a7f3e-50d0-45e8-aebc-bd24493d4f14 service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:52:02.266605 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 670/1349] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:52:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:52:06.585344 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9f579-0913-4ef6-b584-e6298645b1f4 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:06.585942 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9f579-0913-4ef6-b584-e6298645b1f4 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:06.585942 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9f579-0913-4ef6-b584-e6298645b1f4 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:06.587732 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 680/1350] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:52:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:52:06.594099 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9d670-7424-4045-bbbc-2f3815246d22 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:06.594543 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9d670-7424-4045-bbbc-2f3815246d22 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:06.594736 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9d670-7424-4045-bbbc-2f3815246d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:06.613077 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-89b9d670-7424-4045-bbbc-2f3815246d22 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:52:06.614260 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-89b9d670-7424-4045-bbbc-2f3815246d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:52:06.622692 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 671/1351] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:52:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:52:06.646431 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc9f579-0913-4ef6-b584-e6298645b1f4 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:52:06.660148 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc9f579-0913-4ef6-b584-e6298645b1f4 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:52:06.664820 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d2f2a8-b977-49f1-bf27-c82f3ee81778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:52:06.665474 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2f2a8-b977-49f1-bf27-c82f3ee81778 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:06.665749 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2f2a8-b977-49f1-bf27-c82f3ee81778 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:06.666019 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2f2a8-b977-49f1-bf27-c82f3ee81778 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:06.666762 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d2f2a8-b977-49f1-bf27-c82f3ee81778 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:52:06.668647 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d2f2a8-b977-49f1-bf27-c82f3ee81778 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:52:06.682703 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 681/1352] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Dec 24 04:52:06 2021] GET /identity/v3/projects => generated 2553 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 04:52:09.045878 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6dc67e-7608-42e3-b29d-086f86012655 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:09.046408 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6dc67e-7608-42e3-b29d-086f86012655 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:09.046408 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6dc67e-7608-42e3-b29d-086f86012655 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:09.048112 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 672/1353] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:52:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:52:09.053993 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3b7da-f797-40fe-a18e-f41b2f2126d1 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:09.054497 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3b7da-f797-40fe-a18e-f41b2f2126d1 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:09.054603 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3b7da-f797-40fe-a18e-f41b2f2126d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:09.072683 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-aed3b7da-f797-40fe-a18e-f41b2f2126d1 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:52:09.073876 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-aed3b7da-f797-40fe-a18e-f41b2f2126d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:52:09.082273 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 682/1354] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:52:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:52:09.116792 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6dc67e-7608-42e3-b29d-086f86012655 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:52:09.131072 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6dc67e-7608-42e3-b29d-086f86012655 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:52:09.136312 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7965c6fa-64f6-4aec-b4b4-aa66810813bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:52:09.137202 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965c6fa-64f6-4aec-b4b4-aa66810813bf admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:09.137488 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965c6fa-64f6-4aec-b4b4-aa66810813bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:09.137764 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965c6fa-64f6-4aec-b4b4-aa66810813bf admin admin] PATH_INFO: `/v3/projects/49af853a7d674e84987f8788493d4239` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:09.139033 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7965c6fa-64f6-4aec-b4b4-aa66810813bf admin admin] RBAC: Authorizing `identity:get_project(project_id=49af853a7d674e84987f8788493d4239)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:52:09.140868 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7965c6fa-64f6-4aec-b4b4-aa66810813bf admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:52:09.142560 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 673/1355] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:52:09 2021] GET /identity/v3/projects/49af853a7d674e84987f8788493d4239 => generated 344 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:52:09.158254 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3b7da-f797-40fe-a18e-f41b2f2126d1 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:52:09.168221 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3b7da-f797-40fe-a18e-f41b2f2126d1 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:52:09.172836 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be2450-d20f-4a63-ae7c-9687b2453165 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:52:09.173481 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be2450-d20f-4a63-ae7c-9687b2453165 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:09.173761 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be2450-d20f-4a63-ae7c-9687b2453165 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:09.174031 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be2450-d20f-4a63-ae7c-9687b2453165 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:09.183961 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54be2450-d20f-4a63-ae7c-9687b2453165 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:52:09.185430 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54be2450-d20f-4a63-ae7c-9687b2453165 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:52:09.195452 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 683/1356] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:52:09 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 24 04:52:12.220063 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfd27a-6e0a-467d-b9f0-6992bc4af301 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:12.221031 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfd27a-6e0a-467d-b9f0-6992bc4af301 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:12.221031 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfd27a-6e0a-467d-b9f0-6992bc4af301 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:12.223849 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 674/1357] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:52:12 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:52:12.230735 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6275074-4619-49bf-941d-7b38ca413980 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:12.231205 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6275074-4619-49bf-941d-7b38ca413980 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:12.231540 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6275074-4619-49bf-941d-7b38ca413980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:12.254001 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-a6275074-4619-49bf-941d-7b38ca413980 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:52:12.255207 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-a6275074-4619-49bf-941d-7b38ca413980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:52:12.264227 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 684/1358] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:52:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:52:12.302068 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bfd27a-6e0a-467d-b9f0-6992bc4af301 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:52:12.317184 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bfd27a-6e0a-467d-b9f0-6992bc4af301 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:52:12.321970 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c835e1-8b49-4558-8b16-65842d02db7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:52:12.322628 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c835e1-8b49-4558-8b16-65842d02db7c service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:12.322910 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c835e1-8b49-4558-8b16-65842d02db7c service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:12.323179 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c835e1-8b49-4558-8b16-65842d02db7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:12.333681 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c835e1-8b49-4558-8b16-65842d02db7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:52:12.335831 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c835e1-8b49-4558-8b16-65842d02db7c service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:52:12.347819 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 675/1359] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:52:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:52:16.733819 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf12033-fa7d-45d4-96e0-761d9fccbfac None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:16.734702 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf12033-fa7d-45d4-96e0-761d9fccbfac None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:16.734702 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf12033-fa7d-45d4-96e0-761d9fccbfac None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:16.737607 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 685/1360] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:52:16 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:52:16.745192 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defead73-4bfe-4b9a-8dba-9ab2c9e2b12d None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:16.745648 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defead73-4bfe-4b9a-8dba-9ab2c9e2b12d None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:16.745742 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defead73-4bfe-4b9a-8dba-9ab2c9e2b12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:16.764680 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-defead73-4bfe-4b9a-8dba-9ab2c9e2b12d None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:52:16.765903 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-defead73-4bfe-4b9a-8dba-9ab2c9e2b12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:52:16.775793 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 676/1361] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:52:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:52:16.814648 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf12033-fa7d-45d4-96e0-761d9fccbfac None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:52:16.831991 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf12033-fa7d-45d4-96e0-761d9fccbfac None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:52:16.837449 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c98930-4088-4fdf-afca-5c2e07423d8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:52:16.838087 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c98930-4088-4fdf-afca-5c2e07423d8f service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:16.838369 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c98930-4088-4fdf-afca-5c2e07423d8f service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:16.838646 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c98930-4088-4fdf-afca-5c2e07423d8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:16.848637 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c98930-4088-4fdf-afca-5c2e07423d8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:52:16.850067 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c98930-4088-4fdf-afca-5c2e07423d8f service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:52:16.859985 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 686/1362] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:52:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:52:21.697570 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ef2ab-8e82-4ddd-869f-62b5bf122167 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:21.698047 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ef2ab-8e82-4ddd-869f-62b5bf122167 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:21.698165 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ef2ab-8e82-4ddd-869f-62b5bf122167 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:21.700410 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 677/1363] 10.222.0.43 () {54 vars in 921 bytes} [Fri Dec 24 04:52:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:52:21.708424 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678f8e5-fafd-46c6-87ad-f81d40f99178 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:21.709582 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678f8e5-fafd-46c6-87ad-f81d40f99178 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:21.710064 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678f8e5-fafd-46c6-87ad-f81d40f99178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:21.815138 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-a678f8e5-fafd-46c6-87ad-f81d40f99178 None None] MFA Rules not processed for user `430d6177e74c4dbda7fb83d04c75617e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:52:21.816649 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-a678f8e5-fafd-46c6-87ad-f81d40f99178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:52:21.906266 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 687/1364] 10.222.0.43 () {58 vars in 1018 bytes} [Fri Dec 24 04:52:21 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:52:25.969032 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d1edbd-2a6a-45d5-aa7d-7875aa69edd9 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:25.969541 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d1edbd-2a6a-45d5-aa7d-7875aa69edd9 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:25.969771 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d1edbd-2a6a-45d5-aa7d-7875aa69edd9 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:25.971977 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 678/1365] 10.222.0.43 () {54 vars in 921 bytes} [Fri Dec 24 04:52:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:52:25.977901 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f6780-c918-4dec-88ce-584d0c7298bc None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:25.978337 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f6780-c918-4dec-88ce-584d0c7298bc None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:25.978643 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f6780-c918-4dec-88ce-584d0c7298bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:25.997546 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-216f6780-c918-4dec-88ce-584d0c7298bc None None] MFA Rules not processed for user `430d6177e74c4dbda7fb83d04c75617e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:52:25.998835 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-216f6780-c918-4dec-88ce-584d0c7298bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:52:26.008413 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 688/1366] 10.222.0.43 () {58 vars in 1018 bytes} [Fri Dec 24 04:52:25 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:52:27.602765 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37cdd9-95a7-482c-bbaf-74844927fc4f None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:27.603284 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37cdd9-95a7-482c-bbaf-74844927fc4f None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:27.603284 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37cdd9-95a7-482c-bbaf-74844927fc4f None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:27.604999 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 679/1367] 10.222.0.43 () {54 vars in 921 bytes} [Fri Dec 24 04:52:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:52:27.610179 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3261b709-f80d-49c0-becf-ae62a117bba5 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:27.610661 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3261b709-f80d-49c0-becf-ae62a117bba5 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:27.610862 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3261b709-f80d-49c0-becf-ae62a117bba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:27.631371 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-3261b709-f80d-49c0-becf-ae62a117bba5 None None] MFA Rules not processed for user `430d6177e74c4dbda7fb83d04c75617e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:52:27.632677 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-3261b709-f80d-49c0-becf-ae62a117bba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:52:27.641890 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 689/1368] 10.222.0.43 () {58 vars in 1018 bytes} [Fri Dec 24 04:52:27 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:52:31.530642 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8c01e-aadd-4afa-bce9-73a51a0647b2 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:31.531147 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8c01e-aadd-4afa-bce9-73a51a0647b2 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:31.531147 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8c01e-aadd-4afa-bce9-73a51a0647b2 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:31.532931 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 680/1369] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:52:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:52:31.539095 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9cc459-1213-4073-9020-94c18c0be477 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:31.539592 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9cc459-1213-4073-9020-94c18c0be477 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:31.539592 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9cc459-1213-4073-9020-94c18c0be477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:31.557677 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-ac9cc459-1213-4073-9020-94c18c0be477 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:52:31.558847 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-ac9cc459-1213-4073-9020-94c18c0be477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:52:31.567125 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 690/1370] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:52:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:52:31.620790 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1225e-7b05-4754-b14b-99e980697ed5 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:31.621075 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1225e-7b05-4754-b14b-99e980697ed5 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:31.621347 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1225e-7b05-4754-b14b-99e980697ed5 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:31.623318 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 681/1371] 10.222.0.43 () {54 vars in 961 bytes} [Fri Dec 24 04:52:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:52:31.629989 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63563a-4967-4de1-ad96-3d375431a5b0 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:31.630482 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63563a-4967-4de1-ad96-3d375431a5b0 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:31.630920 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63563a-4967-4de1-ad96-3d375431a5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:31.682631 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-8d63563a-4967-4de1-ad96-3d375431a5b0 None None] MFA Rules not processed for user `6f9ad1e8f8f74edcb44aabe17eb59648`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:52:31.684186 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-8d63563a-4967-4de1-ad96-3d375431a5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:52:31.765004 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 691/1372] 10.222.0.43 () {58 vars in 1058 bytes} [Fri Dec 24 04:52:31 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:52:31.773494 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e1225e-7b05-4754-b14b-99e980697ed5 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:52:31.788335 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e1225e-7b05-4754-b14b-99e980697ed5 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:52:31.794967 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a104704-205b-49f1-b4e8-5af63ccd49fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f9ad1e8f8f74edcb44aabe17eb59648', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:52:31.795706 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a104704-205b-49f1-b4e8-5af63ccd49fe service nova] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:31.796083 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a104704-205b-49f1-b4e8-5af63ccd49fe service nova] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:31.796468 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a104704-205b-49f1-b4e8-5af63ccd49fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:31.805374 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a104704-205b-49f1-b4e8-5af63ccd49fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:52:31.807046 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a104704-205b-49f1-b4e8-5af63ccd49fe service nova] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:52:31.816340 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 682/1373] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:52:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:52:34.371934 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c6ec84-3f66-4f99-aa28-3b3530191200 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:34.372498 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c6ec84-3f66-4f99-aa28-3b3530191200 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:34.372932 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c6ec84-3f66-4f99-aa28-3b3530191200 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:34.376481 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 692/1374] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:52:34 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:52:34.384181 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816aa127-fd3e-4834-bf3a-3f0b357442e3 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:34.386447 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816aa127-fd3e-4834-bf3a-3f0b357442e3 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:34.386790 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816aa127-fd3e-4834-bf3a-3f0b357442e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:34.409493 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-816aa127-fd3e-4834-bf3a-3f0b357442e3 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:52:34.410689 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-816aa127-fd3e-4834-bf3a-3f0b357442e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:52:34.420590 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 683/1375] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:52:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:52:34.466072 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c6ec84-3f66-4f99-aa28-3b3530191200 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:52:34.480981 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c6ec84-3f66-4f99-aa28-3b3530191200 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:52:34.487157 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e41d0bd-8f53-4cf3-a373-e435ed575880 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f9ad1e8f8f74edcb44aabe17eb59648', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:52:34.487805 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41d0bd-8f53-4cf3-a373-e435ed575880 service nova] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:34.488086 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41d0bd-8f53-4cf3-a373-e435ed575880 service nova] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:34.488362 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41d0bd-8f53-4cf3-a373-e435ed575880 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:34.497138 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e41d0bd-8f53-4cf3-a373-e435ed575880 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:52:34.498738 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e41d0bd-8f53-4cf3-a373-e435ed575880 service nova] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:52:34.508563 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 693/1376] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:52:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:52:37.147093 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65142801-fdb2-40ec-88ff-0ccb4d27f776 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:37.147997 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65142801-fdb2-40ec-88ff-0ccb4d27f776 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:37.148281 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65142801-fdb2-40ec-88ff-0ccb4d27f776 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:37.150163 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 684/1377] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:52:37 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:52:37.156746 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf5e88-b80b-4a6d-a862-06203a9b891d None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:37.157251 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf5e88-b80b-4a6d-a862-06203a9b891d None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:37.157777 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf5e88-b80b-4a6d-a862-06203a9b891d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:37.177865 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-77cf5e88-b80b-4a6d-a862-06203a9b891d None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:52:37.179628 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-77cf5e88-b80b-4a6d-a862-06203a9b891d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:52:37.192372 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 694/1378] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:52:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:52:37.243278 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f9f22-f392-481a-b311-c0328bd13184 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:37.243562 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f9f22-f392-481a-b311-c0328bd13184 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:37.244049 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f9f22-f392-481a-b311-c0328bd13184 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:37.245843 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 685/1379] 10.222.0.43 () {54 vars in 961 bytes} [Fri Dec 24 04:52:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:52:37.251842 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71dd9ad-b705-40eb-9d82-c98aab20bfca None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:37.252131 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71dd9ad-b705-40eb-9d82-c98aab20bfca None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:37.252407 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71dd9ad-b705-40eb-9d82-c98aab20bfca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:37.274173 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-d71dd9ad-b705-40eb-9d82-c98aab20bfca None None] MFA Rules not processed for user `6f9ad1e8f8f74edcb44aabe17eb59648`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:52:37.275539 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-d71dd9ad-b705-40eb-9d82-c98aab20bfca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:52:37.285257 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 695/1380] 10.222.0.43 () {58 vars in 1058 bytes} [Fri Dec 24 04:52:37 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:52:37.293842 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f9f22-f392-481a-b311-c0328bd13184 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:52:37.318221 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f9f22-f392-481a-b311-c0328bd13184 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:52:37.334553 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e24b3-d69d-4952-9aca-b6f8685ee2ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f9ad1e8f8f74edcb44aabe17eb59648', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:52:37.335492 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e24b3-d69d-4952-9aca-b6f8685ee2ea service nova] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:37.336068 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e24b3-d69d-4952-9aca-b6f8685ee2ea service nova] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:37.336403 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e24b3-d69d-4952-9aca-b6f8685ee2ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:37.346818 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2e24b3-d69d-4952-9aca-b6f8685ee2ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:52:37.349374 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2e24b3-d69d-4952-9aca-b6f8685ee2ea service nova] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:52:37.362637 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 686/1381] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:52:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:52:39.466309 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719afa5-bf9a-43f7-823c-7d27be867625 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:39.466873 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719afa5-bf9a-43f7-823c-7d27be867625 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:39.466873 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719afa5-bf9a-43f7-823c-7d27be867625 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:39.468634 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 696/1382] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:52:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:52:39.475101 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df162870-6fca-4e20-9a14-214fa71dcaae None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:39.475903 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df162870-6fca-4e20-9a14-214fa71dcaae None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:39.475903 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df162870-6fca-4e20-9a14-214fa71dcaae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:39.493581 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-df162870-6fca-4e20-9a14-214fa71dcaae None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:52:39.494755 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-df162870-6fca-4e20-9a14-214fa71dcaae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:52:39.503012 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 687/1383] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:52:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:52:39.554578 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680fa488-5f7c-4910-9d47-ff24b7f17417 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:39.554859 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680fa488-5f7c-4910-9d47-ff24b7f17417 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:39.555140 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680fa488-5f7c-4910-9d47-ff24b7f17417 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:39.557092 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 697/1384] 10.222.0.43 () {54 vars in 963 bytes} [Fri Dec 24 04:52:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:52:39.562255 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2af25f-b15e-424f-8ddc-6dae17be2bd9 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:39.562545 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2af25f-b15e-424f-8ddc-6dae17be2bd9 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:39.562821 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2af25f-b15e-424f-8ddc-6dae17be2bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:39.611062 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-ec2af25f-b15e-424f-8ddc-6dae17be2bd9 None None] MFA Rules not processed for user `38517ab5a29c438e89634209652d9963`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:52:39.612172 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-ec2af25f-b15e-424f-8ddc-6dae17be2bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:52:39.672593 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 688/1385] 10.222.0.43 () {58 vars in 1060 bytes} [Fri Dec 24 04:52:39 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:52:39.679928 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680fa488-5f7c-4910-9d47-ff24b7f17417 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:52:39.690898 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680fa488-5f7c-4910-9d47-ff24b7f17417 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:52:39.694544 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30836c55-9465-4ba7-b751-1692f2158071 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:52:39.695171 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30836c55-9465-4ba7-b751-1692f2158071 service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:39.695450 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30836c55-9465-4ba7-b751-1692f2158071 service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:39.695723 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30836c55-9465-4ba7-b751-1692f2158071 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:39.704903 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30836c55-9465-4ba7-b751-1692f2158071 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:52:39.706341 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30836c55-9465-4ba7-b751-1692f2158071 service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:52:39.716059 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 698/1386] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:52:39 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:52:39.853473 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1023bd-9240-44d9-afc5-2d9189bca3f1 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:39.853733 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1023bd-9240-44d9-afc5-2d9189bca3f1 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:39.854215 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1023bd-9240-44d9-afc5-2d9189bca3f1 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:39.856189 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 689/1387] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:52:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:52:39.862064 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2cbbe6-16d7-43d2-8148-61f50755560f None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:39.862279 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2cbbe6-16d7-43d2-8148-61f50755560f None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:39.862760 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2cbbe6-16d7-43d2-8148-61f50755560f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:39.881080 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-aa2cbbe6-16d7-43d2-8148-61f50755560f None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:52:39.882386 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-aa2cbbe6-16d7-43d2-8148-61f50755560f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:52:39.891403 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 699/1388] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:52:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:52:39.937203 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1023bd-9240-44d9-afc5-2d9189bca3f1 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:52:39.953601 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1023bd-9240-44d9-afc5-2d9189bca3f1 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:52:39.960943 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4655ce7-0b9f-4b2c-9873-aef0040c40ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f9ad1e8f8f74edcb44aabe17eb59648', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:52:39.961770 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4655ce7-0b9f-4b2c-9873-aef0040c40ad service nova] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:39.962309 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4655ce7-0b9f-4b2c-9873-aef0040c40ad service nova] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:39.962678 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4655ce7-0b9f-4b2c-9873-aef0040c40ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:39.971866 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4655ce7-0b9f-4b2c-9873-aef0040c40ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:52:39.973633 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4655ce7-0b9f-4b2c-9873-aef0040c40ad service nova] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:52:39.986254 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 690/1389] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:52:39 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:52:42.428661 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ba9e5-f96d-4a2c-a06b-49bad637240a None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:42.429256 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ba9e5-f96d-4a2c-a06b-49bad637240a None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:42.429256 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ba9e5-f96d-4a2c-a06b-49bad637240a None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:42.431053 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 700/1390] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:52:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:52:42.436948 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a4150-51a5-49b6-871d-73bf447e5081 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:42.437400 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a4150-51a5-49b6-871d-73bf447e5081 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:42.437498 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a4150-51a5-49b6-871d-73bf447e5081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:42.456290 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-ab2a4150-51a5-49b6-871d-73bf447e5081 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:52:42.457556 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-ab2a4150-51a5-49b6-871d-73bf447e5081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:52:42.467118 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 691/1391] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:52:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:52:42.513162 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ba9e5-f96d-4a2c-a06b-49bad637240a None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:52:42.527916 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ba9e5-f96d-4a2c-a06b-49bad637240a None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:52:42.534811 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c796c55-58f6-49de-a89a-c211189db596 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f9ad1e8f8f74edcb44aabe17eb59648', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:52:42.535489 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c796c55-58f6-49de-a89a-c211189db596 service nova] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:42.535770 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c796c55-58f6-49de-a89a-c211189db596 service nova] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:42.536042 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c796c55-58f6-49de-a89a-c211189db596 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:42.545128 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c796c55-58f6-49de-a89a-c211189db596 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:52:42.546720 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c796c55-58f6-49de-a89a-c211189db596 service nova] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:52:42.560947 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 701/1392] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:52:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:52:44.981657 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3db6c-4725-4935-be08-ed55f4edce76 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:44.982229 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3db6c-4725-4935-be08-ed55f4edce76 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:44.982229 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3db6c-4725-4935-be08-ed55f4edce76 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:44.983887 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 692/1393] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:52:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:52:44.989547 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738de99-5aaa-4358-bda3-65725d40104d None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:44.990006 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738de99-5aaa-4358-bda3-65725d40104d None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:44.990102 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738de99-5aaa-4358-bda3-65725d40104d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:45.007727 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-d738de99-5aaa-4358-bda3-65725d40104d None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:52:45.009046 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-d738de99-5aaa-4358-bda3-65725d40104d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:52:45.017418 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 702/1394] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:52:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:52:45.064291 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3db6c-4725-4935-be08-ed55f4edce76 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:52:45.078437 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3db6c-4725-4935-be08-ed55f4edce76 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:52:45.083751 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c14086-1f88-4d96-8150-5bf8e103e152 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f9ad1e8f8f74edcb44aabe17eb59648', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:52:45.084883 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c14086-1f88-4d96-8150-5bf8e103e152 service nova] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:45.085164 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c14086-1f88-4d96-8150-5bf8e103e152 service nova] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:45.085434 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c14086-1f88-4d96-8150-5bf8e103e152 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:45.093906 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c14086-1f88-4d96-8150-5bf8e103e152 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:52:45.095625 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c14086-1f88-4d96-8150-5bf8e103e152 service nova] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:52:45.107832 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 693/1395] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:52:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:52:47.505775 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d95cf3-eabc-4688-8dc8-dcd78749c7f8 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:47.506361 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d95cf3-eabc-4688-8dc8-dcd78749c7f8 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:47.506657 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d95cf3-eabc-4688-8dc8-dcd78749c7f8 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:47.508574 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 703/1396] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:52:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:52:47.515253 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1c487-ceb7-4940-a33e-907dcfa3a2cc None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:47.515703 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1c487-ceb7-4940-a33e-907dcfa3a2cc None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:47.515939 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1c487-ceb7-4940-a33e-907dcfa3a2cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:47.534754 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-38d1c487-ceb7-4940-a33e-907dcfa3a2cc None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:52:47.535978 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-38d1c487-ceb7-4940-a33e-907dcfa3a2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:52:47.544885 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 694/1397] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:52:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:52:47.589396 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d95cf3-eabc-4688-8dc8-dcd78749c7f8 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:52:47.605753 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d95cf3-eabc-4688-8dc8-dcd78749c7f8 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:52:47.613065 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5bfc63-e9f6-4b30-8ef9-9f909da14229 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f9ad1e8f8f74edcb44aabe17eb59648', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:52:47.613815 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5bfc63-e9f6-4b30-8ef9-9f909da14229 service nova] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:47.614093 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5bfc63-e9f6-4b30-8ef9-9f909da14229 service nova] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:47.614415 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5bfc63-e9f6-4b30-8ef9-9f909da14229 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:47.623518 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5bfc63-e9f6-4b30-8ef9-9f909da14229 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:52:47.625142 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5bfc63-e9f6-4b30-8ef9-9f909da14229 service nova] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:52:47.636312 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 704/1398] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:52:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:52:50.017375 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a914c-704e-46c3-9310-2d2616c25891 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:50.017950 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a914c-704e-46c3-9310-2d2616c25891 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:50.017950 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a914c-704e-46c3-9310-2d2616c25891 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:50.019813 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 695/1399] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:52:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:52:50.026510 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d404c2-63b1-406f-a01e-eacc30e06442 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:50.026944 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d404c2-63b1-406f-a01e-eacc30e06442 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:50.027176 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d404c2-63b1-406f-a01e-eacc30e06442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:50.050581 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-44d404c2-63b1-406f-a01e-eacc30e06442 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:52:50.052178 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-44d404c2-63b1-406f-a01e-eacc30e06442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:52:50.062577 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 705/1400] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:52:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 04:52:50.122113 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a914c-704e-46c3-9310-2d2616c25891 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:52:50.137133 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a914c-704e-46c3-9310-2d2616c25891 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:52:50.143752 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b00e7d-358b-48af-9d26-5cea534ff22f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f9ad1e8f8f74edcb44aabe17eb59648', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:52:50.144421 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b00e7d-358b-48af-9d26-5cea534ff22f service nova] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:50.144734 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b00e7d-358b-48af-9d26-5cea534ff22f service nova] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:50.145010 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b00e7d-358b-48af-9d26-5cea534ff22f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:50.154118 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b00e7d-358b-48af-9d26-5cea534ff22f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:52:50.156270 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b00e7d-358b-48af-9d26-5cea534ff22f service nova] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:52:50.168294 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 696/1401] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:52:50 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:52:52.586477 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d2b4d-f2e1-4382-a185-1b59921203b8 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:52.586999 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d2b4d-f2e1-4382-a185-1b59921203b8 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:52.586999 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d2b4d-f2e1-4382-a185-1b59921203b8 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:52.588753 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 706/1402] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:52:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:52:52.594593 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b9f53-a70b-402b-ade4-9610d8b491cd None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:52.595024 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b9f53-a70b-402b-ade4-9610d8b491cd None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:52.595230 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b9f53-a70b-402b-ade4-9610d8b491cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:52.614396 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-d49b9f53-a70b-402b-ade4-9610d8b491cd None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:52:52.615818 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-d49b9f53-a70b-402b-ade4-9610d8b491cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:52:52.624562 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 697/1403] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:52:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:52:52.670046 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d2b4d-f2e1-4382-a185-1b59921203b8 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:52:52.685358 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d2b4d-f2e1-4382-a185-1b59921203b8 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:52:52.690962 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff47ac6-4d02-4e7a-adcc-50a4d31cf7f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f9ad1e8f8f74edcb44aabe17eb59648', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:52:52.691599 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff47ac6-4d02-4e7a-adcc-50a4d31cf7f0 service nova] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:52.691879 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff47ac6-4d02-4e7a-adcc-50a4d31cf7f0 service nova] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:52.692151 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff47ac6-4d02-4e7a-adcc-50a4d31cf7f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:52.701025 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff47ac6-4d02-4e7a-adcc-50a4d31cf7f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:52:52.702650 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff47ac6-4d02-4e7a-adcc-50a4d31cf7f0 service nova] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:52:52.712993 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 707/1404] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:52:52 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:52:54.674949 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d780c-29e9-4d60-8b60-3b5020ac082c None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:54.675497 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d780c-29e9-4d60-8b60-3b5020ac082c None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:54.675497 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d780c-29e9-4d60-8b60-3b5020ac082c None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:54.678077 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 698/1405] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:52:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:52:54.684914 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d84ca0-9250-462d-92c2-4b05490ad6a7 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:54.685498 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d84ca0-9250-462d-92c2-4b05490ad6a7 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:54.685498 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d84ca0-9250-462d-92c2-4b05490ad6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:54.705574 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-55d84ca0-9250-462d-92c2-4b05490ad6a7 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:52:54.706810 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-55d84ca0-9250-462d-92c2-4b05490ad6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:52:54.716134 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 708/1406] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:52:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:52:54.774719 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce597e72-86e5-4c4e-9f59-27315d013b7d None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:54.775008 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce597e72-86e5-4c4e-9f59-27315d013b7d None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:54.775264 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce597e72-86e5-4c4e-9f59-27315d013b7d None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:54.777256 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 699/1407] 10.222.0.43 () {54 vars in 962 bytes} [Fri Dec 24 04:52:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:52:54.782843 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5613e-458e-4047-8c36-5dbe67b4693f None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:54.783203 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5613e-458e-4047-8c36-5dbe67b4693f None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:54.783542 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5613e-458e-4047-8c36-5dbe67b4693f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:54.842207 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-afe5613e-458e-4047-8c36-5dbe67b4693f None None] MFA Rules not processed for user `c1782324ce854868bd11b32bd24b435c`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:52:54.843405 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-afe5613e-458e-4047-8c36-5dbe67b4693f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:52:54.909930 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 709/1408] 10.222.0.43 () {58 vars in 1059 bytes} [Fri Dec 24 04:52:54 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:52:54.920649 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce597e72-86e5-4c4e-9f59-27315d013b7d None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:52:54.932584 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce597e72-86e5-4c4e-9f59-27315d013b7d None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:52:54.936515 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac90e6b-caca-485a-b539-afe97cd90234 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1782324ce854868bd11b32bd24b435c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:52:54.937172 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac90e6b-caca-485a-b539-afe97cd90234 service glance] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:54.937527 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac90e6b-caca-485a-b539-afe97cd90234 service glance] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:54.937780 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac90e6b-caca-485a-b539-afe97cd90234 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:54.947693 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac90e6b-caca-485a-b539-afe97cd90234 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:52:54.949242 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac90e6b-caca-485a-b539-afe97cd90234 service glance] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:52:54.959588 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 700/1409] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:52:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:52:55.081590 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc0d3c-8df4-4b96-802e-f26beffcbcbb None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:55.081877 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc0d3c-8df4-4b96-802e-f26beffcbcbb None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:55.082160 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc0d3c-8df4-4b96-802e-f26beffcbcbb None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:55.084398 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 710/1410] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:52:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:52:55.090723 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbeea6-5819-4db2-a5b0-2236dfd49fd3 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:55.090985 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbeea6-5819-4db2-a5b0-2236dfd49fd3 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:55.091289 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbeea6-5819-4db2-a5b0-2236dfd49fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:55.112980 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-aacbeea6-5819-4db2-a5b0-2236dfd49fd3 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:52:55.114300 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-aacbeea6-5819-4db2-a5b0-2236dfd49fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:52:55.122940 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 701/1411] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:52:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:52:55.171942 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc0d3c-8df4-4b96-802e-f26beffcbcbb None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:52:55.187712 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc0d3c-8df4-4b96-802e-f26beffcbcbb None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:52:55.193259 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76e708-a58c-426b-a54b-eae42bd29a15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f9ad1e8f8f74edcb44aabe17eb59648', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:52:55.193902 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76e708-a58c-426b-a54b-eae42bd29a15 service nova] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:55.194184 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76e708-a58c-426b-a54b-eae42bd29a15 service nova] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:55.194456 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76e708-a58c-426b-a54b-eae42bd29a15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:55.202824 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa76e708-a58c-426b-a54b-eae42bd29a15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:52:55.204414 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa76e708-a58c-426b-a54b-eae42bd29a15 service nova] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:52:55.217454 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 711/1412] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:52:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:52:55.407836 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caea1a8-0d66-455f-a57e-388b66f6acec None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:55.408138 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caea1a8-0d66-455f-a57e-388b66f6acec None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:55.408416 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caea1a8-0d66-455f-a57e-388b66f6acec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:55.464191 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-8caea1a8-0d66-455f-a57e-388b66f6acec None None] MFA Rules not processed for user `3d0ee2c830754741b0f9eedabf6bded8`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:52:55.465374 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-8caea1a8-0d66-455f-a57e-388b66f6acec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:52:55.530645 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 702/1413] 10.222.0.43 () {58 vars in 1009 bytes} [Fri Dec 24 04:52:55 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:52:55.572910 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206bbff-59ad-4620-88a5-4e719263fc2d None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:55.573204 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206bbff-59ad-4620-88a5-4e719263fc2d None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:55.573486 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206bbff-59ad-4620-88a5-4e719263fc2d None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:55.575293 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 712/1414] 10.222.0.43 () {54 vars in 942 bytes} [Fri Dec 24 04:52:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:52:55.582675 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a24f3-9795-42f9-805f-ae35ac353a37 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:55.582990 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a24f3-9795-42f9-805f-ae35ac353a37 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:55.583270 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a24f3-9795-42f9-805f-ae35ac353a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:55.631189 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-bf5a24f3-9795-42f9-805f-ae35ac353a37 None None] MFA Rules not processed for user `218ae7d29b71487d86b11aeb380788ef`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:52:55.632360 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-bf5a24f3-9795-42f9-805f-ae35ac353a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:52:55.702500 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 703/1415] 10.222.0.43 () {58 vars in 1039 bytes} [Fri Dec 24 04:52:55 2021] POST /identity/v3/auth/tokens => generated 3294 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:52:55.712240 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7206bbff-59ad-4620-88a5-4e719263fc2d None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:52:55.726902 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7206bbff-59ad-4620-88a5-4e719263fc2d None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:52:55.732714 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a76ed-65f5-418d-9b15-53c17821bb5c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218ae7d29b71487d86b11aeb380788ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:52:55.733359 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a76ed-65f5-418d-9b15-53c17821bb5c service swift] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:55.733644 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a76ed-65f5-418d-9b15-53c17821bb5c service swift] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:55.733923 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a76ed-65f5-418d-9b15-53c17821bb5c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:55.742240 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04a76ed-65f5-418d-9b15-53c17821bb5c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:52:55.743845 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04a76ed-65f5-418d-9b15-53c17821bb5c service swift] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:52:55.752027 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 713/1416] 10.222.0.43 () {60 vars in 1384 bytes} [Fri Dec 24 04:52:55 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 24 04:52:57.678648 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8e389a-43eb-4309-a50b-43767dc7aba8 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:57.679297 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8e389a-43eb-4309-a50b-43767dc7aba8 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:57.679507 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8e389a-43eb-4309-a50b-43767dc7aba8 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:57.682569 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 704/1417] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:52:57 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:52:57.691833 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779530b-5b32-44fe-a86b-731873b549c5 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:57.692422 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779530b-5b32-44fe-a86b-731873b549c5 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:57.692422 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779530b-5b32-44fe-a86b-731873b549c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:57.715855 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-8779530b-5b32-44fe-a86b-731873b549c5 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:52:57.717189 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-8779530b-5b32-44fe-a86b-731873b549c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:52:57.727684 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 714/1418] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:52:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:52:57.773174 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8e389a-43eb-4309-a50b-43767dc7aba8 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:52:57.787905 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8e389a-43eb-4309-a50b-43767dc7aba8 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:52:57.794138 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe7aec8-5bcd-44e9-9ff5-50993f454d91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f9ad1e8f8f74edcb44aabe17eb59648', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:52:57.794758 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7aec8-5bcd-44e9-9ff5-50993f454d91 service nova] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:52:57.795036 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7aec8-5bcd-44e9-9ff5-50993f454d91 service nova] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:52:57.795304 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7aec8-5bcd-44e9-9ff5-50993f454d91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:52:57.806799 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe7aec8-5bcd-44e9-9ff5-50993f454d91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:52:57.808811 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe7aec8-5bcd-44e9-9ff5-50993f454d91 service nova] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:52:57.820355 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 705/1419] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:52:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:53:00.247744 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecbd4ba-bcb2-4cd5-822d-01919040a4d6 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:00.248310 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecbd4ba-bcb2-4cd5-822d-01919040a4d6 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:00.248310 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecbd4ba-bcb2-4cd5-822d-01919040a4d6 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:00.250430 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 715/1420] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:53:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:53:00.256450 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a61630-7c0e-4b42-a6d5-8be13e875d76 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:00.256923 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a61630-7c0e-4b42-a6d5-8be13e875d76 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:00.257122 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a61630-7c0e-4b42-a6d5-8be13e875d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:00.274925 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-a1a61630-7c0e-4b42-a6d5-8be13e875d76 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:53:00.276121 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-a1a61630-7c0e-4b42-a6d5-8be13e875d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:53:00.289986 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 706/1421] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:53:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:53:00.341670 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecbd4ba-bcb2-4cd5-822d-01919040a4d6 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:53:00.356304 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecbd4ba-bcb2-4cd5-822d-01919040a4d6 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:53:00.361893 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096cc822-abf0-4107-9b46-7dc6c34a1617 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f9ad1e8f8f74edcb44aabe17eb59648', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:53:00.362680 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096cc822-abf0-4107-9b46-7dc6c34a1617 service nova] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:00.362970 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096cc822-abf0-4107-9b46-7dc6c34a1617 service nova] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:00.363249 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096cc822-abf0-4107-9b46-7dc6c34a1617 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:00.372123 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096cc822-abf0-4107-9b46-7dc6c34a1617 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:53:00.373985 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096cc822-abf0-4107-9b46-7dc6c34a1617 service nova] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:53:00.383214 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 716/1422] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:53:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:53:18.507923 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b43450-dd15-4565-a86e-02f39356cdf6 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:18.508572 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b43450-dd15-4565-a86e-02f39356cdf6 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:18.508572 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b43450-dd15-4565-a86e-02f39356cdf6 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:18.510271 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 707/1423] 10.222.0.43 () {54 vars in 918 bytes} [Fri Dec 24 04:53:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:53:18.516225 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855bb86-f24b-425f-b8fd-942ddf2a31fe None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:18.516703 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855bb86-f24b-425f-b8fd-942ddf2a31fe None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:18.516808 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855bb86-f24b-425f-b8fd-942ddf2a31fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:18.537250 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-b855bb86-f24b-425f-b8fd-942ddf2a31fe None None] MFA Rules not processed for user `430d6177e74c4dbda7fb83d04c75617e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:53:18.538518 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-b855bb86-f24b-425f-b8fd-942ddf2a31fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:53:18.547879 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 717/1424] 10.222.0.43 () {58 vars in 1015 bytes} [Fri Dec 24 04:53:18 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 04:53:18.563436 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307be236-9bf7-4e01-81d2-5a6e31e92718 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:18.563721 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307be236-9bf7-4e01-81d2-5a6e31e92718 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:18.564000 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307be236-9bf7-4e01-81d2-5a6e31e92718 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:18.565791 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 708/1425] 10.222.0.43 () {54 vars in 918 bytes} [Fri Dec 24 04:53:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:53:18.571615 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180de054-f54f-4a3c-b7be-c60269614d0d None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:18.571844 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180de054-f54f-4a3c-b7be-c60269614d0d None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:18.572098 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180de054-f54f-4a3c-b7be-c60269614d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:18.591019 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-180de054-f54f-4a3c-b7be-c60269614d0d None None] MFA Rules not processed for user `6f9ad1e8f8f74edcb44aabe17eb59648`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:53:18.592239 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-180de054-f54f-4a3c-b7be-c60269614d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:53:18.603001 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 718/1426] 10.222.0.43 () {58 vars in 1015 bytes} [Fri Dec 24 04:53:18 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:53:21.341132 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0377458d-0beb-4120-96d6-65e32ad1d98e None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:21.341701 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0377458d-0beb-4120-96d6-65e32ad1d98e None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:21.341701 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0377458d-0beb-4120-96d6-65e32ad1d98e None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:21.344259 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 709/1427] 127.0.0.1 () {54 vars in 916 bytes} [Fri Dec 24 04:53:21 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:53:21.350406 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66a27b-5a48-47ac-8b59-6a72950702b0 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:21.350841 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66a27b-5a48-47ac-8b59-6a72950702b0 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:21.350979 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66a27b-5a48-47ac-8b59-6a72950702b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:21.370027 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-1a66a27b-5a48-47ac-8b59-6a72950702b0 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:53:21.371231 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-1a66a27b-5a48-47ac-8b59-6a72950702b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:53:21.381511 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 719/1428] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Dec 24 04:53:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:53:21.427153 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0377458d-0beb-4120-96d6-65e32ad1d98e None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:53:21.443232 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0377458d-0beb-4120-96d6-65e32ad1d98e None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:53:21.449397 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450b827b-d2b8-402d-b657-ded59fdd405b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f9ad1e8f8f74edcb44aabe17eb59648', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:53:21.450032 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b827b-d2b8-402d-b657-ded59fdd405b service nova] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:21.450306 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b827b-d2b8-402d-b657-ded59fdd405b service nova] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:21.450587 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b827b-d2b8-402d-b657-ded59fdd405b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:21.458906 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450b827b-d2b8-402d-b657-ded59fdd405b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:53:21.460850 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450b827b-d2b8-402d-b657-ded59fdd405b service nova] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:53:21.470150 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 710/1429] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:53:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:53:23.066781 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652965a7-dade-4bd3-bbfe-6c46bf612581 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:23.067798 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652965a7-dade-4bd3-bbfe-6c46bf612581 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:23.067985 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652965a7-dade-4bd3-bbfe-6c46bf612581 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:23.069770 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 720/1430] 127.0.0.1 () {54 vars in 901 bytes} [Fri Dec 24 04:53:23 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:53:23.076445 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6a955-00dc-4001-8e4f-796a4616361c None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:23.077193 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6a955-00dc-4001-8e4f-796a4616361c None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:23.077305 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6a955-00dc-4001-8e4f-796a4616361c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:23.100656 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-21d6a955-00dc-4001-8e4f-796a4616361c None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:53:23.101851 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-21d6a955-00dc-4001-8e4f-796a4616361c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:53:23.110413 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 711/1431] 127.0.0.1 () {58 vars in 998 bytes} [Fri Dec 24 04:53:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:53:23.263453 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652965a7-dade-4bd3-bbfe-6c46bf612581 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:53:23.288431 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652965a7-dade-4bd3-bbfe-6c46bf612581 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:53:23.296478 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a123657-5b71-4e42-bda6-33d85e6ca7b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f9ad1e8f8f74edcb44aabe17eb59648', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:53:23.297504 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a123657-5b71-4e42-bda6-33d85e6ca7b8 service nova] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:23.297905 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a123657-5b71-4e42-bda6-33d85e6ca7b8 service nova] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:23.298189 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a123657-5b71-4e42-bda6-33d85e6ca7b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:23.308913 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a123657-5b71-4e42-bda6-33d85e6ca7b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:53:23.310498 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a123657-5b71-4e42-bda6-33d85e6ca7b8 service nova] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:53:23.321445 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 721/1432] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:53:23 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:53:24.869265 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71824e-cce8-484b-a15b-ac6f3319c37f None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:24.870118 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71824e-cce8-484b-a15b-ac6f3319c37f None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:24.870118 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71824e-cce8-484b-a15b-ac6f3319c37f None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:24.873522 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 712/1433] 127.0.0.1 () {54 vars in 901 bytes} [Fri Dec 24 04:53:24 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:53:24.882690 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d5f6f-1b5d-4933-b8ea-14dd40bfd7c7 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:24.883138 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d5f6f-1b5d-4933-b8ea-14dd40bfd7c7 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:24.883234 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d5f6f-1b5d-4933-b8ea-14dd40bfd7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:24.906533 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-283d5f6f-1b5d-4933-b8ea-14dd40bfd7c7 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:53:24.907721 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-283d5f6f-1b5d-4933-b8ea-14dd40bfd7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:53:24.916895 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 722/1434] 127.0.0.1 () {58 vars in 998 bytes} [Fri Dec 24 04:53:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:53:25.071660 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d71824e-cce8-484b-a15b-ac6f3319c37f None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:53:25.089060 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d71824e-cce8-484b-a15b-ac6f3319c37f None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:53:25.095612 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b07f1-5fa5-4b42-951c-7d36ba7d5fe2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f9ad1e8f8f74edcb44aabe17eb59648', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:53:25.096252 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b07f1-5fa5-4b42-951c-7d36ba7d5fe2 service nova] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:25.096545 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b07f1-5fa5-4b42-951c-7d36ba7d5fe2 service nova] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:25.096834 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b07f1-5fa5-4b42-951c-7d36ba7d5fe2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:25.105705 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15b07f1-5fa5-4b42-951c-7d36ba7d5fe2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:53:25.107309 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15b07f1-5fa5-4b42-951c-7d36ba7d5fe2 service nova] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:53:25.117073 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 713/1435] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:53:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:53:26.624248 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f8d76-087b-4c31-a266-c7c9cbf6a266 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:26.625153 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f8d76-087b-4c31-a266-c7c9cbf6a266 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:26.625153 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f8d76-087b-4c31-a266-c7c9cbf6a266 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:26.627781 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 723/1436] 127.0.0.1 () {54 vars in 901 bytes} [Fri Dec 24 04:53:26 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:53:26.633604 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e0291-12e8-40ae-aab7-aa1e2b3c580a None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:26.634029 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e0291-12e8-40ae-aab7-aa1e2b3c580a None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:26.634141 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e0291-12e8-40ae-aab7-aa1e2b3c580a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:26.654926 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-5a8e0291-12e8-40ae-aab7-aa1e2b3c580a None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:53:26.656167 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-5a8e0291-12e8-40ae-aab7-aa1e2b3c580a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:53:26.665498 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 714/1437] 127.0.0.1 () {58 vars in 998 bytes} [Fri Dec 24 04:53:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:53:26.820749 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f8d76-087b-4c31-a266-c7c9cbf6a266 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:53:26.844475 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f8d76-087b-4c31-a266-c7c9cbf6a266 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:53:26.852318 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a033f3b7-7fe8-4208-80bd-7d9a49b5b74d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f9ad1e8f8f74edcb44aabe17eb59648', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:53:26.852988 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033f3b7-7fe8-4208-80bd-7d9a49b5b74d service nova] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:26.853269 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033f3b7-7fe8-4208-80bd-7d9a49b5b74d service nova] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:26.853539 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033f3b7-7fe8-4208-80bd-7d9a49b5b74d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:26.861543 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a033f3b7-7fe8-4208-80bd-7d9a49b5b74d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:53:26.863125 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a033f3b7-7fe8-4208-80bd-7d9a49b5b74d service nova] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:53:26.872326 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 724/1438] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:53:26 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:53:28.410029 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d156e4-262c-45a8-8e6b-311d592b7bfb None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:28.410913 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d156e4-262c-45a8-8e6b-311d592b7bfb None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:28.410913 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d156e4-262c-45a8-8e6b-311d592b7bfb None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:28.412925 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 715/1439] 127.0.0.1 () {54 vars in 901 bytes} [Fri Dec 24 04:53:28 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:53:28.418997 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d999f1-5588-41a7-a937-923c3eb90557 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:28.419476 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d999f1-5588-41a7-a937-923c3eb90557 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:28.419591 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d999f1-5588-41a7-a937-923c3eb90557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:28.438443 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-31d999f1-5588-41a7-a937-923c3eb90557 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:53:28.439640 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-31d999f1-5588-41a7-a937-923c3eb90557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:53:28.448337 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 725/1440] 127.0.0.1 () {58 vars in 998 bytes} [Fri Dec 24 04:53:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:53:28.603371 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d156e4-262c-45a8-8e6b-311d592b7bfb None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:53:28.618609 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d156e4-262c-45a8-8e6b-311d592b7bfb None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:53:28.624068 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb7436-b858-45df-8942-b92ad4279d03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f9ad1e8f8f74edcb44aabe17eb59648', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:53:28.624743 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb7436-b858-45df-8942-b92ad4279d03 service nova] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:28.625042 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb7436-b858-45df-8942-b92ad4279d03 service nova] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:28.625320 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb7436-b858-45df-8942-b92ad4279d03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:28.633698 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eb7436-b858-45df-8942-b92ad4279d03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:53:28.635296 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eb7436-b858-45df-8942-b92ad4279d03 service nova] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:53:28.645149 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 716/1441] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:53:28 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:53:30.117223 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101bec7-0f24-424e-a0cf-82d30634fdd8 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:30.118131 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101bec7-0f24-424e-a0cf-82d30634fdd8 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:30.118131 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101bec7-0f24-424e-a0cf-82d30634fdd8 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:30.120919 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 726/1442] 127.0.0.1 () {54 vars in 901 bytes} [Fri Dec 24 04:53:30 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:53:30.127445 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc3e39-069f-48f6-91aa-340e89d86ee0 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:30.127910 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc3e39-069f-48f6-91aa-340e89d86ee0 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:30.128049 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc3e39-069f-48f6-91aa-340e89d86ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:30.152000 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-b4fc3e39-069f-48f6-91aa-340e89d86ee0 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:53:30.153218 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-b4fc3e39-069f-48f6-91aa-340e89d86ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:53:30.162101 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 717/1443] 127.0.0.1 () {58 vars in 998 bytes} [Fri Dec 24 04:53:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:53:30.315080 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101bec7-0f24-424e-a0cf-82d30634fdd8 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:53:30.339322 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101bec7-0f24-424e-a0cf-82d30634fdd8 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:53:30.347795 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478d8cb-92ec-4b27-bcee-63b1ab6c07b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f9ad1e8f8f74edcb44aabe17eb59648', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:53:30.348436 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478d8cb-92ec-4b27-bcee-63b1ab6c07b7 service nova] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:30.349059 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478d8cb-92ec-4b27-bcee-63b1ab6c07b7 service nova] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:30.349225 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478d8cb-92ec-4b27-bcee-63b1ab6c07b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:30.358492 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b478d8cb-92ec-4b27-bcee-63b1ab6c07b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:53:30.360073 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b478d8cb-92ec-4b27-bcee-63b1ab6c07b7 service nova] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:53:30.372194 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 727/1444] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:53:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:53:31.844057 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e784c-3026-4c29-9b97-f942c00c8d96 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:31.844653 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e784c-3026-4c29-9b97-f942c00c8d96 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:31.844653 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e784c-3026-4c29-9b97-f942c00c8d96 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:31.846430 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 718/1445] 127.0.0.1 () {54 vars in 901 bytes} [Fri Dec 24 04:53:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:53:31.852295 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279116bb-20e3-417e-9986-1187439a7c39 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:31.852790 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279116bb-20e3-417e-9986-1187439a7c39 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:31.852911 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279116bb-20e3-417e-9986-1187439a7c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:31.872272 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-279116bb-20e3-417e-9986-1187439a7c39 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:53:31.873485 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-279116bb-20e3-417e-9986-1187439a7c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:53:31.881608 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 728/1446] 127.0.0.1 () {58 vars in 998 bytes} [Fri Dec 24 04:53:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:53:32.036739 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e784c-3026-4c29-9b97-f942c00c8d96 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:53:32.053854 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e784c-3026-4c29-9b97-f942c00c8d96 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:53:32.060846 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6635d458-122b-4816-abc8-209e6771e798 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f9ad1e8f8f74edcb44aabe17eb59648', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:53:32.061481 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635d458-122b-4816-abc8-209e6771e798 service nova] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:32.061760 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635d458-122b-4816-abc8-209e6771e798 service nova] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:32.062033 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635d458-122b-4816-abc8-209e6771e798 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:32.070582 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6635d458-122b-4816-abc8-209e6771e798 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:53:32.072172 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6635d458-122b-4816-abc8-209e6771e798 service nova] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:53:32.081624 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 719/1447] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:53:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:53:33.555158 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be8771-95a1-469c-98ec-f04ec5ddb7df None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:33.555766 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be8771-95a1-469c-98ec-f04ec5ddb7df None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:33.555766 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be8771-95a1-469c-98ec-f04ec5ddb7df None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:33.557558 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 729/1448] 127.0.0.1 () {54 vars in 901 bytes} [Fri Dec 24 04:53:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:53:33.564088 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1ffec-5ee4-4f45-a792-30ae30ff78b5 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:33.564839 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1ffec-5ee4-4f45-a792-30ae30ff78b5 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:33.565029 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1ffec-5ee4-4f45-a792-30ae30ff78b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:33.587190 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-58e1ffec-5ee4-4f45-a792-30ae30ff78b5 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:53:33.588315 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-58e1ffec-5ee4-4f45-a792-30ae30ff78b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:53:33.598565 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 720/1449] 127.0.0.1 () {58 vars in 998 bytes} [Fri Dec 24 04:53:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:53:33.767889 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be8771-95a1-469c-98ec-f04ec5ddb7df None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:53:33.785665 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be8771-95a1-469c-98ec-f04ec5ddb7df None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:53:33.793980 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be68bd7-dd1f-46bd-8623-37b82d2637c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f9ad1e8f8f74edcb44aabe17eb59648', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:53:33.794611 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be68bd7-dd1f-46bd-8623-37b82d2637c9 service nova] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:33.794887 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be68bd7-dd1f-46bd-8623-37b82d2637c9 service nova] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:33.795154 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be68bd7-dd1f-46bd-8623-37b82d2637c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:33.804083 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be68bd7-dd1f-46bd-8623-37b82d2637c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:53:33.805727 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be68bd7-dd1f-46bd-8623-37b82d2637c9 service nova] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:53:33.816186 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 730/1450] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:53:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:53:35.264439 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ebf1a-7c31-4617-a92b-d54784ccc9c6 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:35.265071 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ebf1a-7c31-4617-a92b-d54784ccc9c6 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:35.265071 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ebf1a-7c31-4617-a92b-d54784ccc9c6 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:35.266808 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 721/1451] 127.0.0.1 () {54 vars in 901 bytes} [Fri Dec 24 04:53:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 24 04:53:35.272594 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ae955-f843-457f-ba16-928d942e17ad None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:35.273048 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ae955-f843-457f-ba16-928d942e17ad None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:35.273164 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ae955-f843-457f-ba16-928d942e17ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:35.292479 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-387ae955-f843-457f-ba16-928d942e17ad None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:53:35.293677 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-387ae955-f843-457f-ba16-928d942e17ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:53:35.301960 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 731/1452] 127.0.0.1 () {58 vars in 998 bytes} [Fri Dec 24 04:53:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:53:35.457230 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ebf1a-7c31-4617-a92b-d54784ccc9c6 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:53:35.474566 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ebf1a-7c31-4617-a92b-d54784ccc9c6 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:53:35.480754 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d2d1b-ae79-4cba-90c4-2ed0c573445f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f9ad1e8f8f74edcb44aabe17eb59648', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:53:35.481392 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d2d1b-ae79-4cba-90c4-2ed0c573445f service nova] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:35.481679 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d2d1b-ae79-4cba-90c4-2ed0c573445f service nova] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:35.481957 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d2d1b-ae79-4cba-90c4-2ed0c573445f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:35.490490 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d2d1b-ae79-4cba-90c4-2ed0c573445f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:53:35.492131 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d2d1b-ae79-4cba-90c4-2ed0c573445f service nova] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:53:35.501588 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 722/1453] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:53:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:53:37.890122 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beecae5-2ba7-4bad-b857-6230f887ff66 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:37.890697 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beecae5-2ba7-4bad-b857-6230f887ff66 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:37.890697 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beecae5-2ba7-4bad-b857-6230f887ff66 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:37.892451 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 732/1454] 127.0.0.1 () {54 vars in 916 bytes} [Fri Dec 24 04:53:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:53:37.899467 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb786a8-cfd0-43f3-a1ee-22911627977a None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:37.900290 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb786a8-cfd0-43f3-a1ee-22911627977a None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:37.900290 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb786a8-cfd0-43f3-a1ee-22911627977a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:37.925236 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-ebb786a8-cfd0-43f3-a1ee-22911627977a None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:53:37.926932 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-ebb786a8-cfd0-43f3-a1ee-22911627977a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:53:37.944960 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 723/1455] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Dec 24 04:53:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:53:38.006930 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beecae5-2ba7-4bad-b857-6230f887ff66 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:53:38.024049 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beecae5-2ba7-4bad-b857-6230f887ff66 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:53:38.031588 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458741b5-f1e5-48a2-afa9-ad555ed69b1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:53:38.032601 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458741b5-f1e5-48a2-afa9-ad555ed69b1a service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:38.033100 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458741b5-f1e5-48a2-afa9-ad555ed69b1a service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:38.033550 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458741b5-f1e5-48a2-afa9-ad555ed69b1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:38.045836 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458741b5-f1e5-48a2-afa9-ad555ed69b1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:53:38.047386 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458741b5-f1e5-48a2-afa9-ad555ed69b1a service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:53:38.061030 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 733/1456] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:53:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:53:40.596968 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8f623-7dd9-43d8-83f1-7f3177d172d1 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:40.597556 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8f623-7dd9-43d8-83f1-7f3177d172d1 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:40.597556 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8f623-7dd9-43d8-83f1-7f3177d172d1 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:40.599322 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 724/1457] 127.0.0.1 () {54 vars in 916 bytes} [Fri Dec 24 04:53:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:53:40.613434 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c2f76-b745-4a53-adb0-43315c746e0b None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:40.613982 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c2f76-b745-4a53-adb0-43315c746e0b None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:40.614093 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c2f76-b745-4a53-adb0-43315c746e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:40.632500 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-a69c2f76-b745-4a53-adb0-43315c746e0b None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:53:40.633736 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-a69c2f76-b745-4a53-adb0-43315c746e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:53:40.642419 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 734/1458] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Dec 24 04:53:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:53:40.680946 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc8f623-7dd9-43d8-83f1-7f3177d172d1 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:53:40.691952 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc8f623-7dd9-43d8-83f1-7f3177d172d1 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:53:40.695897 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63cc853-23f0-4425-9bf1-b9e0284c5e73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:53:40.696545 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63cc853-23f0-4425-9bf1-b9e0284c5e73 service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:40.696909 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63cc853-23f0-4425-9bf1-b9e0284c5e73 service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:40.697178 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63cc853-23f0-4425-9bf1-b9e0284c5e73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:40.706131 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63cc853-23f0-4425-9bf1-b9e0284c5e73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:53:40.707561 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63cc853-23f0-4425-9bf1-b9e0284c5e73 service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:53:40.718093 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 725/1459] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:53:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:53:43.389144 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da6b51-56f7-4be0-b6bc-284e8a4add21 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:43.390062 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da6b51-56f7-4be0-b6bc-284e8a4add21 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:43.390062 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da6b51-56f7-4be0-b6bc-284e8a4add21 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:43.392871 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 735/1460] 127.0.0.1 () {54 vars in 916 bytes} [Fri Dec 24 04:53:43 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:53:43.403037 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d358a9c-1bae-4b8d-bd9a-146a736b7b21 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:43.403553 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d358a9c-1bae-4b8d-bd9a-146a736b7b21 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:43.403664 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d358a9c-1bae-4b8d-bd9a-146a736b7b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:43.425060 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-9d358a9c-1bae-4b8d-bd9a-146a736b7b21 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:53:43.426263 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-9d358a9c-1bae-4b8d-bd9a-146a736b7b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:53:43.436856 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 726/1461] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Dec 24 04:53:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:53:43.477060 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24da6b51-56f7-4be0-b6bc-284e8a4add21 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:53:43.488978 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24da6b51-56f7-4be0-b6bc-284e8a4add21 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:53:43.495595 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32043822-59d6-4282-a3bf-bc837c4c8e00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:53:43.496582 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32043822-59d6-4282-a3bf-bc837c4c8e00 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:43.496990 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32043822-59d6-4282-a3bf-bc837c4c8e00 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:43.497343 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32043822-59d6-4282-a3bf-bc837c4c8e00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:43.509612 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32043822-59d6-4282-a3bf-bc837c4c8e00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:53:43.511041 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32043822-59d6-4282-a3bf-bc837c4c8e00 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:53:43.520487 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 736/1462] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:53:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 24 04:53:46.022523 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38f0e9-2fa1-4a71-9e1e-e9848c09c2f5 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:46.023393 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38f0e9-2fa1-4a71-9e1e-e9848c09c2f5 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:46.023393 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38f0e9-2fa1-4a71-9e1e-e9848c09c2f5 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:46.026338 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 727/1463] 127.0.0.1 () {54 vars in 916 bytes} [Fri Dec 24 04:53:46 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:53:46.033335 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4b10c-f50c-4d5d-a962-d54c33510c1a None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:46.034032 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4b10c-f50c-4d5d-a962-d54c33510c1a None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:46.034217 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4b10c-f50c-4d5d-a962-d54c33510c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:46.060346 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-4af4b10c-f50c-4d5d-a962-d54c33510c1a None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:53:46.061577 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-4af4b10c-f50c-4d5d-a962-d54c33510c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:53:46.071002 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 737/1464] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Dec 24 04:53:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:53:46.116452 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38f0e9-2fa1-4a71-9e1e-e9848c09c2f5 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:53:46.119669 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-0b38f0e9-2fa1-4a71-9e1e-e9848c09c2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:53:46.142365 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38f0e9-2fa1-4a71-9e1e-e9848c09c2f5 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:53:46.147595 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ec713-2227-4734-9691-8f8cd9239387 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:53:46.148231 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ec713-2227-4734-9691-8f8cd9239387 service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:46.148548 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ec713-2227-4734-9691-8f8cd9239387 service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:46.148832 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ec713-2227-4734-9691-8f8cd9239387 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:46.158166 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22ec713-2227-4734-9691-8f8cd9239387 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:53:46.159610 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22ec713-2227-4734-9691-8f8cd9239387 service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:53:46.169044 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 728/1465] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:53:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 24 04:53:48.674410 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcfbda0-cbe2-4f6f-a626-378a1c2f03d4 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:48.675253 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcfbda0-cbe2-4f6f-a626-378a1c2f03d4 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:48.675253 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcfbda0-cbe2-4f6f-a626-378a1c2f03d4 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:48.678454 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 738/1466] 127.0.0.1 () {54 vars in 916 bytes} [Fri Dec 24 04:53:48 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:53:48.688383 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264e2e7-60fa-42fb-b2bc-a035a66a83f3 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:48.688872 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264e2e7-60fa-42fb-b2bc-a035a66a83f3 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:48.688978 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264e2e7-60fa-42fb-b2bc-a035a66a83f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:48.708705 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-7264e2e7-60fa-42fb-b2bc-a035a66a83f3 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:53:48.710228 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-7264e2e7-60fa-42fb-b2bc-a035a66a83f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:53:48.718596 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 729/1467] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Dec 24 04:53:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:53:48.758440 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcfbda0-cbe2-4f6f-a626-378a1c2f03d4 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:53:48.778075 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcfbda0-cbe2-4f6f-a626-378a1c2f03d4 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:53:48.785436 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2f622-5a68-47b6-afa1-a04957459102 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:53:48.786445 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2f622-5a68-47b6-afa1-a04957459102 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:48.786721 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2f622-5a68-47b6-afa1-a04957459102 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:48.786987 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2f622-5a68-47b6-afa1-a04957459102 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:48.796695 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b2f622-5a68-47b6-afa1-a04957459102 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:53:48.798147 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b2f622-5a68-47b6-afa1-a04957459102 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:53:48.808959 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 739/1468] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:53:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:53:51.203734 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112697e-2fc3-4f86-99ff-55073cf82c4f None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:51.204314 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112697e-2fc3-4f86-99ff-55073cf82c4f None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:51.204314 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112697e-2fc3-4f86-99ff-55073cf82c4f None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:51.206123 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 730/1469] 127.0.0.1 () {54 vars in 916 bytes} [Fri Dec 24 04:53:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:53:51.216593 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c25e7-9820-4b80-9333-371361d585fd None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:51.217229 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c25e7-9820-4b80-9333-371361d585fd None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:51.217429 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c25e7-9820-4b80-9333-371361d585fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:51.238028 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-3b4c25e7-9820-4b80-9333-371361d585fd None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:53:51.239541 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-3b4c25e7-9820-4b80-9333-371361d585fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:53:51.248205 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 740/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Dec 24 04:53:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:53:51.286291 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112697e-2fc3-4f86-99ff-55073cf82c4f None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:53:51.297565 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112697e-2fc3-4f86-99ff-55073cf82c4f None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:53:51.301289 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd222fe5-87e5-4e6a-9b2e-e41d007a50e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:53:51.301912 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd222fe5-87e5-4e6a-9b2e-e41d007a50e6 service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:51.302191 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd222fe5-87e5-4e6a-9b2e-e41d007a50e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:51.302470 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd222fe5-87e5-4e6a-9b2e-e41d007a50e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:51.312395 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd222fe5-87e5-4e6a-9b2e-e41d007a50e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:53:51.313924 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd222fe5-87e5-4e6a-9b2e-e41d007a50e6 service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:53:51.324168 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 731/1471] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:53:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 24 04:53:53.752342 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c222ab6-0d57-4a67-b1ae-91818408d2e8 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:53.752973 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c222ab6-0d57-4a67-b1ae-91818408d2e8 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:53.752973 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c222ab6-0d57-4a67-b1ae-91818408d2e8 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:53.755557 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 741/1472] 127.0.0.1 () {54 vars in 916 bytes} [Fri Dec 24 04:53:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:53:53.766129 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240185a-6266-4b0c-925b-ad793214d770 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:53.766850 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240185a-6266-4b0c-925b-ad793214d770 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:53.767019 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240185a-6266-4b0c-925b-ad793214d770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:53.792983 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-1240185a-6266-4b0c-925b-ad793214d770 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:53:53.794215 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-1240185a-6266-4b0c-925b-ad793214d770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:53:53.804331 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 732/1473] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Dec 24 04:53:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:53:53.843062 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c222ab6-0d57-4a67-b1ae-91818408d2e8 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:53:53.855514 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c222ab6-0d57-4a67-b1ae-91818408d2e8 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:53:53.860056 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81c962-a322-46f8-a954-7af08ad80c87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:53:53.860739 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81c962-a322-46f8-a954-7af08ad80c87 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:53.861037 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81c962-a322-46f8-a954-7af08ad80c87 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:53.861309 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81c962-a322-46f8-a954-7af08ad80c87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:53.870971 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc81c962-a322-46f8-a954-7af08ad80c87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:53:53.872397 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc81c962-a322-46f8-a954-7af08ad80c87 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:53:53.881918 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 742/1474] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:53:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:53:56.295244 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c9ecf-a3cc-43a3-891a-45dbf5630ccb None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:56.296176 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c9ecf-a3cc-43a3-891a-45dbf5630ccb None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:56.296176 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c9ecf-a3cc-43a3-891a-45dbf5630ccb None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:56.299004 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 733/1475] 127.0.0.1 () {54 vars in 916 bytes} [Fri Dec 24 04:53:56 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:53:56.305430 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9199c87-56f5-482e-a755-1889c0b16523 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:56.305922 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9199c87-56f5-482e-a755-1889c0b16523 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:56.305922 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9199c87-56f5-482e-a755-1889c0b16523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:56.325628 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-d9199c87-56f5-482e-a755-1889c0b16523 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:53:56.326838 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-d9199c87-56f5-482e-a755-1889c0b16523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:53:56.336055 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 743/1476] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Dec 24 04:53:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:53:56.374277 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c9ecf-a3cc-43a3-891a-45dbf5630ccb None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:53:56.385706 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c9ecf-a3cc-43a3-891a-45dbf5630ccb None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:53:56.391621 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c34a2-4e68-4610-b08c-dd75836deb97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:53:56.392752 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c34a2-4e68-4610-b08c-dd75836deb97 service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:56.393409 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c34a2-4e68-4610-b08c-dd75836deb97 service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:56.393899 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c34a2-4e68-4610-b08c-dd75836deb97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:56.405316 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3c34a2-4e68-4610-b08c-dd75836deb97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:53:56.406759 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3c34a2-4e68-4610-b08c-dd75836deb97 service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:53:56.416797 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 734/1477] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:53:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:53:58.791975 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914f16d-6537-44f6-bdfc-27d4c025606d None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:58.792606 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914f16d-6537-44f6-bdfc-27d4c025606d None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:58.792606 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914f16d-6537-44f6-bdfc-27d4c025606d None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:58.795627 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 744/1478] 127.0.0.1 () {54 vars in 916 bytes} [Fri Dec 24 04:53:58 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:53:58.802934 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f0c66-ea46-492a-9463-7546badf939f None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:58.803425 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f0c66-ea46-492a-9463-7546badf939f None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:58.803558 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f0c66-ea46-492a-9463-7546badf939f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:58.823335 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-ad7f0c66-ea46-492a-9463-7546badf939f None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:53:58.824557 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-ad7f0c66-ea46-492a-9463-7546badf939f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:53:58.840657 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 735/1479] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Dec 24 04:53:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:53:58.876770 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1914f16d-6537-44f6-bdfc-27d4c025606d None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:53:58.891693 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1914f16d-6537-44f6-bdfc-27d4c025606d None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:53:58.896871 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd927f6-0657-4e61-95e2-113d9418f4f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:53:58.897656 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd927f6-0657-4e61-95e2-113d9418f4f2 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:53:58.898021 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd927f6-0657-4e61-95e2-113d9418f4f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:53:58.898344 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd927f6-0657-4e61-95e2-113d9418f4f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:53:58.908833 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd927f6-0657-4e61-95e2-113d9418f4f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:53:58.910496 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd927f6-0657-4e61-95e2-113d9418f4f2 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:53:58.921426 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 745/1480] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:53:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:54:01.298579 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee666870-9cbf-4099-a53d-6b031c8cfd5a None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:54:01.299549 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee666870-9cbf-4099-a53d-6b031c8cfd5a None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:54:01.299549 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee666870-9cbf-4099-a53d-6b031c8cfd5a None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:54:01.302365 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 736/1481] 127.0.0.1 () {54 vars in 916 bytes} [Fri Dec 24 04:54:01 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:54:01.312148 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b53637-cad1-4571-9db6-fffefee4af8b None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:54:01.312643 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b53637-cad1-4571-9db6-fffefee4af8b None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:54:01.312845 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b53637-cad1-4571-9db6-fffefee4af8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:54:01.334060 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-83b53637-cad1-4571-9db6-fffefee4af8b None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:54:01.335582 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-83b53637-cad1-4571-9db6-fffefee4af8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:54:01.345545 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 746/1482] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Dec 24 04:54:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:54:01.383813 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee666870-9cbf-4099-a53d-6b031c8cfd5a None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:54:01.397180 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee666870-9cbf-4099-a53d-6b031c8cfd5a None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:54:01.401308 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401f7426-6d6b-4f3b-9ec6-2d294f940c04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:54:01.401941 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f7426-6d6b-4f3b-9ec6-2d294f940c04 service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:54:01.402229 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f7426-6d6b-4f3b-9ec6-2d294f940c04 service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:54:01.402499 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f7426-6d6b-4f3b-9ec6-2d294f940c04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:54:01.414713 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401f7426-6d6b-4f3b-9ec6-2d294f940c04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:54:01.416159 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401f7426-6d6b-4f3b-9ec6-2d294f940c04 service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:54:01.425771 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 737/1483] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:54:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:54:18.522010 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7dc79f-cc69-479d-aabe-074420bc19a8 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:54:18.522970 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7dc79f-cc69-479d-aabe-074420bc19a8 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:54:18.522970 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7dc79f-cc69-479d-aabe-074420bc19a8 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:54:18.525970 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 747/1484] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:54:18 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:54:18.531904 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30aa8a-0323-48be-ae11-993b9eec4e1c None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:54:18.532355 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30aa8a-0323-48be-ae11-993b9eec4e1c None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:54:18.532456 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30aa8a-0323-48be-ae11-993b9eec4e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:54:18.551579 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-0d30aa8a-0323-48be-ae11-993b9eec4e1c None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:54:18.552807 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-0d30aa8a-0323-48be-ae11-993b9eec4e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:54:18.561128 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 738/1485] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:54:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:54:18.620785 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36e0a0-1fa8-4809-96ed-9e99053998dd None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:54:18.621069 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36e0a0-1fa8-4809-96ed-9e99053998dd None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:54:18.621504 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36e0a0-1fa8-4809-96ed-9e99053998dd None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:54:18.624144 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 748/1486] 10.222.0.43 () {54 vars in 962 bytes} [Fri Dec 24 04:54:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:54:18.633019 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de0da9-cf52-42db-ae22-117840753a93 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:54:18.633379 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de0da9-cf52-42db-ae22-117840753a93 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:54:18.633676 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de0da9-cf52-42db-ae22-117840753a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:54:18.661043 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-05de0da9-cf52-42db-ae22-117840753a93 None None] MFA Rules not processed for user `c1782324ce854868bd11b32bd24b435c`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:54:18.662248 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-05de0da9-cf52-42db-ae22-117840753a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:54:18.673326 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 739/1487] 10.222.0.43 () {58 vars in 1059 bytes} [Fri Dec 24 04:54:18 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:54:18.682489 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36e0a0-1fa8-4809-96ed-9e99053998dd None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:54:18.698246 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36e0a0-1fa8-4809-96ed-9e99053998dd None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:54:18.703112 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089bfacc-2db8-450a-9e76-2b2abb266454 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1782324ce854868bd11b32bd24b435c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:54:18.703743 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089bfacc-2db8-450a-9e76-2b2abb266454 service glance] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:54:18.704023 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089bfacc-2db8-450a-9e76-2b2abb266454 service glance] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:54:18.704290 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089bfacc-2db8-450a-9e76-2b2abb266454 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:54:18.714059 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089bfacc-2db8-450a-9e76-2b2abb266454 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:54:18.715486 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089bfacc-2db8-450a-9e76-2b2abb266454 service glance] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:54:18.724862 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 749/1488] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:54:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:54:21.131776 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244e410-09f7-43c4-a1cd-0bfd244484f7 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:54:21.132388 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244e410-09f7-43c4-a1cd-0bfd244484f7 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:54:21.132388 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244e410-09f7-43c4-a1cd-0bfd244484f7 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:54:21.134144 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 740/1489] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:54:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:54:21.143480 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5299d-19cd-4b3c-8adb-42c759a2674f None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:54:21.144183 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5299d-19cd-4b3c-8adb-42c759a2674f None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:54:21.144445 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5299d-19cd-4b3c-8adb-42c759a2674f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:54:21.165336 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-03e5299d-19cd-4b3c-8adb-42c759a2674f None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:54:21.166535 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-03e5299d-19cd-4b3c-8adb-42c759a2674f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:54:21.176808 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 750/1490] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:54:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:54:21.201625 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a244e410-09f7-43c4-a1cd-0bfd244484f7 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:54:21.217109 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a244e410-09f7-43c4-a1cd-0bfd244484f7 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:54:21.221986 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf369ba-4b95-46a8-a514-f7c8cd8b1c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:54:21.222747 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf369ba-4b95-46a8-a514-f7c8cd8b1c1d admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:54:21.223106 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf369ba-4b95-46a8-a514-f7c8cd8b1c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:54:21.223386 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf369ba-4b95-46a8-a514-f7c8cd8b1c1d admin admin] PATH_INFO: `/v3/projects` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:54:21.224134 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf369ba-4b95-46a8-a514-f7c8cd8b1c1d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:54:21.226034 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf369ba-4b95-46a8-a514-f7c8cd8b1c1d admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:54:21.239635 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 741/1491] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Dec 24 04:54:21 2021] GET /identity/v3/projects => generated 2553 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 04:54:23.610863 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da87586-f34b-4f8a-9f83-8e3243a0987f None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:54:23.611462 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da87586-f34b-4f8a-9f83-8e3243a0987f None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:54:23.611462 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da87586-f34b-4f8a-9f83-8e3243a0987f None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:54:23.613339 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 751/1492] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:54:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:54:23.620402 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e549c594-71ea-4e18-b4b7-4b4af4a54360 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:54:23.620880 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e549c594-71ea-4e18-b4b7-4b4af4a54360 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:54:23.620992 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e549c594-71ea-4e18-b4b7-4b4af4a54360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:54:23.645999 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-e549c594-71ea-4e18-b4b7-4b4af4a54360 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:54:23.647257 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-e549c594-71ea-4e18-b4b7-4b4af4a54360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:54:23.655764 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 742/1493] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:54:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:54:23.699945 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da87586-f34b-4f8a-9f83-8e3243a0987f None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:54:23.722574 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da87586-f34b-4f8a-9f83-8e3243a0987f None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:54:23.730114 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a6f2f-33f4-4532-8ce3-6695fd1c9ae0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f9ad1e8f8f74edcb44aabe17eb59648', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:54:23.730772 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a6f2f-33f4-4532-8ce3-6695fd1c9ae0 service nova] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:54:23.731049 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a6f2f-33f4-4532-8ce3-6695fd1c9ae0 service nova] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:54:23.731314 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a6f2f-33f4-4532-8ce3-6695fd1c9ae0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:54:23.740315 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2a6f2f-33f4-4532-8ce3-6695fd1c9ae0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:54:23.741943 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2a6f2f-33f4-4532-8ce3-6695fd1c9ae0 service nova] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:54:23.751609 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 752/1494] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:54:23 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:54:26.263592 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a147b6d-ddc0-4c77-bf83-769a8e50bb2e None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:54:26.264191 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a147b6d-ddc0-4c77-bf83-769a8e50bb2e None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:54:26.264191 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a147b6d-ddc0-4c77-bf83-769a8e50bb2e None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:54:26.267012 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 743/1495] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:54:26 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:54:26.275904 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b1f44-d6db-4c32-a939-7e80bdf87bcd None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:54:26.276392 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b1f44-d6db-4c32-a939-7e80bdf87bcd None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:54:26.276517 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b1f44-d6db-4c32-a939-7e80bdf87bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:54:26.295566 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-ea8b1f44-d6db-4c32-a939-7e80bdf87bcd None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:54:26.296779 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-ea8b1f44-d6db-4c32-a939-7e80bdf87bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:54:26.305278 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 753/1496] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:54:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 04:54:26.342232 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a147b6d-ddc0-4c77-bf83-769a8e50bb2e None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:54:26.354680 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a147b6d-ddc0-4c77-bf83-769a8e50bb2e None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:54:26.358524 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a01de-fa79-4c9e-974d-4c546f261208 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:54:26.359163 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a01de-fa79-4c9e-974d-4c546f261208 service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:54:26.359447 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a01de-fa79-4c9e-974d-4c546f261208 service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:54:26.359721 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a01de-fa79-4c9e-974d-4c546f261208 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:54:26.369338 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4a01de-fa79-4c9e-974d-4c546f261208 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:54:26.370785 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4a01de-fa79-4c9e-974d-4c546f261208 service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:54:26.381984 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 744/1497] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:54:26 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:54:28.811469 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1290b-21b2-4bc3-bec4-6bf420aded1e None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:54:28.812055 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1290b-21b2-4bc3-bec4-6bf420aded1e None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:54:28.812055 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1290b-21b2-4bc3-bec4-6bf420aded1e None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:54:28.814897 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 754/1498] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:54:28 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:54:28.824137 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7abe8-b071-45a3-8868-8b5db203cdf8 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:54:28.824600 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7abe8-b071-45a3-8868-8b5db203cdf8 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:54:28.824705 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7abe8-b071-45a3-8868-8b5db203cdf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:54:28.844660 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-49f7abe8-b071-45a3-8868-8b5db203cdf8 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:54:28.845812 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-49f7abe8-b071-45a3-8868-8b5db203cdf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:54:28.855535 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 745/1499] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:54:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:54:28.894465 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c1290b-21b2-4bc3-bec4-6bf420aded1e None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:54:28.909131 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c1290b-21b2-4bc3-bec4-6bf420aded1e None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:54:28.914829 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564fa6a0-d480-461c-a460-0407a0b6cdc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:54:28.915463 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564fa6a0-d480-461c-a460-0407a0b6cdc5 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:54:28.915749 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564fa6a0-d480-461c-a460-0407a0b6cdc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:54:28.916020 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564fa6a0-d480-461c-a460-0407a0b6cdc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:54:28.926446 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564fa6a0-d480-461c-a460-0407a0b6cdc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:54:28.927888 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564fa6a0-d480-461c-a460-0407a0b6cdc5 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:54:28.937343 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 755/1500] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:54:28 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 24 04:54:31.512403 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13f164-159f-48d4-915c-c5c0bef34b7b None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:54:31.512979 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13f164-159f-48d4-915c-c5c0bef34b7b None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:54:31.513073 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13f164-159f-48d4-915c-c5c0bef34b7b None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:54:31.515499 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 746/1501] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:54:31 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:54:31.524729 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0478b1e-37cb-446c-b125-357f70113dba None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:54:31.525169 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0478b1e-37cb-446c-b125-357f70113dba None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:54:31.525448 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0478b1e-37cb-446c-b125-357f70113dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:54:31.549065 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-d0478b1e-37cb-446c-b125-357f70113dba None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:54:31.550588 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-d0478b1e-37cb-446c-b125-357f70113dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:54:31.560877 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 756/1502] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:54:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:54:31.605882 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13f164-159f-48d4-915c-c5c0bef34b7b None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:54:31.619631 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13f164-159f-48d4-915c-c5c0bef34b7b None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:54:31.624946 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3c20b-bc1c-4bff-ad75-315acb5e28eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:54:31.625795 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3c20b-bc1c-4bff-ad75-315acb5e28eb admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:54:31.626071 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3c20b-bc1c-4bff-ad75-315acb5e28eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:54:31.626345 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3c20b-bc1c-4bff-ad75-315acb5e28eb admin admin] PATH_INFO: `/v3/projects/49af853a7d674e84987f8788493d4239` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:54:31.627660 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf3c20b-bc1c-4bff-ad75-315acb5e28eb admin admin] RBAC: Authorizing `identity:get_project(project_id=49af853a7d674e84987f8788493d4239)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:54:31.629980 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf3c20b-bc1c-4bff-ad75-315acb5e28eb admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:54:31.631527 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 747/1503] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:54:31 2021] GET /identity/v3/projects/49af853a7d674e84987f8788493d4239 => generated 344 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:54:31.646939 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0478b1e-37cb-446c-b125-357f70113dba None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:54:31.656341 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0478b1e-37cb-446c-b125-357f70113dba None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:54:31.660652 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d128f56d-a069-47d9-9ebd-58de5df131b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:54:31.661322 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128f56d-a069-47d9-9ebd-58de5df131b2 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:54:31.661597 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128f56d-a069-47d9-9ebd-58de5df131b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:54:31.661863 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128f56d-a069-47d9-9ebd-58de5df131b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:54:31.671674 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d128f56d-a069-47d9-9ebd-58de5df131b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:54:31.673148 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d128f56d-a069-47d9-9ebd-58de5df131b2 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:54:31.685543 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 757/1504] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:54:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:54:34.242901 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5087ede-6b9b-47bc-bde3-8cb2a7f6f936 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:54:34.243787 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5087ede-6b9b-47bc-bde3-8cb2a7f6f936 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:54:34.243787 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5087ede-6b9b-47bc-bde3-8cb2a7f6f936 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:54:34.246707 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 748/1505] 10.222.0.43 () {54 vars in 926 bytes} [Fri Dec 24 04:54:34 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:54:34.256492 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e021752-463d-4767-9ec9-36a018051362 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:54:34.257004 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e021752-463d-4767-9ec9-36a018051362 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:54:34.257120 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e021752-463d-4767-9ec9-36a018051362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:54:34.284651 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-4e021752-463d-4767-9ec9-36a018051362 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:54:34.285921 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-4e021752-463d-4767-9ec9-36a018051362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:54:34.294980 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 758/1506] 10.222.0.43 () {58 vars in 1023 bytes} [Fri Dec 24 04:54:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:54:34.329918 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5087ede-6b9b-47bc-bde3-8cb2a7f6f936 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:54:34.344949 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5087ede-6b9b-47bc-bde3-8cb2a7f6f936 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:54:34.350695 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a8a00-1376-4739-947d-d61f21e71e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:54:34.351934 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a8a00-1376-4739-947d-d61f21e71e02 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:54:34.352261 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a8a00-1376-4739-947d-d61f21e71e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:54:34.352556 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a8a00-1376-4739-947d-d61f21e71e02 admin admin] PATH_INFO: `/v3/projects/49af853a7d674e84987f8788493d4239` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:54:34.354587 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148a8a00-1376-4739-947d-d61f21e71e02 admin admin] RBAC: Authorizing `identity:get_project(project_id=49af853a7d674e84987f8788493d4239)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:54:34.357487 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148a8a00-1376-4739-947d-d61f21e71e02 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:54:34.359992 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 749/1507] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Dec 24 04:54:34 2021] GET /identity/v3/projects/49af853a7d674e84987f8788493d4239 => generated 344 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:54:34.375332 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e021752-463d-4767-9ec9-36a018051362 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:54:34.386966 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e021752-463d-4767-9ec9-36a018051362 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:54:34.391600 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50099b0-865a-4169-8bd8-affa7380b54e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:54:34.392240 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50099b0-865a-4169-8bd8-affa7380b54e service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:54:34.392512 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50099b0-865a-4169-8bd8-affa7380b54e service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:54:34.392811 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50099b0-865a-4169-8bd8-affa7380b54e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:54:34.402938 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50099b0-865a-4169-8bd8-affa7380b54e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:54:34.404357 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50099b0-865a-4169-8bd8-affa7380b54e service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:54:34.413803 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 759/1508] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:54:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:55:47.542680 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5e9a9-4a96-4cfb-82af-24043d12fe99 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:55:47.543324 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5e9a9-4a96-4cfb-82af-24043d12fe99 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:55:47.543324 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5e9a9-4a96-4cfb-82af-24043d12fe99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:55:47.562224 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-3fb5e9a9-4a96-4cfb-82af-24043d12fe99 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:55:47.563433 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-3fb5e9a9-4a96-4cfb-82af-24043d12fe99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:55:47.572626 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 750/1509] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:55:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:55:47.581024 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841dc6f5-87d4-4871-a5d5-6d48a1edcc20 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:55:47.581560 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841dc6f5-87d4-4871-a5d5-6d48a1edcc20 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:55:47.581560 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841dc6f5-87d4-4871-a5d5-6d48a1edcc20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:55:47.600985 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-841dc6f5-87d4-4871-a5d5-6d48a1edcc20 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:55:47.602170 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-841dc6f5-87d4-4871-a5d5-6d48a1edcc20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:55:47.613629 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 760/1510] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:55:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:55:47.618876 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb5e9a9-4a96-4cfb-82af-24043d12fe99 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:55:47.634350 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb5e9a9-4a96-4cfb-82af-24043d12fe99 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:55:47.642956 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b649ff-7f63-4198-ba8d-ab11a27c3827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:55:47.643824 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b649ff-7f63-4198-ba8d-ab11a27c3827 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:55:47.644108 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b649ff-7f63-4198-ba8d-ab11a27c3827 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:55:47.644380 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b649ff-7f63-4198-ba8d-ab11a27c3827 admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:55:47.645166 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b649ff-7f63-4198-ba8d-ab11a27c3827 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:55:47.645470 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b649ff-7f63-4198-ba8d-ab11a27c3827 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:55:47.647087 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b649ff-7f63-4198-ba8d-ab11a27c3827 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:55:47.659229 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 751/1511] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 04:55:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:55:47.667543 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841dc6f5-87d4-4871-a5d5-6d48a1edcc20 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:55:47.678185 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841dc6f5-87d4-4871-a5d5-6d48a1edcc20 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:55:47.687086 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf94bc3-87a6-4cd8-9d6b-be4ecd191db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:55:47.688000 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf94bc3-87a6-4cd8-9d6b-be4ecd191db5 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:55:47.688365 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf94bc3-87a6-4cd8-9d6b-be4ecd191db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:55:47.688767 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf94bc3-87a6-4cd8-9d6b-be4ecd191db5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:55:47.689901 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf94bc3-87a6-4cd8-9d6b-be4ecd191db5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:55:47.691847 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf94bc3-87a6-4cd8-9d6b-be4ecd191db5 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:55:47.733159 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 761/1512] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 04:55:47 2021] POST /identity/v3/projects => generated 377 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:55:47.737800 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b649ff-7f63-4198-ba8d-ab11a27c3827 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:55:47.748493 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b649ff-7f63-4198-ba8d-ab11a27c3827 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:55:47.806551 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d247bb4-7923-4382-a6bb-ce4758ec4e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:55:47.807252 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d247bb4-7923-4382-a6bb-ce4758ec4e82 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:55:47.807569 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d247bb4-7923-4382-a6bb-ce4758ec4e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:55:47.807844 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d247bb4-7923-4382-a6bb-ce4758ec4e82 admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:55:47.808600 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d247bb4-7923-4382-a6bb-ce4758ec4e82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:55:47.810710 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d247bb4-7923-4382-a6bb-ce4758ec4e82 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:55:47.835613 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 752/1513] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 04:55:47 2021] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:55:47.841300 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf94bc3-87a6-4cd8-9d6b-be4ecd191db5 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:55:47.854423 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf94bc3-87a6-4cd8-9d6b-be4ecd191db5 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:55:47.860311 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d9722-f774-4465-b74f-1215e91d2633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:55:47.861010 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d9722-f774-4465-b74f-1215e91d2633 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:55:47.861306 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d9722-f774-4465-b74f-1215e91d2633 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:55:47.861627 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d9722-f774-4465-b74f-1215e91d2633 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:55:47.862424 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875d9722-f774-4465-b74f-1215e91d2633 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:55:47.864036 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875d9722-f774-4465-b74f-1215e91d2633 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:55:47.877522 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 762/1514] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 04:55:47 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 04:55:47.883171 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d247bb4-7923-4382-a6bb-ce4758ec4e82 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:55:47.894123 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d247bb4-7923-4382-a6bb-ce4758ec4e82 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:55:47.900716 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73de5c9b-a8ff-4d84-8a06-0b2c095f140b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:55:47.901625 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de5c9b-a8ff-4d84-8a06-0b2c095f140b admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:55:47.902036 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de5c9b-a8ff-4d84-8a06-0b2c095f140b admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:55:47.902448 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de5c9b-a8ff-4d84-8a06-0b2c095f140b admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:55:47.903597 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73de5c9b-a8ff-4d84-8a06-0b2c095f140b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:55:47.906201 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73de5c9b-a8ff-4d84-8a06-0b2c095f140b admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:55:47.921826 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 753/1515] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 04:55:47 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 04:55:47.926066 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d9722-f774-4465-b74f-1215e91d2633 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:55:47.941726 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d9722-f774-4465-b74f-1215e91d2633 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:55:47.947409 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21440f6-0ad1-4cd7-a7c5-114609379b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:55:47.948296 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21440f6-0ad1-4cd7-a7c5-114609379b7c admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:55:47.948586 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21440f6-0ad1-4cd7-a7c5-114609379b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:55:47.948862 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21440f6-0ad1-4cd7-a7c5-114609379b7c admin admin] PATH_INFO: `/v3/projects/49be79bb597e49ef9ef9e84a0b33641a/users/05bd5f42e8de40cf9d43804fd226d646/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:55:47.965016 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21440f6-0ad1-4cd7-a7c5-114609379b7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=49be79bb597e49ef9ef9e84a0b33641a, user_id=05bd5f42e8de40cf9d43804fd226d646, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:55:47.967675 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21440f6-0ad1-4cd7-a7c5-114609379b7c admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:55:47.983528 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 763/1516] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 04:55:47 2021] PUT /identity/v3/projects/49be79bb597e49ef9ef9e84a0b33641a/users/05bd5f42e8de40cf9d43804fd226d646/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 04:55:47.995803 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633d527-427b-401f-8408-256ab3f6241a None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:55:47.996163 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633d527-427b-401f-8408-256ab3f6241a None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:55:47.996576 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633d527-427b-401f-8408-256ab3f6241a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:55:48.025782 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-0633d527-427b-401f-8408-256ab3f6241a None None] MFA Rules not processed for user `05bd5f42e8de40cf9d43804fd226d646`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:55:48.026994 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-0633d527-427b-401f-8408-256ab3f6241a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:55:48.101012 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 754/1517] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:55:47 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:55:48.114502 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21440f6-0ad1-4cd7-a7c5-114609379b7c admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:55:48.200315 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21440f6-0ad1-4cd7-a7c5-114609379b7c admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:55:48.207368 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f646fc74-8391-4578-9151-eec1f9004231 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f9ad1e8f8f74edcb44aabe17eb59648', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:55:48.208023 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646fc74-8391-4578-9151-eec1f9004231 service nova] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:55:48.208280 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646fc74-8391-4578-9151-eec1f9004231 service nova] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:55:48.208552 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646fc74-8391-4578-9151-eec1f9004231 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:55:48.220145 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f646fc74-8391-4578-9151-eec1f9004231 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:55:48.222083 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f646fc74-8391-4578-9151-eec1f9004231 service nova] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:55:48.233398 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 764/1518] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:55:48 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:55:48.305419 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4963d8f-5e86-4670-b74c-7d37355b0a40 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:55:48.305694 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4963d8f-5e86-4670-b74c-7d37355b0a40 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:55:48.305965 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4963d8f-5e86-4670-b74c-7d37355b0a40 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:55:48.307748 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 755/1519] 10.222.0.43 () {52 vars in 829 bytes} [Fri Dec 24 04:55:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:55:48.311666 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f646fc74-8391-4578-9151-eec1f9004231 service nova] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:55:48.373800 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f646fc74-8391-4578-9151-eec1f9004231 service nova] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:55:48.379162 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919a664-e899-42b2-a83b-59373c63df76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:55:48.380024 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919a664-e899-42b2-a83b-59373c63df76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:55:48.380296 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919a664-e899-42b2-a83b-59373c63df76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:55:48.380560 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919a664-e899-42b2-a83b-59373c63df76 admin admin] PATH_INFO: `/v3/users/05bd5f42e8de40cf9d43804fd226d646` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:55:48.381891 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6919a664-e899-42b2-a83b-59373c63df76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05bd5f42e8de40cf9d43804fd226d646)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:55:48.382914 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING py.warnings [None req-6919a664-e899-42b2-a83b-59373c63df76 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:55:48.382914 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: warnings.warn(msg) Dec 24 04:55:48.382914 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: Dec 24 04:55:48.384127 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6919a664-e899-42b2-a83b-59373c63df76 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:55:48.450330 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-6919a664-e899-42b2-a83b-59373c63df76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05bd5f42e8de40cf9d43804fd226d646'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:55:48.451007 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-6919a664-e899-42b2-a83b-59373c63df76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05bd5f42e8de40cf9d43804fd226d646'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:55:48.462160 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-6919a664-e899-42b2-a83b-59373c63df76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05bd5f42e8de40cf9d43804fd226d646'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:55:48.475367 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-6919a664-e899-42b2-a83b-59373c63df76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05bd5f42e8de40cf9d43804fd226d646'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:55:48.499877 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-6919a664-e899-42b2-a83b-59373c63df76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05bd5f42e8de40cf9d43804fd226d646'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:55:48.506889 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 765/1520] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 04:55:48 2021] DELETE /identity/v3/users/05bd5f42e8de40cf9d43804fd226d646 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:55:48.511484 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699bead6-a8b8-4738-acea-71b6c5f6e281 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:55:48.511775 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699bead6-a8b8-4738-acea-71b6c5f6e281 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:55:48.512043 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699bead6-a8b8-4738-acea-71b6c5f6e281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:55:48.530374 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-699bead6-a8b8-4738-acea-71b6c5f6e281 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:55:48.531564 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-699bead6-a8b8-4738-acea-71b6c5f6e281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:55:48.588206 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 756/1521] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:55:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:55:48.598140 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919a664-e899-42b2-a83b-59373c63df76 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:55:48.599819 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-6919a664-e899-42b2-a83b-59373c63df76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:55:48.667068 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919a664-e899-42b2-a83b-59373c63df76 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:55:48.672060 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc874c-9dac-4676-b06d-ad665be293f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:55:48.672739 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc874c-9dac-4676-b06d-ad665be293f4 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:55:48.673017 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc874c-9dac-4676-b06d-ad665be293f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:55:48.673285 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc874c-9dac-4676-b06d-ad665be293f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:55:48.683007 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adc874c-9dac-4676-b06d-ad665be293f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:55:48.684446 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adc874c-9dac-4676-b06d-ad665be293f4 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:55:48.693966 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 766/1522] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:55:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:55:49.049260 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699bead6-a8b8-4738-acea-71b6c5f6e281 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:55:49.050749 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-699bead6-a8b8-4738-acea-71b6c5f6e281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:55:49.062557 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699bead6-a8b8-4738-acea-71b6c5f6e281 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:55:49.069031 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e8bbf-1690-45e1-b14f-31aabe249e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:55:49.069900 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e8bbf-1690-45e1-b14f-31aabe249e0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:55:49.070178 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e8bbf-1690-45e1-b14f-31aabe249e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:55:49.070443 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e8bbf-1690-45e1-b14f-31aabe249e0a admin admin] PATH_INFO: `/v3/projects/49be79bb597e49ef9ef9e84a0b33641a` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:55:49.071723 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0e8bbf-1690-45e1-b14f-31aabe249e0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=49be79bb597e49ef9ef9e84a0b33641a)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:55:49.072834 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING py.warnings [None req-6c0e8bbf-1690-45e1-b14f-31aabe249e0a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:55:49.072834 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: warnings.warn(msg) Dec 24 04:55:49.072834 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: Dec 24 04:55:49.074038 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0e8bbf-1690-45e1-b14f-31aabe249e0a admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:55:49.135789 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-6c0e8bbf-1690-45e1-b14f-31aabe249e0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49be79bb597e49ef9ef9e84a0b33641a', 'request_id': 'req-6c0e8bbf-1690-45e1-b14f-31aabe249e0a'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:55:49.145798 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-6c0e8bbf-1690-45e1-b14f-31aabe249e0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49be79bb597e49ef9ef9e84a0b33641a', 'request_id': 'req-6c0e8bbf-1690-45e1-b14f-31aabe249e0a'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:55:49.152118 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-6c0e8bbf-1690-45e1-b14f-31aabe249e0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49be79bb597e49ef9ef9e84a0b33641a', 'request_id': 'req-6c0e8bbf-1690-45e1-b14f-31aabe249e0a'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:55:49.170510 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-6c0e8bbf-1690-45e1-b14f-31aabe249e0a admin admin] The token cache is being invalidate because project 49be79bb597e49ef9ef9e84a0b33641a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 04:55:49.170795 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-6c0e8bbf-1690-45e1-b14f-31aabe249e0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:55:49.171559 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-6c0e8bbf-1690-45e1-b14f-31aabe249e0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:55:49.173314 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 757/1523] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 04:55:49 2021] DELETE /identity/v3/projects/49be79bb597e49ef9ef9e84a0b33641a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:57:13.891600 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b894c93-f594-44fd-9d41-66c0ac6a5fd9 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:57:13.892685 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b894c93-f594-44fd-9d41-66c0ac6a5fd9 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:57:13.892685 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b894c93-f594-44fd-9d41-66c0ac6a5fd9 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:57:13.895721 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 767/1524] 127.0.0.1 () {54 vars in 901 bytes} [Fri Dec 24 04:57:13 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:57:13.902349 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01a688-9e10-4ef0-922b-b7363e2fd2f9 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:57:13.903172 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01a688-9e10-4ef0-922b-b7363e2fd2f9 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:57:13.903172 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01a688-9e10-4ef0-922b-b7363e2fd2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:57:13.924694 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-1e01a688-9e10-4ef0-922b-b7363e2fd2f9 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:57:13.925906 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-1e01a688-9e10-4ef0-922b-b7363e2fd2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:57:13.991358 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 758/1525] 127.0.0.1 () {58 vars in 998 bytes} [Fri Dec 24 04:57:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:57:14.159579 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b894c93-f594-44fd-9d41-66c0ac6a5fd9 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:57:14.161439 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-5b894c93-f594-44fd-9d41-66c0ac6a5fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:57:14.232560 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce3146-7a65-4806-893d-5947edea7e64 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:57:14.232818 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce3146-7a65-4806-893d-5947edea7e64 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:57:14.233096 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce3146-7a65-4806-893d-5947edea7e64 None None] PATH_INFO: `/v3` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:57:14.234389 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 759/1526] 10.222.0.46 () {54 vars in 925 bytes} [Fri Dec 24 04:57:14 2021] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:57:14.242386 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bfb926-83aa-4024-a11a-066e85f70d0c None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:57:14.242793 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bfb926-83aa-4024-a11a-066e85f70d0c None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:57:14.243142 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bfb926-83aa-4024-a11a-066e85f70d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:57:14.255464 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b894c93-f594-44fd-9d41-66c0ac6a5fd9 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:57:14.261740 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-69bfb926-83aa-4024-a11a-066e85f70d0c None None] MFA Rules not processed for user `430d6177e74c4dbda7fb83d04c75617e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:57:14.261913 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f4605-38e6-4e6c-bfd3-1bb911c25d2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f9ad1e8f8f74edcb44aabe17eb59648', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:57:14.262552 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f4605-38e6-4e6c-bfd3-1bb911c25d2d service nova] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:57:14.262891 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f4605-38e6-4e6c-bfd3-1bb911c25d2d service nova] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:57:14.263046 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-69bfb926-83aa-4024-a11a-066e85f70d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:57:14.263154 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f4605-38e6-4e6c-bfd3-1bb911c25d2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:57:14.272206 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f4605-38e6-4e6c-bfd3-1bb911c25d2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:57:14.273826 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f4605-38e6-4e6c-bfd3-1bb911c25d2d service nova] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:57:14.283568 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 768/1527] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:57:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:57:14.335251 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 760/1528] 10.222.0.46 () {58 vars in 1015 bytes} [Fri Dec 24 04:57:14 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:57:15.805833 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4b9a6-9b88-4ba5-9ebd-4d1e71f8a47d None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:57:15.806415 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4b9a6-9b88-4ba5-9ebd-4d1e71f8a47d None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:57:15.806415 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4b9a6-9b88-4ba5-9ebd-4d1e71f8a47d None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:57:15.808207 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 769/1529] 127.0.0.1 () {54 vars in 901 bytes} [Fri Dec 24 04:57:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:57:15.814732 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ea322-3974-44f8-814a-2595ca413c86 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:57:15.815461 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ea322-3974-44f8-814a-2595ca413c86 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:57:15.815653 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ea322-3974-44f8-814a-2595ca413c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:57:15.840163 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-ca0ea322-3974-44f8-814a-2595ca413c86 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:57:15.841421 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-ca0ea322-3974-44f8-814a-2595ca413c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:57:15.850111 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 761/1530] 127.0.0.1 () {58 vars in 998 bytes} [Fri Dec 24 04:57:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:57:16.007631 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4b9a6-9b88-4ba5-9ebd-4d1e71f8a47d None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:57:16.028721 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4b9a6-9b88-4ba5-9ebd-4d1e71f8a47d None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:57:16.036700 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb5763-7951-4b94-a1f8-0f1fc477cd01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f9ad1e8f8f74edcb44aabe17eb59648', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:57:16.037519 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb5763-7951-4b94-a1f8-0f1fc477cd01 service nova] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:57:16.038937 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb5763-7951-4b94-a1f8-0f1fc477cd01 service nova] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:57:16.040165 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb5763-7951-4b94-a1f8-0f1fc477cd01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:57:16.050693 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb5763-7951-4b94-a1f8-0f1fc477cd01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:57:16.052658 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb5763-7951-4b94-a1f8-0f1fc477cd01 service nova] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:57:16.062511 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 770/1531] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:57:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:57:23.041721 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01916c-0230-42b2-91f3-e13039ebd728 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:57:23.042214 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01916c-0230-42b2-91f3-e13039ebd728 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:57:23.042308 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01916c-0230-42b2-91f3-e13039ebd728 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:57:23.044077 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 762/1532] 10.222.0.43 () {54 vars in 960 bytes} [Fri Dec 24 04:57:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:57:23.050507 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674cac8-980c-49c2-a983-15110eee020c None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:57:23.050926 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674cac8-980c-49c2-a983-15110eee020c None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:57:23.051305 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674cac8-980c-49c2-a983-15110eee020c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:57:23.073745 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-0674cac8-980c-49c2-a983-15110eee020c None None] MFA Rules not processed for user `430d6177e74c4dbda7fb83d04c75617e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:57:23.074979 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-0674cac8-980c-49c2-a983-15110eee020c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:57:23.086562 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 771/1533] 10.222.0.43 () {58 vars in 1057 bytes} [Fri Dec 24 04:57:23 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:57:23.094889 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d01916c-0230-42b2-91f3-e13039ebd728 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:57:23.111379 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d01916c-0230-42b2-91f3-e13039ebd728 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:57:23.118011 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a71ea9-6f7c-4927-856a-47fd96c04ea6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '430d6177e74c4dbda7fb83d04c75617e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:57:23.118677 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a71ea9-6f7c-4927-856a-47fd96c04ea6 service placement] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:57:23.118959 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a71ea9-6f7c-4927-856a-47fd96c04ea6 service placement] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:57:23.119235 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a71ea9-6f7c-4927-856a-47fd96c04ea6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:57:23.128192 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a71ea9-6f7c-4927-856a-47fd96c04ea6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:57:23.129848 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a71ea9-6f7c-4927-856a-47fd96c04ea6 service placement] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:57:23.143566 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 763/1534] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:57:23 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:57:27.991611 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b072e3e4-77dc-43cb-82b6-e86087881d4a None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:57:27.992198 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b072e3e4-77dc-43cb-82b6-e86087881d4a None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:57:27.992198 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b072e3e4-77dc-43cb-82b6-e86087881d4a None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:57:27.994015 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 772/1535] 127.0.0.1 () {54 vars in 901 bytes} [Fri Dec 24 04:57:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:57:28.001948 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0e240-ec2b-45d2-8311-c466683b3f1f None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:57:28.002416 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0e240-ec2b-45d2-8311-c466683b3f1f None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:57:28.002528 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0e240-ec2b-45d2-8311-c466683b3f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:57:28.022511 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-31c0e240-ec2b-45d2-8311-c466683b3f1f None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:57:28.023718 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-31c0e240-ec2b-45d2-8311-c466683b3f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:57:28.032858 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 764/1536] 127.0.0.1 () {58 vars in 998 bytes} [Fri Dec 24 04:57:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 04:57:28.193427 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b072e3e4-77dc-43cb-82b6-e86087881d4a None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:57:28.216117 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b072e3e4-77dc-43cb-82b6-e86087881d4a None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:57:28.222912 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b4452-dbcf-4957-8adc-2f6026f1cb2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f9ad1e8f8f74edcb44aabe17eb59648', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:57:28.223545 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b4452-dbcf-4957-8adc-2f6026f1cb2e service nova] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:57:28.223827 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b4452-dbcf-4957-8adc-2f6026f1cb2e service nova] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:57:28.224100 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b4452-dbcf-4957-8adc-2f6026f1cb2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:57:28.232395 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251b4452-dbcf-4957-8adc-2f6026f1cb2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:57:28.234020 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251b4452-dbcf-4957-8adc-2f6026f1cb2e service nova] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:57:28.243717 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 773/1537] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:57:28 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:57:29.753996 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cdca4c-de76-452d-bfe1-85b1389a319b None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:57:29.754838 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cdca4c-de76-452d-bfe1-85b1389a319b None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:57:29.754838 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cdca4c-de76-452d-bfe1-85b1389a319b None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:57:29.757851 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 765/1538] 127.0.0.1 () {54 vars in 901 bytes} [Fri Dec 24 04:57:29 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:57:29.767104 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa4852-026a-4ee2-9d42-dcc2e1c44b1c None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:57:29.767901 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa4852-026a-4ee2-9d42-dcc2e1c44b1c None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:57:29.768059 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa4852-026a-4ee2-9d42-dcc2e1c44b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:57:29.797149 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-b5aa4852-026a-4ee2-9d42-dcc2e1c44b1c None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:57:29.798971 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-b5aa4852-026a-4ee2-9d42-dcc2e1c44b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:57:29.810421 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 774/1539] 127.0.0.1 () {58 vars in 998 bytes} [Fri Dec 24 04:57:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:57:29.977346 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cdca4c-de76-452d-bfe1-85b1389a319b None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:57:30.000849 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cdca4c-de76-452d-bfe1-85b1389a319b None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:57:30.007612 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a30e3-760d-4ddd-8569-be5027212534 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f9ad1e8f8f74edcb44aabe17eb59648', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:57:30.008177 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a30e3-760d-4ddd-8569-be5027212534 service nova] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:57:30.008456 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a30e3-760d-4ddd-8569-be5027212534 service nova] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:57:30.008749 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a30e3-760d-4ddd-8569-be5027212534 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:57:30.016757 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a30e3-760d-4ddd-8569-be5027212534 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:57:30.018356 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a30e3-760d-4ddd-8569-be5027212534 service nova] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:57:30.027441 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 766/1540] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:57:29 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:57:34.150802 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4b22d-1f1e-483d-9633-28de96000388 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:57:34.151421 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4b22d-1f1e-483d-9633-28de96000388 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:57:34.151421 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4b22d-1f1e-483d-9633-28de96000388 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:57:34.153170 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 775/1541] 127.0.0.1 () {54 vars in 916 bytes} [Fri Dec 24 04:57:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:57:34.160026 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3535b-4c27-4b63-805e-0c77596b3aef None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:57:34.160808 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3535b-4c27-4b63-805e-0c77596b3aef None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:57:34.161029 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3535b-4c27-4b63-805e-0c77596b3aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:57:34.191673 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-efa3535b-4c27-4b63-805e-0c77596b3aef None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:57:34.192908 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-efa3535b-4c27-4b63-805e-0c77596b3aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:57:34.202433 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 767/1542] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Dec 24 04:57:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:57:34.240101 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd4b22d-1f1e-483d-9633-28de96000388 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:57:34.242300 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-9fd4b22d-1f1e-483d-9633-28de96000388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:57:34.305190 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd4b22d-1f1e-483d-9633-28de96000388 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:57:34.309864 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581cf8b4-3f22-46f3-9987-69a6bc44d33c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:57:34.310519 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581cf8b4-3f22-46f3-9987-69a6bc44d33c service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:57:34.310797 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581cf8b4-3f22-46f3-9987-69a6bc44d33c service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:57:34.311100 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581cf8b4-3f22-46f3-9987-69a6bc44d33c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:57:34.321819 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581cf8b4-3f22-46f3-9987-69a6bc44d33c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:57:34.323278 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581cf8b4-3f22-46f3-9987-69a6bc44d33c service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:57:34.333327 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 776/1543] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:57:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:57:36.685073 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d6c78a-49cd-40af-8dbb-158d5efc1fef None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:57:36.685636 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d6c78a-49cd-40af-8dbb-158d5efc1fef None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:57:36.685636 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d6c78a-49cd-40af-8dbb-158d5efc1fef None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:57:36.687342 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 768/1544] 127.0.0.1 () {54 vars in 916 bytes} [Fri Dec 24 04:57:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:57:36.693547 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014bc28-71da-4965-93f2-435dfc0f7433 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:57:36.693990 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014bc28-71da-4965-93f2-435dfc0f7433 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:57:36.694092 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014bc28-71da-4965-93f2-435dfc0f7433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:57:36.714514 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-9014bc28-71da-4965-93f2-435dfc0f7433 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:57:36.715725 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-9014bc28-71da-4965-93f2-435dfc0f7433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:57:36.725014 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 777/1545] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Dec 24 04:57:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:57:36.764226 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d6c78a-49cd-40af-8dbb-158d5efc1fef None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:57:36.767134 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-39d6c78a-49cd-40af-8dbb-158d5efc1fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:57:36.792302 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d6c78a-49cd-40af-8dbb-158d5efc1fef None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:57:36.797526 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e541c61-05a5-41c4-898d-4193f86f77a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:57:36.798932 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e541c61-05a5-41c4-898d-4193f86f77a4 service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:57:36.798932 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e541c61-05a5-41c4-898d-4193f86f77a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:57:36.798932 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e541c61-05a5-41c4-898d-4193f86f77a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:57:36.809818 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e541c61-05a5-41c4-898d-4193f86f77a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:57:36.811274 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e541c61-05a5-41c4-898d-4193f86f77a4 service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:57:36.821483 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 769/1546] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:57:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:57:40.673901 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3f5f2-c107-4145-a5bd-41cd5bfbddf2 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:57:40.674438 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3f5f2-c107-4145-a5bd-41cd5bfbddf2 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:57:40.674438 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3f5f2-c107-4145-a5bd-41cd5bfbddf2 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:57:40.676171 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 778/1547] 127.0.0.1 () {54 vars in 916 bytes} [Fri Dec 24 04:57:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:57:40.683198 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d9da7-372e-41fe-9f6e-51f8fe1271f0 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:57:40.683967 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d9da7-372e-41fe-9f6e-51f8fe1271f0 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:57:40.684133 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d9da7-372e-41fe-9f6e-51f8fe1271f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:57:40.707042 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-bf3d9da7-372e-41fe-9f6e-51f8fe1271f0 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:57:40.708234 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-bf3d9da7-372e-41fe-9f6e-51f8fe1271f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:57:40.717964 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 770/1548] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Dec 24 04:57:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:57:40.773200 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3f5f2-c107-4145-a5bd-41cd5bfbddf2 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:57:40.776317 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-8bc3f5f2-c107-4145-a5bd-41cd5bfbddf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:57:40.844799 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3f5f2-c107-4145-a5bd-41cd5bfbddf2 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:57:40.848677 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d07866-0155-45ef-b310-dcc923b218d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:57:40.849319 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d07866-0155-45ef-b310-dcc923b218d3 service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:57:40.849602 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d07866-0155-45ef-b310-dcc923b218d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:57:40.849875 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d07866-0155-45ef-b310-dcc923b218d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:57:40.859259 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d07866-0155-45ef-b310-dcc923b218d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:57:40.860732 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d07866-0155-45ef-b310-dcc923b218d3 service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:57:40.870271 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 779/1549] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:57:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:57:43.309639 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778f510-f9bc-4e8f-ba4d-ac6e74f7f4a1 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:57:43.310217 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778f510-f9bc-4e8f-ba4d-ac6e74f7f4a1 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:57:43.310217 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778f510-f9bc-4e8f-ba4d-ac6e74f7f4a1 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:57:43.311986 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 771/1550] 127.0.0.1 () {54 vars in 916 bytes} [Fri Dec 24 04:57:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:57:43.321696 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4dc452-d4d0-4ea2-af68-9af8fb2096c3 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:57:43.322356 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4dc452-d4d0-4ea2-af68-9af8fb2096c3 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:57:43.322533 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4dc452-d4d0-4ea2-af68-9af8fb2096c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:57:43.347729 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-7e4dc452-d4d0-4ea2-af68-9af8fb2096c3 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:57:43.348994 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-7e4dc452-d4d0-4ea2-af68-9af8fb2096c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:57:43.358480 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 780/1551] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Dec 24 04:57:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:57:43.413685 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32791e2b-302a-4e17-a47c-0d1d9736b50a None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:57:43.413988 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32791e2b-302a-4e17-a47c-0d1d9736b50a None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:57:43.414739 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32791e2b-302a-4e17-a47c-0d1d9736b50a None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:57:43.417599 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 772/1552] 10.222.0.43 () {54 vars in 963 bytes} [Fri Dec 24 04:57:43 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:57:43.423023 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23110003-84a7-4659-9737-d41a2c38143b None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:57:43.423317 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23110003-84a7-4659-9737-d41a2c38143b None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:57:43.423596 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23110003-84a7-4659-9737-d41a2c38143b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:57:43.442520 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-23110003-84a7-4659-9737-d41a2c38143b None None] MFA Rules not processed for user `38517ab5a29c438e89634209652d9963`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:57:43.443716 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-23110003-84a7-4659-9737-d41a2c38143b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:57:43.450831 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 781/1553] 10.222.0.43 () {58 vars in 1060 bytes} [Fri Dec 24 04:57:43 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:57:43.459285 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32791e2b-302a-4e17-a47c-0d1d9736b50a None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:57:43.476822 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32791e2b-302a-4e17-a47c-0d1d9736b50a None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:57:43.481386 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c7a61-1aee-4f87-8a66-d6b20c10cf50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:57:43.482028 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c7a61-1aee-4f87-8a66-d6b20c10cf50 service cinder] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:57:43.482306 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c7a61-1aee-4f87-8a66-d6b20c10cf50 service cinder] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:57:43.482570 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c7a61-1aee-4f87-8a66-d6b20c10cf50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:57:43.491662 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418c7a61-1aee-4f87-8a66-d6b20c10cf50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:57:43.493146 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418c7a61-1aee-4f87-8a66-d6b20c10cf50 service cinder] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:57:43.502335 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 773/1554] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:57:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:59:04.569461 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0875045-5365-4ff5-8026-96b2c674e026 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:04.570578 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0875045-5365-4ff5-8026-96b2c674e026 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:04.571092 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0875045-5365-4ff5-8026-96b2c674e026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:04.590486 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-e0875045-5365-4ff5-8026-96b2c674e026 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:04.591920 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-e0875045-5365-4ff5-8026-96b2c674e026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:04.610642 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 782/1555] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:04.619399 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb76564-6b88-4df6-899e-06b183b49cb4 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:04.620496 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb76564-6b88-4df6-899e-06b183b49cb4 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:04.620496 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb76564-6b88-4df6-899e-06b183b49cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:04.648922 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-1bb76564-6b88-4df6-899e-06b183b49cb4 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:04.650204 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-1bb76564-6b88-4df6-899e-06b183b49cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:04.667299 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 774/1556] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:04.672087 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0875045-5365-4ff5-8026-96b2c674e026 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:04.682239 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0875045-5365-4ff5-8026-96b2c674e026 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:04.692949 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26b057-ee35-41f5-a91c-9434366a79b4 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:04.693245 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26b057-ee35-41f5-a91c-9434366a79b4 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:04.693519 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26b057-ee35-41f5-a91c-9434366a79b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:04.697132 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60990635-08dd-4a66-9c60-7af28fdb6dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:04.697807 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60990635-08dd-4a66-9c60-7af28fdb6dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:04.698089 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60990635-08dd-4a66-9c60-7af28fdb6dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:04.698366 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60990635-08dd-4a66-9c60-7af28fdb6dd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:04.699118 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60990635-08dd-4a66-9c60-7af28fdb6dd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:59:04.699427 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60990635-08dd-4a66-9c60-7af28fdb6dd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:04.701133 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60990635-08dd-4a66-9c60-7af28fdb6dd6 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:04.744831 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 783/1557] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 04:59:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:59:04.746179 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909e724-bcfa-4a8b-95a9-09b4a10dfea1 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:04.746659 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909e724-bcfa-4a8b-95a9-09b4a10dfea1 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:04.747098 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909e724-bcfa-4a8b-95a9-09b4a10dfea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:04.748811 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-9d26b057-ee35-41f5-a91c-9434366a79b4 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:04.750201 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-9d26b057-ee35-41f5-a91c-9434366a79b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:04.768890 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 775/1558] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Dec 24 04:59:04.769908 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26b057-ee35-41f5-a91c-9434366a79b4 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:04.772142 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-0909e724-bcfa-4a8b-95a9-09b4a10dfea1 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:04.773582 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-0909e724-bcfa-4a8b-95a9-09b4a10dfea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:04.785611 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26b057-ee35-41f5-a91c-9434366a79b4 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:04.790271 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 784/1559] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:04.791749 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b11e8-b896-4524-8dd3-618491bdcc2a None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:04.792208 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b11e8-b896-4524-8dd3-618491bdcc2a None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:04.792681 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b11e8-b896-4524-8dd3-618491bdcc2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:04.799180 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b724086b-6fae-4e37-9abe-8a07ac536b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:04.800255 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724086b-6fae-4e37-9abe-8a07ac536b3b admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:04.800714 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724086b-6fae-4e37-9abe-8a07ac536b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:04.801161 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724086b-6fae-4e37-9abe-8a07ac536b3b admin admin] PATH_INFO: `/v3/projects` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:04.802204 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b724086b-6fae-4e37-9abe-8a07ac536b3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:04.804306 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b724086b-6fae-4e37-9abe-8a07ac536b3b admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:04.814144 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-d30b11e8-b896-4524-8dd3-618491bdcc2a None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:04.815372 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-d30b11e8-b896-4524-8dd3-618491bdcc2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:04.832295 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 785/1560] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:04.837010 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f541d-c261-4433-8b37-55f51b3d1fa9 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:04.837310 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f541d-c261-4433-8b37-55f51b3d1fa9 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:04.837590 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f541d-c261-4433-8b37-55f51b3d1fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:04.849738 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 776/1561] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 04:59:04 2021] POST /identity/v3/projects => generated 389 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:59:04.852334 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3f590-ac49-4d91-8572-3449fa703d35 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:04.852645 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3f590-ac49-4d91-8572-3449fa703d35 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:04.852931 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3f590-ac49-4d91-8572-3449fa703d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:04.869778 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-aa8f541d-c261-4433-8b37-55f51b3d1fa9 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:04.870460 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-aa8f541d-c261-4433-8b37-55f51b3d1fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:04.885560 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-5ce3f590-ac49-4d91-8572-3449fa703d35 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:04.886955 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-5ce3f590-ac49-4d91-8572-3449fa703d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:04.931111 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 786/1562] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:04.932443 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a2679-b7c6-4b3f-b1c3-78eb75d767d1 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:04.932731 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a2679-b7c6-4b3f-b1c3-78eb75d767d1 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:04.933013 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a2679-b7c6-4b3f-b1c3-78eb75d767d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:04.943484 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 777/1563] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:04.944312 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce3f590-ac49-4d91-8572-3449fa703d35 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:04.953629 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce3f590-ac49-4d91-8572-3449fa703d35 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:04.954531 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-b26a2679-b7c6-4b3f-b1c3-78eb75d767d1 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:04.955830 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-b26a2679-b7c6-4b3f-b1c3-78eb75d767d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:04.958416 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df61d5-9632-4121-b154-4894a0a98978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:04.959066 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df61d5-9632-4121-b154-4894a0a98978 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:04.959349 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df61d5-9632-4121-b154-4894a0a98978 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:04.959953 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df61d5-9632-4121-b154-4894a0a98978 admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:04.960730 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df61d5-9632-4121-b154-4894a0a98978 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:59:04.961040 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df61d5-9632-4121-b154-4894a0a98978 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:04.962660 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df61d5-9632-4121-b154-4894a0a98978 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:04.964012 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 787/1564] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:04.964792 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26a2679-b7c6-4b3f-b1c3-78eb75d767d1 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:04.974126 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26a2679-b7c6-4b3f-b1c3-78eb75d767d1 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:04.974808 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 778/1565] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 04:59:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:59:04.976085 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e7035-4c8c-4022-8af3-714c8306316a None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:04.976405 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e7035-4c8c-4022-8af3-714c8306316a None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:04.976744 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e7035-4c8c-4022-8af3-714c8306316a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:04.979263 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92be9358-91b9-47b2-9a76-5e35104e7612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:04.979923 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be9358-91b9-47b2-9a76-5e35104e7612 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:04.980208 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be9358-91b9-47b2-9a76-5e35104e7612 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:04.980480 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be9358-91b9-47b2-9a76-5e35104e7612 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:04.981215 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92be9358-91b9-47b2-9a76-5e35104e7612 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:04.983252 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92be9358-91b9-47b2-9a76-5e35104e7612 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:04.994492 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-b08e7035-4c8c-4022-8af3-714c8306316a None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:04.995868 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-b08e7035-4c8c-4022-8af3-714c8306316a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:05.004049 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 788/1566] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 04:59:04 2021] POST /identity/v3/users => generated 295 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:59:05.004586 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 779/1567] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:05.005826 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa791b1-e06c-40ba-9a6f-949e933adcdf None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:05.006117 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa791b1-e06c-40ba-9a6f-949e933adcdf None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:05.006395 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa791b1-e06c-40ba-9a6f-949e933adcdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:05.009845 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02baff8-f75d-4320-b320-71ee115a4c3f None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:05.010387 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02baff8-f75d-4320-b320-71ee115a4c3f None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:05.011029 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02baff8-f75d-4320-b320-71ee115a4c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:05.024752 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-bfa791b1-e06c-40ba-9a6f-949e933adcdf None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:05.025999 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-bfa791b1-e06c-40ba-9a6f-949e933adcdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:05.029754 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-b02baff8-f75d-4320-b320-71ee115a4c3f None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:05.030961 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-b02baff8-f75d-4320-b320-71ee115a4c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:05.034106 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 780/1568] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:05.034875 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa791b1-e06c-40ba-9a6f-949e933adcdf None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:05.040567 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 789/1569] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:05.041548 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1fdff-f84a-4007-aa47-1d7a7f48544f None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:05.041835 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1fdff-f84a-4007-aa47-1d7a7f48544f None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:05.042108 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1fdff-f84a-4007-aa47-1d7a7f48544f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:05.048577 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa791b1-e06c-40ba-9a6f-949e933adcdf None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:05.053550 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8dd894-fcad-454b-b8f2-4e9226412dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:05.054230 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8dd894-fcad-454b-b8f2-4e9226412dd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:05.054513 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8dd894-fcad-454b-b8f2-4e9226412dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:05.054913 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8dd894-fcad-454b-b8f2-4e9226412dd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:05.055666 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8dd894-fcad-454b-b8f2-4e9226412dd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:59:05.055975 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8dd894-fcad-454b-b8f2-4e9226412dd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:05.057628 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8dd894-fcad-454b-b8f2-4e9226412dd8 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:05.060802 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-10f1fdff-f84a-4007-aa47-1d7a7f48544f None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:05.061995 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-10f1fdff-f84a-4007-aa47-1d7a7f48544f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:05.070002 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 781/1570] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 04:59:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:59:05.071056 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 790/1571] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:05.071361 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16262d0c-d928-4f25-8cfc-32e7d7ec6827 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:05.071655 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16262d0c-d928-4f25-8cfc-32e7d7ec6827 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:05.071932 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16262d0c-d928-4f25-8cfc-32e7d7ec6827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:05.075462 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1fdff-f84a-4007-aa47-1d7a7f48544f None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:05.086031 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1fdff-f84a-4007-aa47-1d7a7f48544f None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:05.090273 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-16262d0c-d928-4f25-8cfc-32e7d7ec6827 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:05.091163 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b3f11-fadb-41b2-b072-91bb9754973b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:05.091499 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-16262d0c-d928-4f25-8cfc-32e7d7ec6827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:05.091811 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b3f11-fadb-41b2-b072-91bb9754973b admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:05.092089 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b3f11-fadb-41b2-b072-91bb9754973b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:05.092350 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b3f11-fadb-41b2-b072-91bb9754973b admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:05.093098 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b3f11-fadb-41b2-b072-91bb9754973b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:05.095092 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b3f11-fadb-41b2-b072-91bb9754973b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:05.099884 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 782/1572] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:05.100689 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16262d0c-d928-4f25-8cfc-32e7d7ec6827 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:05.109683 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16262d0c-d928-4f25-8cfc-32e7d7ec6827 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:05.115513 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285a0374-4f50-49e5-ad32-cfc6189462a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:05.116165 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a0374-4f50-49e5-ad32-cfc6189462a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:05.116448 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a0374-4f50-49e5-ad32-cfc6189462a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:05.116751 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a0374-4f50-49e5-ad32-cfc6189462a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:05.117505 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285a0374-4f50-49e5-ad32-cfc6189462a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:05.119156 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285a0374-4f50-49e5-ad32-cfc6189462a1 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:05.121066 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 791/1573] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 04:59:05 2021] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:59:05.122478 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7c343-30c0-458f-88e2-3a57355f765c None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:05.122771 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7c343-30c0-458f-88e2-3a57355f765c None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:05.123048 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7c343-30c0-458f-88e2-3a57355f765c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:05.129816 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 783/1574] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 04:59:05 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 04:59:05.131402 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f82e4-c5e6-4ba7-b0e5-cb3b6359101d None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:05.131689 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f82e4-c5e6-4ba7-b0e5-cb3b6359101d None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:05.131964 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f82e4-c5e6-4ba7-b0e5-cb3b6359101d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:05.141099 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-ead7c343-30c0-458f-88e2-3a57355f765c None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:05.142351 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-ead7c343-30c0-458f-88e2-3a57355f765c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:05.149647 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-a67f82e4-c5e6-4ba7-b0e5-cb3b6359101d None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:05.150822 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-a67f82e4-c5e6-4ba7-b0e5-cb3b6359101d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:05.199846 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 792/1575] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:05.201329 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baeb7e0-9b6e-4351-bb9f-937842264c00 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:05.201619 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baeb7e0-9b6e-4351-bb9f-937842264c00 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:05.201936 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baeb7e0-9b6e-4351-bb9f-937842264c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:05.212267 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 784/1576] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:05.212267 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f82e4-c5e6-4ba7-b0e5-cb3b6359101d None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:05.220786 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f82e4-c5e6-4ba7-b0e5-cb3b6359101d None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:05.221256 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-5baeb7e0-9b6e-4351-bb9f-937842264c00 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:05.222466 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-5baeb7e0-9b6e-4351-bb9f-937842264c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:05.225652 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7125790-0876-4c05-8067-96262a7b9980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:05.226304 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7125790-0876-4c05-8067-96262a7b9980 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:05.226589 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7125790-0876-4c05-8067-96262a7b9980 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:05.226888 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7125790-0876-4c05-8067-96262a7b9980 admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:05.227676 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7125790-0876-4c05-8067-96262a7b9980 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:59:05.227992 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7125790-0876-4c05-8067-96262a7b9980 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:05.229647 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7125790-0876-4c05-8067-96262a7b9980 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:05.231411 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 793/1577] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:05.232209 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baeb7e0-9b6e-4351-bb9f-937842264c00 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:05.241671 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 785/1578] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 04:59:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:59:05.242473 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7125790-0876-4c05-8067-96262a7b9980 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:05.247010 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baeb7e0-9b6e-4351-bb9f-937842264c00 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:05.251980 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7125790-0876-4c05-8067-96262a7b9980 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:05.252337 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e41989-bfbb-4879-841c-7c9f5add24b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:05.253038 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e41989-bfbb-4879-841c-7c9f5add24b6 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:05.253312 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e41989-bfbb-4879-841c-7c9f5add24b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:05.253579 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e41989-bfbb-4879-841c-7c9f5add24b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:05.254287 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e41989-bfbb-4879-841c-7c9f5add24b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:05.256173 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e41989-bfbb-4879-841c-7c9f5add24b6 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:05.256701 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a0d80d-97c7-41f1-9966-c9fb91da5abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:05.257332 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0d80d-97c7-41f1-9966-c9fb91da5abc admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:05.257617 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0d80d-97c7-41f1-9966-c9fb91da5abc admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:05.257893 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0d80d-97c7-41f1-9966-c9fb91da5abc admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:05.258624 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a0d80d-97c7-41f1-9966-c9fb91da5abc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:59:05.258931 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a0d80d-97c7-41f1-9966-c9fb91da5abc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:05.260676 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a0d80d-97c7-41f1-9966-c9fb91da5abc admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:05.272518 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 786/1579] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 04:59:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:59:05.273404 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a0d80d-97c7-41f1-9966-c9fb91da5abc admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:05.283061 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a0d80d-97c7-41f1-9966-c9fb91da5abc admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:05.288206 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd00ac3-e450-425d-9d2d-0c03b824859f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:05.288900 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd00ac3-e450-425d-9d2d-0c03b824859f admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:05.289175 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd00ac3-e450-425d-9d2d-0c03b824859f admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:05.289448 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd00ac3-e450-425d-9d2d-0c03b824859f admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:05.290143 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd00ac3-e450-425d-9d2d-0c03b824859f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:05.290618 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 794/1580] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 04:59:05 2021] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:59:05.291437 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e41989-bfbb-4879-841c-7c9f5add24b6 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:05.292287 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd00ac3-e450-425d-9d2d-0c03b824859f admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:05.318137 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 787/1581] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 04:59:05 2021] POST /identity/v3/users => generated 290 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:59:05.319170 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd00ac3-e450-425d-9d2d-0c03b824859f admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:05.329199 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd00ac3-e450-425d-9d2d-0c03b824859f admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:05.354462 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e41989-bfbb-4879-841c-7c9f5add24b6 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:05.359079 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b2ace8-59b9-4f8f-a841-a76492f4506d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:05.359744 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b2ace8-59b9-4f8f-a841-a76492f4506d admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:05.360030 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b2ace8-59b9-4f8f-a841-a76492f4506d admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:05.360364 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b2ace8-59b9-4f8f-a841-a76492f4506d admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:05.361241 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b2ace8-59b9-4f8f-a841-a76492f4506d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:05.363073 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b2ace8-59b9-4f8f-a841-a76492f4506d admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:05.372900 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 795/1582] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 04:59:05 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 04:59:05.373694 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b2ace8-59b9-4f8f-a841-a76492f4506d admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:05.383492 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b2ace8-59b9-4f8f-a841-a76492f4506d admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:05.388471 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25bebe5-5ffe-4ede-981d-02a07c1e57c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:05.388900 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e981b42b-5478-4ed5-8695-a970413db139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:05.389113 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bebe5-5ffe-4ede-981d-02a07c1e57c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:05.389406 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bebe5-5ffe-4ede-981d-02a07c1e57c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:05.389568 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981b42b-5478-4ed5-8695-a970413db139 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:05.389669 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bebe5-5ffe-4ede-981d-02a07c1e57c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:05.389833 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981b42b-5478-4ed5-8695-a970413db139 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:05.390107 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981b42b-5478-4ed5-8695-a970413db139 admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:05.390394 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25bebe5-5ffe-4ede-981d-02a07c1e57c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:59:05.390706 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25bebe5-5ffe-4ede-981d-02a07c1e57c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:05.390837 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e981b42b-5478-4ed5-8695-a970413db139 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:59:05.391141 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e981b42b-5478-4ed5-8695-a970413db139 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:05.392408 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25bebe5-5ffe-4ede-981d-02a07c1e57c0 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:05.393061 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e981b42b-5478-4ed5-8695-a970413db139 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:05.404028 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 788/1583] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 04:59:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:59:05.404296 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 796/1584] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 04:59:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:59:05.405106 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25bebe5-5ffe-4ede-981d-02a07c1e57c0 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:05.405272 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e981b42b-5478-4ed5-8695-a970413db139 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:05.414553 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e981b42b-5478-4ed5-8695-a970413db139 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:05.419273 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e90a3d5-f671-4252-8903-8522deb72713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:05.419913 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90a3d5-f671-4252-8903-8522deb72713 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:05.420192 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90a3d5-f671-4252-8903-8522deb72713 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:05.420463 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90a3d5-f671-4252-8903-8522deb72713 admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:05.421230 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e90a3d5-f671-4252-8903-8522deb72713 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:59:05.421534 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e90a3d5-f671-4252-8903-8522deb72713 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:05.423282 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e90a3d5-f671-4252-8903-8522deb72713 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:05.425016 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25bebe5-5ffe-4ede-981d-02a07c1e57c0 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:05.430657 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5aa020-dbc4-4568-bb04-525478b73d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:05.431333 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5aa020-dbc4-4568-bb04-525478b73d23 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:05.431622 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5aa020-dbc4-4568-bb04-525478b73d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:05.431895 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5aa020-dbc4-4568-bb04-525478b73d23 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:05.432769 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5aa020-dbc4-4568-bb04-525478b73d23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:05.434675 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5aa020-dbc4-4568-bb04-525478b73d23 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:05.435032 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 789/1585] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 04:59:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:59:05.435856 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e90a3d5-f671-4252-8903-8522deb72713 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:05.448481 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e90a3d5-f671-4252-8903-8522deb72713 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:05.453252 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1493d7e-6295-45b1-bff8-8266a5de8e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:05.453987 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1493d7e-6295-45b1-bff8-8266a5de8e17 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:05.454233 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1493d7e-6295-45b1-bff8-8266a5de8e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:05.454514 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1493d7e-6295-45b1-bff8-8266a5de8e17 admin admin] PATH_INFO: `/v3/projects` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:05.455215 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1493d7e-6295-45b1-bff8-8266a5de8e17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:05.457368 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1493d7e-6295-45b1-bff8-8266a5de8e17 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:05.466620 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 797/1586] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 04:59:05 2021] POST /identity/v3/projects => generated 405 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:59:05.467469 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5aa020-dbc4-4568-bb04-525478b73d23 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:05.486989 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 790/1587] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 04:59:05 2021] POST /identity/v3/projects => generated 393 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:59:05.487935 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1493d7e-6295-45b1-bff8-8266a5de8e17 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:05.533159 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5aa020-dbc4-4568-bb04-525478b73d23 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:05.550224 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1493d7e-6295-45b1-bff8-8266a5de8e17 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:05.554980 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b70d38-b75b-4a61-b4fe-30a922b08ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:05.555639 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b70d38-b75b-4a61-b4fe-30a922b08ebb admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:05.555923 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b70d38-b75b-4a61-b4fe-30a922b08ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:05.556202 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b70d38-b75b-4a61-b4fe-30a922b08ebb admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:05.556980 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b70d38-b75b-4a61-b4fe-30a922b08ebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:05.558636 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b70d38-b75b-4a61-b4fe-30a922b08ebb admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:05.568655 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 791/1588] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 04:59:05 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 04:59:05.569497 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b70d38-b75b-4a61-b4fe-30a922b08ebb admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:05.580040 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b70d38-b75b-4a61-b4fe-30a922b08ebb admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:05.585891 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8d0a68-8d6e-47a0-9a26-5db16f3043f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:05.586765 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d0a68-8d6e-47a0-9a26-5db16f3043f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:05.587044 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d0a68-8d6e-47a0-9a26-5db16f3043f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:05.587319 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d0a68-8d6e-47a0-9a26-5db16f3043f9 admin admin] PATH_INFO: `/v3/projects/6c9c47f70b8d4da5827a8ef4349559ab/users/979cc4a0723b4543a16197d393c7929a/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:05.591004 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118c691-c6e8-4eaa-a15f-e317aedb703a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:05.591683 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118c691-c6e8-4eaa-a15f-e317aedb703a admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:05.591971 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118c691-c6e8-4eaa-a15f-e317aedb703a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:05.592249 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118c691-c6e8-4eaa-a15f-e317aedb703a admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:05.592990 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3118c691-c6e8-4eaa-a15f-e317aedb703a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:05.595268 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3118c691-c6e8-4eaa-a15f-e317aedb703a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:05.604920 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8d0a68-8d6e-47a0-9a26-5db16f3043f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c9c47f70b8d4da5827a8ef4349559ab, user_id=979cc4a0723b4543a16197d393c7929a, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:05.607728 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8d0a68-8d6e-47a0-9a26-5db16f3043f9 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:05.617216 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 798/1589] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 04:59:05 2021] POST /identity/v3/users => generated 287 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:59:05.618061 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118c691-c6e8-4eaa-a15f-e317aedb703a admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:05.620873 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 792/1590] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 04:59:05 2021] PUT /identity/v3/projects/6c9c47f70b8d4da5827a8ef4349559ab/users/979cc4a0723b4543a16197d393c7929a/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:59:05.621709 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8d0a68-8d6e-47a0-9a26-5db16f3043f9 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:05.627487 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118c691-c6e8-4eaa-a15f-e317aedb703a admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:05.682599 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099c0587-42bf-46a7-a855-4aefa418c52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:05.683263 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c0587-42bf-46a7-a855-4aefa418c52a admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:05.683542 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c0587-42bf-46a7-a855-4aefa418c52a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:05.683819 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c0587-42bf-46a7-a855-4aefa418c52a admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:05.684039 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8d0a68-8d6e-47a0-9a26-5db16f3043f9 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:05.684539 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099c0587-42bf-46a7-a855-4aefa418c52a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:05.686461 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099c0587-42bf-46a7-a855-4aefa418c52a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:05.688929 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b6235a-89c1-4234-8ede-415aeb04dca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:05.689611 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b6235a-89c1-4234-8ede-415aeb04dca0 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:05.689941 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b6235a-89c1-4234-8ede-415aeb04dca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:05.690214 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b6235a-89c1-4234-8ede-415aeb04dca0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:05.690918 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b6235a-89c1-4234-8ede-415aeb04dca0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:05.692827 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b6235a-89c1-4234-8ede-415aeb04dca0 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:05.715942 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 799/1591] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 04:59:05 2021] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:59:05.715942 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099c0587-42bf-46a7-a855-4aefa418c52a admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:05.721546 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 793/1592] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 04:59:05 2021] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:59:05.721546 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b6235a-89c1-4234-8ede-415aeb04dca0 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:05.772880 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099c0587-42bf-46a7-a855-4aefa418c52a admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:05.777567 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2545acbf-6e23-44ca-827d-df14249314a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:05.778126 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b6235a-89c1-4234-8ede-415aeb04dca0 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:05.778236 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545acbf-6e23-44ca-827d-df14249314a6 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:05.778484 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545acbf-6e23-44ca-827d-df14249314a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:05.778749 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545acbf-6e23-44ca-827d-df14249314a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:05.779449 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2545acbf-6e23-44ca-827d-df14249314a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:05.781376 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2545acbf-6e23-44ca-827d-df14249314a6 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:05.782818 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c89c36f-3ba8-4920-b0e7-f0555a7e7e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:05.783483 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89c36f-3ba8-4920-b0e7-f0555a7e7e8d admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:05.783759 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89c36f-3ba8-4920-b0e7-f0555a7e7e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:05.784033 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89c36f-3ba8-4920-b0e7-f0555a7e7e8d admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:05.784752 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c89c36f-3ba8-4920-b0e7-f0555a7e7e8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:05.786677 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c89c36f-3ba8-4920-b0e7-f0555a7e7e8d admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:05.807927 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 794/1593] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 04:59:05 2021] POST /identity/v3/users => generated 303 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:59:05.811895 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 800/1594] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 04:59:05 2021] POST /identity/v3/projects => generated 375 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:59:05.812042 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c89c36f-3ba8-4920-b0e7-f0555a7e7e8d admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:05.812172 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2545acbf-6e23-44ca-827d-df14249314a6 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:05.820507 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c89c36f-3ba8-4920-b0e7-f0555a7e7e8d admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:05.871821 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2545acbf-6e23-44ca-827d-df14249314a6 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:05.874705 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7cab58-0a2c-4a31-9bbe-e8fc5f2e9b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:05.875377 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7cab58-0a2c-4a31-9bbe-e8fc5f2e9b71 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:05.875655 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7cab58-0a2c-4a31-9bbe-e8fc5f2e9b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:05.876076 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7cab58-0a2c-4a31-9bbe-e8fc5f2e9b71 admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:05.876606 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f2cd81-53d3-4944-90bb-e4623b564eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:05.876815 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7cab58-0a2c-4a31-9bbe-e8fc5f2e9b71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:05.877274 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2cd81-53d3-4944-90bb-e4623b564eb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:05.877557 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2cd81-53d3-4944-90bb-e4623b564eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:05.877835 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2cd81-53d3-4944-90bb-e4623b564eb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:05.878598 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f2cd81-53d3-4944-90bb-e4623b564eb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:05.878767 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7cab58-0a2c-4a31-9bbe-e8fc5f2e9b71 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:05.880173 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f2cd81-53d3-4944-90bb-e4623b564eb5 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:05.893314 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 801/1595] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 04:59:05 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 04:59:05.893314 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f2cd81-53d3-4944-90bb-e4623b564eb5 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:05.899252 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 795/1596] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 04:59:05 2021] POST /identity/v3/users => generated 297 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:59:05.900560 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455460a0-c197-445a-a92e-c5b2b7a8a896 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:05.900862 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455460a0-c197-445a-a92e-c5b2b7a8a896 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:05.901101 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455460a0-c197-445a-a92e-c5b2b7a8a896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:05.902230 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f2cd81-53d3-4944-90bb-e4623b564eb5 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:05.907030 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63174f0-9cff-4ed4-88e3-360e739a24f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:05.908070 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63174f0-9cff-4ed4-88e3-360e739a24f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:05.908372 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63174f0-9cff-4ed4-88e3-360e739a24f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:05.908683 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63174f0-9cff-4ed4-88e3-360e739a24f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:05.909423 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63174f0-9cff-4ed4-88e3-360e739a24f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:05.911030 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63174f0-9cff-4ed4-88e3-360e739a24f7 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:05.918712 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-455460a0-c197-445a-a92e-c5b2b7a8a896 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:05.919922 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-455460a0-c197-445a-a92e-c5b2b7a8a896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:05.920862 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 802/1597] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 04:59:05 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 04:59:05.921686 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63174f0-9cff-4ed4-88e3-360e739a24f7 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:05.928517 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 796/1598] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:05.929251 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455460a0-c197-445a-a92e-c5b2b7a8a896 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:05.931158 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63174f0-9cff-4ed4-88e3-360e739a24f7 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:05.936148 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277849a8-d7f7-4124-81bf-8233f8ffcda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:05.936880 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277849a8-d7f7-4124-81bf-8233f8ffcda7 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:05.937160 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277849a8-d7f7-4124-81bf-8233f8ffcda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:05.937435 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277849a8-d7f7-4124-81bf-8233f8ffcda7 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:05.938131 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277849a8-d7f7-4124-81bf-8233f8ffcda7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:05.940323 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277849a8-d7f7-4124-81bf-8233f8ffcda7 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:05.940907 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455460a0-c197-445a-a92e-c5b2b7a8a896 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:05.946061 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8821dd9b-446e-4bff-aea5-0cc708040408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:05.946723 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821dd9b-446e-4bff-aea5-0cc708040408 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:05.947009 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821dd9b-446e-4bff-aea5-0cc708040408 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:05.947284 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821dd9b-446e-4bff-aea5-0cc708040408 admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:05.948303 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8821dd9b-446e-4bff-aea5-0cc708040408 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:05.949952 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8821dd9b-446e-4bff-aea5-0cc708040408 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:05.961436 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 803/1599] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 04:59:05 2021] POST /identity/v3/users => generated 290 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:59:05.962486 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277849a8-d7f7-4124-81bf-8233f8ffcda7 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:05.972203 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277849a8-d7f7-4124-81bf-8233f8ffcda7 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:05.973074 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 797/1600] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 04:59:05 2021] POST /identity/v3/users => generated 291 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:59:05.973842 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8821dd9b-446e-4bff-aea5-0cc708040408 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:05.979997 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ffbc0d-51fa-4568-87f2-beae0a7e55c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:05.980695 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffbc0d-51fa-4568-87f2-beae0a7e55c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:05.980976 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffbc0d-51fa-4568-87f2-beae0a7e55c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:05.981251 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffbc0d-51fa-4568-87f2-beae0a7e55c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:05.981992 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ffbc0d-51fa-4568-87f2-beae0a7e55c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:05.983625 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ffbc0d-51fa-4568-87f2-beae0a7e55c7 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:05.984951 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8821dd9b-446e-4bff-aea5-0cc708040408 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:05.989402 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e0cd4-04f0-4cbb-9271-e83fe1558212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:05.990035 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e0cd4-04f0-4cbb-9271-e83fe1558212 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:05.990312 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e0cd4-04f0-4cbb-9271-e83fe1558212 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:05.990578 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e0cd4-04f0-4cbb-9271-e83fe1558212 admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:05.991266 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18e0cd4-04f0-4cbb-9271-e83fe1558212 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:05.993205 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18e0cd4-04f0-4cbb-9271-e83fe1558212 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:05.994693 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 804/1601] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 04:59:05 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 04:59:05.995613 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ffbc0d-51fa-4568-87f2-beae0a7e55c7 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:06.005798 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ffbc0d-51fa-4568-87f2-beae0a7e55c7 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:06.010374 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04704aba-e2d0-45df-b230-56e0a218ab29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:06.011231 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04704aba-e2d0-45df-b230-56e0a218ab29 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:06.011509 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04704aba-e2d0-45df-b230-56e0a218ab29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:06.011775 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04704aba-e2d0-45df-b230-56e0a218ab29 admin admin] PATH_INFO: `/v3/projects/bb4c0810c1124ffa823c4a28f0f4887d/users/6fe6cde1c4c94cb88bc41407cfca79e1/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:06.016495 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 798/1602] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 04:59:05 2021] POST /identity/v3/users => generated 288 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:59:06.016495 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e0cd4-04f0-4cbb-9271-e83fe1558212 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:06.023566 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e0cd4-04f0-4cbb-9271-e83fe1558212 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:06.025939 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04704aba-e2d0-45df-b230-56e0a218ab29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb4c0810c1124ffa823c4a28f0f4887d, user_id=6fe6cde1c4c94cb88bc41407cfca79e1, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:06.028335 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5eb3ee-2ceb-44cc-81fd-d8f34be7bae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:06.028624 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04704aba-e2d0-45df-b230-56e0a218ab29 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:06.029020 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5eb3ee-2ceb-44cc-81fd-d8f34be7bae2 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:06.029403 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5eb3ee-2ceb-44cc-81fd-d8f34be7bae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:06.029683 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5eb3ee-2ceb-44cc-81fd-d8f34be7bae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:06.030426 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5eb3ee-2ceb-44cc-81fd-d8f34be7bae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:06.032028 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5eb3ee-2ceb-44cc-81fd-d8f34be7bae2 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:06.041764 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 805/1603] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 04:59:05 2021] PUT /identity/v3/projects/bb4c0810c1124ffa823c4a28f0f4887d/users/6fe6cde1c4c94cb88bc41407cfca79e1/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:59:06.042571 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04704aba-e2d0-45df-b230-56e0a218ab29 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:06.048378 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 799/1604] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 04:59:06 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 04:59:06.049774 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5eb3ee-2ceb-44cc-81fd-d8f34be7bae2 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:06.108621 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5eb3ee-2ceb-44cc-81fd-d8f34be7bae2 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:06.135793 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04704aba-e2d0-45df-b230-56e0a218ab29 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:06.135793 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2646bf0-d0f7-4ee9-9e12-1858ced6cca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:06.135793 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2646bf0-d0f7-4ee9-9e12-1858ced6cca9 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:06.135793 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2646bf0-d0f7-4ee9-9e12-1858ced6cca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:06.136260 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2646bf0-d0f7-4ee9-9e12-1858ced6cca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:06.136260 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2646bf0-d0f7-4ee9-9e12-1858ced6cca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:06.136260 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2646bf0-d0f7-4ee9-9e12-1858ced6cca9 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:06.136260 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 806/1605] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 04:59:06 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 04:59:06.136260 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2646bf0-d0f7-4ee9-9e12-1858ced6cca9 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:06.139158 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2646bf0-d0f7-4ee9-9e12-1858ced6cca9 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:06.143866 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041d3d6-f930-4cbb-b0ac-d66bdee4db9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:06.144498 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041d3d6-f930-4cbb-b0ac-d66bdee4db9c admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:06.144799 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041d3d6-f930-4cbb-b0ac-d66bdee4db9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:06.145067 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041d3d6-f930-4cbb-b0ac-d66bdee4db9c admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:06.145793 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7041d3d6-f930-4cbb-b0ac-d66bdee4db9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:06.147406 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7041d3d6-f930-4cbb-b0ac-d66bdee4db9c admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:06.155488 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e26bc-1bcd-4c03-b637-177befe8f7d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:06.156134 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e26bc-1bcd-4c03-b637-177befe8f7d3 service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:06.156418 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e26bc-1bcd-4c03-b637-177befe8f7d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:06.156725 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e26bc-1bcd-4c03-b637-177befe8f7d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:06.157281 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 807/1606] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 04:59:06 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 04:59:06.158230 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041d3d6-f930-4cbb-b0ac-d66bdee4db9c admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:06.167623 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041d3d6-f930-4cbb-b0ac-d66bdee4db9c admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:06.168762 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5e26bc-1bcd-4c03-b637-177befe8f7d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:06.170240 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5e26bc-1bcd-4c03-b637-177befe8f7d3 service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:06.172314 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c8a33-6cad-4a5d-b665-99ad3ddf6174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:06.173212 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c8a33-6cad-4a5d-b665-99ad3ddf6174 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:06.173489 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c8a33-6cad-4a5d-b665-99ad3ddf6174 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:06.173761 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c8a33-6cad-4a5d-b665-99ad3ddf6174 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:06.174479 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c8a33-6cad-4a5d-b665-99ad3ddf6174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:06.176048 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c8a33-6cad-4a5d-b665-99ad3ddf6174 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:06.179638 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 800/1607] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:59:06 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:59:06.180410 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e26bc-1bcd-4c03-b637-177befe8f7d3 service neutron] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:06.191129 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 808/1608] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 04:59:06 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 04:59:06.191129 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c8a33-6cad-4a5d-b665-99ad3ddf6174 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:06.191435 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e26bc-1bcd-4c03-b637-177befe8f7d3 service neutron] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:06.195214 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8a7a4-52a5-4cb6-ad23-ab7bcaace2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:06.195972 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8a7a4-52a5-4cb6-ad23-ab7bcaace2c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:06.196322 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8a7a4-52a5-4cb6-ad23-ab7bcaace2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:06.196699 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8a7a4-52a5-4cb6-ad23-ab7bcaace2c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:06.197528 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b8a7a4-52a5-4cb6-ad23-ab7bcaace2c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:06.198336 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c8a33-6cad-4a5d-b665-99ad3ddf6174 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:06.199292 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b8a7a4-52a5-4cb6-ad23-ab7bcaace2c8 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:06.203604 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b9dcd2-e52e-4682-b5f6-ac223cf9d618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:06.207381 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9dcd2-e52e-4682-b5f6-ac223cf9d618 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:06.207685 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9dcd2-e52e-4682-b5f6-ac223cf9d618 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:06.207989 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9dcd2-e52e-4682-b5f6-ac223cf9d618 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:06.208788 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b9dcd2-e52e-4682-b5f6-ac223cf9d618 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:06.210758 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b9dcd2-e52e-4682-b5f6-ac223cf9d618 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:06.214618 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 801/1609] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 04:59:06 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 04:59:06.214618 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8a7a4-52a5-4cb6-ad23-ab7bcaace2c8 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:06.222659 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8a7a4-52a5-4cb6-ad23-ab7bcaace2c8 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:06.225620 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 809/1610] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 04:59:06 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 04:59:06.227803 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96663ee5-5806-4f6e-8f60-d220c6d68eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:06.228858 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96663ee5-5806-4f6e-8f60-d220c6d68eab admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:06.229211 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96663ee5-5806-4f6e-8f60-d220c6d68eab admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:06.229575 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96663ee5-5806-4f6e-8f60-d220c6d68eab admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:06.229758 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4494b-0325-41dc-9845-e531de1711ae None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:06.230425 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96663ee5-5806-4f6e-8f60-d220c6d68eab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:06.231145 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4494b-0325-41dc-9845-e531de1711ae None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:06.231339 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4494b-0325-41dc-9845-e531de1711ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:06.232281 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96663ee5-5806-4f6e-8f60-d220c6d68eab admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:06.244881 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 802/1611] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 04:59:06 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 04:59:06.248841 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96663ee5-5806-4f6e-8f60-d220c6d68eab admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:06.259899 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96663ee5-5806-4f6e-8f60-d220c6d68eab admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:06.260218 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-27e4494b-0325-41dc-9845-e531de1711ae None None] MFA Rules not processed for user `6fe6cde1c4c94cb88bc41407cfca79e1`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:06.261539 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-27e4494b-0325-41dc-9845-e531de1711ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:06.265475 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7018a93c-81eb-46cd-bc62-d5724d38f3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:06.266481 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018a93c-81eb-46cd-bc62-d5724d38f3bf admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:06.266834 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018a93c-81eb-46cd-bc62-d5724d38f3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:06.267118 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018a93c-81eb-46cd-bc62-d5724d38f3bf admin admin] PATH_INFO: `/v3/projects/1d8144fae2194b5e96dc3900a7f5a276/users/97e3f4fb77bf41378fe4682392906764/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:06.283570 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7018a93c-81eb-46cd-bc62-d5724d38f3bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d8144fae2194b5e96dc3900a7f5a276, user_id=97e3f4fb77bf41378fe4682392906764, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:06.286714 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7018a93c-81eb-46cd-bc62-d5724d38f3bf admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:06.301567 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 803/1612] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 04:59:06 2021] PUT /identity/v3/projects/1d8144fae2194b5e96dc3900a7f5a276/users/97e3f4fb77bf41378fe4682392906764/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:59:06.302558 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7018a93c-81eb-46cd-bc62-d5724d38f3bf admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:06.342346 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 810/1613] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:06 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:06.343427 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4494b-0325-41dc-9845-e531de1711ae None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:06.355188 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4494b-0325-41dc-9845-e531de1711ae None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:06.378767 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7018a93c-81eb-46cd-bc62-d5724d38f3bf admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:06.386479 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e77909b-886e-4b40-bcc3-4aed3ad8d514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:06.386479 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e77909b-886e-4b40-bcc3-4aed3ad8d514 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:06.386479 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e77909b-886e-4b40-bcc3-4aed3ad8d514 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:06.386479 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e77909b-886e-4b40-bcc3-4aed3ad8d514 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:06.387314 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e77909b-886e-4b40-bcc3-4aed3ad8d514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:06.389808 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e77909b-886e-4b40-bcc3-4aed3ad8d514 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:06.406493 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 804/1614] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 04:59:06 2021] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 04:59:06.406493 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e77909b-886e-4b40-bcc3-4aed3ad8d514 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:06.417957 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e77909b-886e-4b40-bcc3-4aed3ad8d514 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:06.418381 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea31007-9896-4e89-8284-37c40715c11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:06.419126 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea31007-9896-4e89-8284-37c40715c11a admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:06.419416 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea31007-9896-4e89-8284-37c40715c11a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:06.419696 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea31007-9896-4e89-8284-37c40715c11a admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:06.420445 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea31007-9896-4e89-8284-37c40715c11a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:06.422119 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea31007-9896-4e89-8284-37c40715c11a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:06.423881 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab4c3a-54f0-486b-8b8b-5e0876d7f5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:06.424871 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab4c3a-54f0-486b-8b8b-5e0876d7f5c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:06.425251 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab4c3a-54f0-486b-8b8b-5e0876d7f5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:06.425585 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab4c3a-54f0-486b-8b8b-5e0876d7f5c7 admin admin] PATH_INFO: `/v3/projects/e1b7efd121ac4cf9a0965e95479e8da8/users/ca9159ba116140d2ad234b4b8d948215/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:06.435926 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 811/1615] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 04:59:06 2021] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 04:59:06.435926 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea31007-9896-4e89-8284-37c40715c11a admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:06.443805 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab4c3a-54f0-486b-8b8b-5e0876d7f5c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1b7efd121ac4cf9a0965e95479e8da8, user_id=ca9159ba116140d2ad234b4b8d948215, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:06.444387 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea31007-9896-4e89-8284-37c40715c11a admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:06.446989 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab4c3a-54f0-486b-8b8b-5e0876d7f5c7 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:06.449957 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f2023-0114-4908-8a5f-fee61280fe4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:06.451098 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f2023-0114-4908-8a5f-fee61280fe4a admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:06.451098 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f2023-0114-4908-8a5f-fee61280fe4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:06.451279 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f2023-0114-4908-8a5f-fee61280fe4a admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:06.451952 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f2023-0114-4908-8a5f-fee61280fe4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:06.453953 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f2023-0114-4908-8a5f-fee61280fe4a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:06.468259 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 812/1617] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 04:59:06 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 04:59:06.468259 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f2023-0114-4908-8a5f-fee61280fe4a admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:06.468798 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 805/1617] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 04:59:06 2021] PUT /identity/v3/projects/e1b7efd121ac4cf9a0965e95479e8da8/users/ca9159ba116140d2ad234b4b8d948215/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:59:06.471639 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa27f01-3284-49ca-8b80-22b0431981b7 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:06.471926 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa27f01-3284-49ca-8b80-22b0431981b7 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:06.472203 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa27f01-3284-49ca-8b80-22b0431981b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:06.481141 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f2023-0114-4908-8a5f-fee61280fe4a admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:06.505485 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-5fa27f01-3284-49ca-8b80-22b0431981b7 None None] MFA Rules not processed for user `97e3f4fb77bf41378fe4682392906764`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:06.506955 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-5fa27f01-3284-49ca-8b80-22b0431981b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:06.542604 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabafa3f-22f2-4c1b-ad3e-89356ab89e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:06.543813 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabafa3f-22f2-4c1b-ad3e-89356ab89e7a admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:06.544113 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabafa3f-22f2-4c1b-ad3e-89356ab89e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:06.544426 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabafa3f-22f2-4c1b-ad3e-89356ab89e7a admin admin] PATH_INFO: `/v3/projects/1b651e55b1a349a0b9582c526d3b5d67/users/fa2aab5929e746dbbc011b42927b8e37/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:06.562716 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabafa3f-22f2-4c1b-ad3e-89356ab89e7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b651e55b1a349a0b9582c526d3b5d67, user_id=fa2aab5929e746dbbc011b42927b8e37, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:06.566559 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabafa3f-22f2-4c1b-ad3e-89356ab89e7a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:06.586414 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 813/1618] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 04:59:06 2021] PUT /identity/v3/projects/1b651e55b1a349a0b9582c526d3b5d67/users/fa2aab5929e746dbbc011b42927b8e37/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:59:06.590646 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabafa3f-22f2-4c1b-ad3e-89356ab89e7a admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:06.597896 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 806/1619] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:06 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:06.598841 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa27f01-3284-49ca-8b80-22b0431981b7 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:06.614787 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa27f01-3284-49ca-8b80-22b0431981b7 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:06.663805 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabafa3f-22f2-4c1b-ad3e-89356ab89e7a admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:06.668809 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceedd010-1d4a-4f00-a7b5-13baa8200f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:06.669476 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceedd010-1d4a-4f00-a7b5-13baa8200f33 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:06.669757 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceedd010-1d4a-4f00-a7b5-13baa8200f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:06.670714 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceedd010-1d4a-4f00-a7b5-13baa8200f33 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:06.670714 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceedd010-1d4a-4f00-a7b5-13baa8200f33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:06.672732 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceedd010-1d4a-4f00-a7b5-13baa8200f33 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:06.685656 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9053d-4b99-4300-9d75-b4f8a33ff2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:06.686830 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9053d-4b99-4300-9d75-b4f8a33ff2ed admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:06.687037 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9053d-4b99-4300-9d75-b4f8a33ff2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:06.687523 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9053d-4b99-4300-9d75-b4f8a33ff2ed admin admin] PATH_INFO: `/v3/projects/14dbe9b1ff9041858e25c4fafebc1a51/users/61664b664e1d45e686290d000f94f5ab/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:06.700662 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 814/1620] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 04:59:06 2021] POST /identity/v3/projects => generated 379 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:59:06.700662 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceedd010-1d4a-4f00-a7b5-13baa8200f33 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:06.703112 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e9053d-4b99-4300-9d75-b4f8a33ff2ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=14dbe9b1ff9041858e25c4fafebc1a51, user_id=61664b664e1d45e686290d000f94f5ab, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:06.706055 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e9053d-4b99-4300-9d75-b4f8a33ff2ed admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:06.725078 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 807/1621] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 04:59:06 2021] PUT /identity/v3/projects/14dbe9b1ff9041858e25c4fafebc1a51/users/61664b664e1d45e686290d000f94f5ab/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:59:06.726600 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45dd646-ab05-4d96-947b-9a8c948bdf37 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:06.727041 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45dd646-ab05-4d96-947b-9a8c948bdf37 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:06.727409 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45dd646-ab05-4d96-947b-9a8c948bdf37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:06.746982 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-b45dd646-ab05-4d96-947b-9a8c948bdf37 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:06.748277 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-b45dd646-ab05-4d96-947b-9a8c948bdf37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:06.767548 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceedd010-1d4a-4f00-a7b5-13baa8200f33 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:06.809959 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 808/1622] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:06.810879 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45dd646-ab05-4d96-947b-9a8c948bdf37 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:06.820297 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45dd646-ab05-4d96-947b-9a8c948bdf37 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:06.825644 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3d0ae-ba04-420d-aa16-00e9d17834c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:06.826534 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3d0ae-ba04-420d-aa16-00e9d17834c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:06.826812 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3d0ae-ba04-420d-aa16-00e9d17834c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:06.827080 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3d0ae-ba04-420d-aa16-00e9d17834c9 admin admin] PATH_INFO: `/v3/projects/a0a31201e2084a198f151b0bfc556fa1/users/6ec4ea97212946149a29d76fd7839f1f/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:06.835623 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f37c0-8c33-4de1-81e1-efcf3fd609e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:06.836545 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f37c0-8c33-4de1-81e1-efcf3fd609e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:06.836835 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f37c0-8c33-4de1-81e1-efcf3fd609e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:06.837751 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f37c0-8c33-4de1-81e1-efcf3fd609e8 admin admin] PATH_INFO: `/v3/projects/8f1c3a94f02049e3a76c4fc01fa7a022/users/f29f576d3a98449b8077c0df53968f07/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:06.844436 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd3d0ae-ba04-420d-aa16-00e9d17834c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0a31201e2084a198f151b0bfc556fa1, user_id=6ec4ea97212946149a29d76fd7839f1f, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:06.847190 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd3d0ae-ba04-420d-aa16-00e9d17834c9 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:06.855484 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8f37c0-8c33-4de1-81e1-efcf3fd609e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f1c3a94f02049e3a76c4fc01fa7a022, user_id=f29f576d3a98449b8077c0df53968f07, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:06.859356 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8f37c0-8c33-4de1-81e1-efcf3fd609e8 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:06.864627 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 809/1623] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 04:59:06 2021] PUT /identity/v3/projects/a0a31201e2084a198f151b0bfc556fa1/users/6ec4ea97212946149a29d76fd7839f1f/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:59:06.879511 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 815/1624] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 04:59:06 2021] PUT /identity/v3/projects/8f1c3a94f02049e3a76c4fc01fa7a022/users/f29f576d3a98449b8077c0df53968f07/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:59:06.881438 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239b872-cf42-46d9-97a2-276d4bbaf418 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:06.881438 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239b872-cf42-46d9-97a2-276d4bbaf418 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:06.881678 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239b872-cf42-46d9-97a2-276d4bbaf418 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:06.883676 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 816/1625] 10.222.0.43 () {54 vars in 961 bytes} [Fri Dec 24 04:59:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:59:06.884377 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239b872-cf42-46d9-97a2-276d4bbaf418 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:06.888840 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f29326-1263-4c99-b6a8-19f436acecce None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:06.889302 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f29326-1263-4c99-b6a8-19f436acecce None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:06.889916 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f29326-1263-4c99-b6a8-19f436acecce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:06.908518 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-b3f29326-1263-4c99-b6a8-19f436acecce None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:06.909869 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-b3f29326-1263-4c99-b6a8-19f436acecce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:06.970675 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239b872-cf42-46d9-97a2-276d4bbaf418 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:06.977497 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ea377-2058-4d02-b4b1-6c810ab21e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:06.978219 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ea377-2058-4d02-b4b1-6c810ab21e77 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:06.978538 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ea377-2058-4d02-b4b1-6c810ab21e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:06.978867 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ea377-2058-4d02-b4b1-6c810ab21e77 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:06.979455 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 810/1626] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:06.981119 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ceca53-7cd3-48b5-a807-b5a7f5898a7d None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:06.981470 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ceca53-7cd3-48b5-a807-b5a7f5898a7d None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:06.981806 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ceca53-7cd3-48b5-a807-b5a7f5898a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:06.983131 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3ea377-2058-4d02-b4b1-6c810ab21e77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:06.985918 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3ea377-2058-4d02-b4b1-6c810ab21e77 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:07.003050 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-b3ceca53-7cd3-48b5-a807-b5a7f5898a7d None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:07.004413 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-b3ceca53-7cd3-48b5-a807-b5a7f5898a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:07.015207 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 817/1627] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 04:59:06 2021] POST /identity/v3/users => generated 296 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:59:07.015207 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ea377-2058-4d02-b4b1-6c810ab21e77 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:07.016062 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 811/1628] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:07.018209 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43edfcf0-b953-44e2-9885-c2252b73536a None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:07.018599 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43edfcf0-b953-44e2-9885-c2252b73536a None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:07.018967 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43edfcf0-b953-44e2-9885-c2252b73536a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:07.040204 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-43edfcf0-b953-44e2-9885-c2252b73536a None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:07.041839 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-43edfcf0-b953-44e2-9885-c2252b73536a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:07.059761 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 812/1629] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:07.059761 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc78a4b-4268-4890-bb14-a1a820b5f830 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:07.059761 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc78a4b-4268-4890-bb14-a1a820b5f830 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:07.059761 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc78a4b-4268-4890-bb14-a1a820b5f830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:07.096472 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ea377-2058-4d02-b4b1-6c810ab21e77 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:07.098574 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-cbc78a4b-4268-4890-bb14-a1a820b5f830 None None] MFA Rules not processed for user `6ec4ea97212946149a29d76fd7839f1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:07.099969 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-cbc78a4b-4268-4890-bb14-a1a820b5f830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:07.101642 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa765e-604a-45b8-87ba-b7d88500eb01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:07.102419 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa765e-604a-45b8-87ba-b7d88500eb01 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:07.102711 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa765e-604a-45b8-87ba-b7d88500eb01 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:07.102993 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa765e-604a-45b8-87ba-b7d88500eb01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:07.115814 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfa765e-604a-45b8-87ba-b7d88500eb01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:07.117409 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfa765e-604a-45b8-87ba-b7d88500eb01 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:07.129944 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 818/1630] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:59:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:59:07.131388 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec1aba-1b51-4918-b585-48e542f2782c None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:07.131684 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec1aba-1b51-4918-b585-48e542f2782c None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:07.132098 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec1aba-1b51-4918-b585-48e542f2782c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:07.154425 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-f1ec1aba-1b51-4918-b585-48e542f2782c None None] MFA Rules not processed for user `6f9ad1e8f8f74edcb44aabe17eb59648`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:07.155641 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-f1ec1aba-1b51-4918-b585-48e542f2782c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:07.181249 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 813/1631] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:07 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:07.185476 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc78a4b-4268-4890-bb14-a1a820b5f830 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:07.197553 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc78a4b-4268-4890-bb14-a1a820b5f830 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:07.205446 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c81f82-7c53-4139-b83d-0a1425d2d283 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:07.207183 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c81f82-7c53-4139-b83d-0a1425d2d283 service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:07.207506 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c81f82-7c53-4139-b83d-0a1425d2d283 service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:07.207786 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c81f82-7c53-4139-b83d-0a1425d2d283 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:07.221154 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c81f82-7c53-4139-b83d-0a1425d2d283 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:07.222679 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c81f82-7c53-4139-b83d-0a1425d2d283 service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:07.232937 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 814/1632] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:59:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:59:07.233771 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c81f82-7c53-4139-b83d-0a1425d2d283 service neutron] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:07.244241 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c81f82-7c53-4139-b83d-0a1425d2d283 service neutron] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:07.250126 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7581e7-d99a-4302-a704-c24646dabbac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:07.250389 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7581e7-d99a-4302-a704-c24646dabbac admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:07.250672 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7581e7-d99a-4302-a704-c24646dabbac admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:07.251172 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7581e7-d99a-4302-a704-c24646dabbac admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:07.252124 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7581e7-d99a-4302-a704-c24646dabbac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:07.253800 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7581e7-d99a-4302-a704-c24646dabbac admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:07.256637 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 819/1633] 10.222.0.43 () {58 vars in 1058 bytes} [Fri Dec 24 04:59:07 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:07.257778 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec1aba-1b51-4918-b585-48e542f2782c None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:07.272671 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec1aba-1b51-4918-b585-48e542f2782c None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:07.273791 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 815/1634] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 04:59:07 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 04:59:07.274692 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7581e7-d99a-4302-a704-c24646dabbac admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:07.285001 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eff7152-2e46-4f64-9281-6f23b2556a8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:07.286733 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff7152-2e46-4f64-9281-6f23b2556a8d service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:07.286863 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7581e7-d99a-4302-a704-c24646dabbac admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:07.287779 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff7152-2e46-4f64-9281-6f23b2556a8d service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:07.288997 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff7152-2e46-4f64-9281-6f23b2556a8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:07.295427 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f1dd6-57be-4948-a7ab-b64d6e6451bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:07.296096 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f1dd6-57be-4948-a7ab-b64d6e6451bb service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:07.296379 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f1dd6-57be-4948-a7ab-b64d6e6451bb service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:07.296748 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f1dd6-57be-4948-a7ab-b64d6e6451bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:07.307316 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665f1dd6-57be-4948-a7ab-b64d6e6451bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:07.308969 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665f1dd6-57be-4948-a7ab-b64d6e6451bb service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:07.319875 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eff7152-2e46-4f64-9281-6f23b2556a8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:07.322122 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eff7152-2e46-4f64-9281-6f23b2556a8d service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:07.322504 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 816/1635] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:59:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:59:07.323884 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9801e-542c-459f-a215-d4419f5eed24 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:07.324169 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9801e-542c-459f-a215-d4419f5eed24 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:07.324449 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9801e-542c-459f-a215-d4419f5eed24 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:07.326915 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 817/1636] 10.222.0.43 () {54 vars in 961 bytes} [Fri Dec 24 04:59:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:59:07.327539 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b9801e-542c-459f-a215-d4419f5eed24 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:07.344915 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b9801e-542c-459f-a215-d4419f5eed24 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:07.351660 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c979176e-6fbf-42ef-a9ed-28822c78ea52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f9ad1e8f8f74edcb44aabe17eb59648', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:07.352476 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979176e-6fbf-42ef-a9ed-28822c78ea52 service nova] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:07.352841 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979176e-6fbf-42ef-a9ed-28822c78ea52 service nova] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:07.353122 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979176e-6fbf-42ef-a9ed-28822c78ea52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:07.354577 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 820/1637] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:59:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:59:07.355271 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eff7152-2e46-4f64-9281-6f23b2556a8d service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:07.378670 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eff7152-2e46-4f64-9281-6f23b2556a8d service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:07.387241 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78405f37-e0ea-4ae4-bd1f-0a9d7c0f4c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:07.388145 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78405f37-e0ea-4ae4-bd1f-0a9d7c0f4c6f admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:07.388426 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78405f37-e0ea-4ae4-bd1f-0a9d7c0f4c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:07.389009 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78405f37-e0ea-4ae4-bd1f-0a9d7c0f4c6f admin admin] PATH_INFO: `/v3/projects/8091752497d14ce0935026b6e200c825/users/1da91a7c317a4600b63e02099b124080/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:07.419338 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78405f37-e0ea-4ae4-bd1f-0a9d7c0f4c6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8091752497d14ce0935026b6e200c825, user_id=1da91a7c317a4600b63e02099b124080, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:07.425983 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78405f37-e0ea-4ae4-bd1f-0a9d7c0f4c6f admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:07.447359 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c979176e-6fbf-42ef-a9ed-28822c78ea52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:07.450686 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c979176e-6fbf-42ef-a9ed-28822c78ea52 service nova] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:07.455021 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 821/1638] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 04:59:07 2021] PUT /identity/v3/projects/8091752497d14ce0935026b6e200c825/users/1da91a7c317a4600b63e02099b124080/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:59:07.455021 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4549b441-6514-4e21-920e-f2e5ffecbfe2 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:07.455021 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4549b441-6514-4e21-920e-f2e5ffecbfe2 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:07.455021 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4549b441-6514-4e21-920e-f2e5ffecbfe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:07.465179 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 818/1639] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:59:07 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:59:07.466583 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c979176e-6fbf-42ef-a9ed-28822c78ea52 service nova] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:07.484154 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c979176e-6fbf-42ef-a9ed-28822c78ea52 service nova] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:07.505611 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-4549b441-6514-4e21-920e-f2e5ffecbfe2 None None] MFA Rules not processed for user `6f9ad1e8f8f74edcb44aabe17eb59648`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:07.508086 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-4549b441-6514-4e21-920e-f2e5ffecbfe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:07.570683 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac98798-9e5c-44b1-b108-2e3c42fd27db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:07.571949 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac98798-9e5c-44b1-b108-2e3c42fd27db admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:07.573199 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac98798-9e5c-44b1-b108-2e3c42fd27db admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:07.573813 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac98798-9e5c-44b1-b108-2e3c42fd27db admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:07.575161 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac98798-9e5c-44b1-b108-2e3c42fd27db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:07.578626 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac98798-9e5c-44b1-b108-2e3c42fd27db admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:07.592068 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 819/1640] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 04:59:07 2021] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 04:59:07.596939 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac98798-9e5c-44b1-b108-2e3c42fd27db admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:07.613382 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac98798-9e5c-44b1-b108-2e3c42fd27db admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:07.618780 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e61018-6a27-4310-96fb-50201f281554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:07.620007 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e61018-6a27-4310-96fb-50201f281554 admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:07.620458 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e61018-6a27-4310-96fb-50201f281554 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:07.620942 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e61018-6a27-4310-96fb-50201f281554 admin admin] PATH_INFO: `/v3/projects/8091752497d14ce0935026b6e200c825/users/1da91a7c317a4600b63e02099b124080/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:07.623325 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e61018-6a27-4310-96fb-50201f281554 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8091752497d14ce0935026b6e200c825, user_id=1da91a7c317a4600b63e02099b124080, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:07.626656 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e61018-6a27-4310-96fb-50201f281554 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:07.641258 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 820/1641] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 04:59:07 2021] PUT /identity/v3/projects/8091752497d14ce0935026b6e200c825/users/1da91a7c317a4600b63e02099b124080/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:59:07.651852 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1daa3-9861-4630-baec-b716cca7fa66 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:07.652139 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1daa3-9861-4630-baec-b716cca7fa66 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:07.652414 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1daa3-9861-4630-baec-b716cca7fa66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:07.652848 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 822/1642] 10.222.0.43 () {58 vars in 1058 bytes} [Fri Dec 24 04:59:07 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:07.662017 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4549b441-6514-4e21-920e-f2e5ffecbfe2 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:07.673948 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4549b441-6514-4e21-920e-f2e5ffecbfe2 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:07.693941 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-10c1daa3-9861-4630-baec-b716cca7fa66 None None] MFA Rules not processed for user `1da91a7c317a4600b63e02099b124080`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:07.695254 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-10c1daa3-9861-4630-baec-b716cca7fa66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:07.777789 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 821/1643] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:07 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:07.800187 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1daa3-9861-4630-baec-b716cca7fa66 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:07.830661 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace05f5-ff82-4f70-b175-c4a2637c3498 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f9ad1e8f8f74edcb44aabe17eb59648', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:07.831341 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace05f5-ff82-4f70-b175-c4a2637c3498 service nova] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:07.831652 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace05f5-ff82-4f70-b175-c4a2637c3498 service nova] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:07.831881 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace05f5-ff82-4f70-b175-c4a2637c3498 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:07.926055 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1daa3-9861-4630-baec-b716cca7fa66 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:07.931542 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff291ebe-33b1-4fb3-bc3d-cc852603b4d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:07.932199 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff291ebe-33b1-4fb3-bc3d-cc852603b4d2 service cinder] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:07.932478 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff291ebe-33b1-4fb3-bc3d-cc852603b4d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:07.932912 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff291ebe-33b1-4fb3-bc3d-cc852603b4d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:07.945823 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace05f5-ff82-4f70-b175-c4a2637c3498 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:07.946520 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff291ebe-33b1-4fb3-bc3d-cc852603b4d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:07.948423 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff291ebe-33b1-4fb3-bc3d-cc852603b4d2 service cinder] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:07.950164 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace05f5-ff82-4f70-b175-c4a2637c3498 service nova] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:07.974009 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 822/1644] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:59:07 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:59:07.977687 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c8cb7-41ff-4a91-a855-57654d4249d2 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:07.978270 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c8cb7-41ff-4a91-a855-57654d4249d2 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:07.980293 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c8cb7-41ff-4a91-a855-57654d4249d2 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:07.985049 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 823/1645] 10.222.0.43 () {54 vars in 912 bytes} [Fri Dec 24 04:59:07 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:59:07.992247 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a5115-3d39-4378-aa5c-dabaa7bbf8e7 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:07.992935 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a5115-3d39-4378-aa5c-dabaa7bbf8e7 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:07.994294 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 823/1646] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:59:07 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 24 04:59:08.006165 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a5115-3d39-4378-aa5c-dabaa7bbf8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:08.062989 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-a50a5115-3d39-4378-aa5c-dabaa7bbf8e7 None None] MFA Rules not processed for user `6f9ad1e8f8f74edcb44aabe17eb59648`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:08.065626 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-a50a5115-3d39-4378-aa5c-dabaa7bbf8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:08.095639 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 824/1647] 10.222.0.43 () {58 vars in 1009 bytes} [Fri Dec 24 04:59:07 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:08.112257 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace05f5-ff82-4f70-b175-c4a2637c3498 service nova] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:08.121812 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a5115-3d39-4378-aa5c-dabaa7bbf8e7 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:08.124879 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace05f5-ff82-4f70-b175-c4a2637c3498 service nova] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:08.137752 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95aed18-f62a-48d8-ad86-49c80cdf546b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:08.139037 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a5115-3d39-4378-aa5c-dabaa7bbf8e7 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:08.140771 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95aed18-f62a-48d8-ad86-49c80cdf546b service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:08.140990 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95aed18-f62a-48d8-ad86-49c80cdf546b service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:08.142005 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95aed18-f62a-48d8-ad86-49c80cdf546b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:08.152822 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f4c33-5fcf-4018-bbb6-126c9e130b00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:08.153910 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f4c33-5fcf-4018-bbb6-126c9e130b00 service cinder] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:08.154598 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f4c33-5fcf-4018-bbb6-126c9e130b00 service cinder] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:08.155069 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f4c33-5fcf-4018-bbb6-126c9e130b00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:08.170460 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95aed18-f62a-48d8-ad86-49c80cdf546b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:08.175146 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95aed18-f62a-48d8-ad86-49c80cdf546b service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:08.203139 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 824/1648] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:59:08 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:59:08.288116 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2f4c33-5fcf-4018-bbb6-126c9e130b00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:08.289623 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2f4c33-5fcf-4018-bbb6-126c9e130b00 service cinder] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:08.317906 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 825/1649] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:59:08 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:59:08.620054 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f99b53-67a5-4379-8722-0cc4006615a7 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:08.620361 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f99b53-67a5-4379-8722-0cc4006615a7 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:08.620687 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f99b53-67a5-4379-8722-0cc4006615a7 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:08.623315 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 825/1650] 10.222.0.43 () {54 vars in 912 bytes} [Fri Dec 24 04:59:08 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:59:08.637197 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbbf1f5-a313-4133-a3f3-06e620a3f8a7 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:08.637707 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbbf1f5-a313-4133-a3f3-06e620a3f8a7 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:08.638225 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbbf1f5-a313-4133-a3f3-06e620a3f8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:08.678150 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-fcbbf1f5-a313-4133-a3f3-06e620a3f8a7 None None] MFA Rules not processed for user `6f9ad1e8f8f74edcb44aabe17eb59648`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:08.680213 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-fcbbf1f5-a313-4133-a3f3-06e620a3f8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:08.700140 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 826/1651] 10.222.0.43 () {58 vars in 1009 bytes} [Fri Dec 24 04:59:08 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:08.778220 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f99b53-67a5-4379-8722-0cc4006615a7 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:08.797406 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f99b53-67a5-4379-8722-0cc4006615a7 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:08.807444 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43e141-aaa8-404b-8b1c-fe1c2497f170 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:08.808206 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43e141-aaa8-404b-8b1c-fe1c2497f170 service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:08.808495 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43e141-aaa8-404b-8b1c-fe1c2497f170 service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:08.809191 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43e141-aaa8-404b-8b1c-fe1c2497f170 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:08.870157 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c43e141-aaa8-404b-8b1c-fe1c2497f170 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:08.871674 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c43e141-aaa8-404b-8b1c-fe1c2497f170 service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:08.911469 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 826/1652] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:59:08 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:59:09.394829 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbbf1f5-a313-4133-a3f3-06e620a3f8a7 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:09.535642 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbbf1f5-a313-4133-a3f3-06e620a3f8a7 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:09.545974 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec999600-9a4c-4a35-85e8-65f4356249fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:09.547380 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec999600-9a4c-4a35-85e8-65f4356249fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:09.547918 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec999600-9a4c-4a35-85e8-65f4356249fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:09.548490 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec999600-9a4c-4a35-85e8-65f4356249fe admin admin] PATH_INFO: `/v3/users/6ec4ea97212946149a29d76fd7839f1f` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:09.549944 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec999600-9a4c-4a35-85e8-65f4356249fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ec4ea97212946149a29d76fd7839f1f)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:09.551167 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: WARNING py.warnings [None req-ec999600-9a4c-4a35-85e8-65f4356249fe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:09.551167 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: warnings.warn(msg) Dec 24 04:59:09.551167 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: Dec 24 04:59:09.553163 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec999600-9a4c-4a35-85e8-65f4356249fe admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:09.678149 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-ec999600-9a4c-4a35-85e8-65f4356249fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ec4ea97212946149a29d76fd7839f1f'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:09.681785 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-ec999600-9a4c-4a35-85e8-65f4356249fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ec4ea97212946149a29d76fd7839f1f'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:09.717396 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-ec999600-9a4c-4a35-85e8-65f4356249fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ec4ea97212946149a29d76fd7839f1f'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:09.744580 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-ec999600-9a4c-4a35-85e8-65f4356249fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ec4ea97212946149a29d76fd7839f1f'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:09.746000 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-ec999600-9a4c-4a35-85e8-65f4356249fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ec4ea97212946149a29d76fd7839f1f'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:09.789901 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 827/1653] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 04:59:09 2021] DELETE /identity/v3/users/6ec4ea97212946149a29d76fd7839f1f => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 04:59:09.794626 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7fa20-1412-48b4-a8e0-fabb089bc42c None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:09.795206 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7fa20-1412-48b4-a8e0-fabb089bc42c None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:09.795206 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7fa20-1412-48b4-a8e0-fabb089bc42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:09.825914 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-95f7fa20-1412-48b4-a8e0-fabb089bc42c None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:09.832040 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-95f7fa20-1412-48b4-a8e0-fabb089bc42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:09.919958 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a414e81-45d4-4af3-af23-d359e0086897 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:09.921037 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a414e81-45d4-4af3-af23-d359e0086897 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:09.922021 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a414e81-45d4-4af3-af23-d359e0086897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:09.993843 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-5a414e81-45d4-4af3-af23-d359e0086897 None None] MFA Rules not processed for user `61664b664e1d45e686290d000f94f5ab`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:09.995041 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-5a414e81-45d4-4af3-af23-d359e0086897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:09.998858 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 827/1654] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:10.052987 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7fa20-1412-48b4-a8e0-fabb089bc42c None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:10.056024 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-95f7fa20-1412-48b4-a8e0-fabb089bc42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:10.142409 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 828/1655] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:09 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 04:59:10.156584 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172bf38-0c38-4b25-9129-332e7ef2cd53 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:10.157424 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172bf38-0c38-4b25-9129-332e7ef2cd53 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:10.158261 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172bf38-0c38-4b25-9129-332e7ef2cd53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:10.197117 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7fa20-1412-48b4-a8e0-fabb089bc42c None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:10.201540 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76393e81-ecf3-48fa-a4c2-f28ffdff9a77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:10.202679 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76393e81-ecf3-48fa-a4c2-f28ffdff9a77 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:10.203156 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76393e81-ecf3-48fa-a4c2-f28ffdff9a77 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:10.203658 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76393e81-ecf3-48fa-a4c2-f28ffdff9a77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:10.216629 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76393e81-ecf3-48fa-a4c2-f28ffdff9a77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:10.218582 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76393e81-ecf3-48fa-a4c2-f28ffdff9a77 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:10.225904 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-b172bf38-0c38-4b25-9129-332e7ef2cd53 None None] MFA Rules not processed for user `61664b664e1d45e686290d000f94f5ab`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:10.228779 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-b172bf38-0c38-4b25-9129-332e7ef2cd53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:10.238794 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 828/1656] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:59:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 24 04:59:10.244443 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 829/1657] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:10 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 04:59:10.256209 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76393e81-ecf3-48fa-a4c2-f28ffdff9a77 service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:10.258009 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-76393e81-ecf3-48fa-a4c2-f28ffdff9a77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:10.348575 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec9ab0-c0a7-454c-85e4-6eb87386cca6 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:10.348862 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec9ab0-c0a7-454c-85e4-6eb87386cca6 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:10.350242 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec9ab0-c0a7-454c-85e4-6eb87386cca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:10.410414 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76393e81-ecf3-48fa-a4c2-f28ffdff9a77 service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:10.411246 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-caec9ab0-c0a7-454c-85e4-6eb87386cca6 None None] MFA Rules not processed for user `ca9159ba116140d2ad234b4b8d948215`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:10.413609 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-caec9ab0-c0a7-454c-85e4-6eb87386cca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:10.427561 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac914930-784b-4789-a1f0-9bcb636c47d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f9ad1e8f8f74edcb44aabe17eb59648', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:10.429725 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac914930-784b-4789-a1f0-9bcb636c47d0 service nova] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:10.431216 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac914930-784b-4789-a1f0-9bcb636c47d0 service nova] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:10.431510 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac914930-784b-4789-a1f0-9bcb636c47d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:10.465774 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac914930-784b-4789-a1f0-9bcb636c47d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:10.471944 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac914930-784b-4789-a1f0-9bcb636c47d0 service nova] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:10.500981 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 829/1658] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:59:10 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:59:10.587845 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 830/1659] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:10 2021] POST /identity/v3/auth/tokens => generated 3272 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 04:59:10.592306 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac914930-784b-4789-a1f0-9bcb636c47d0 service nova] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:10.593927 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-ac914930-784b-4789-a1f0-9bcb636c47d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:10.628201 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac914930-784b-4789-a1f0-9bcb636c47d0 service nova] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:10.650803 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea7c4e8-e231-4846-b639-50ed54835bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:10.651647 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7c4e8-e231-4846-b639-50ed54835bc1 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:10.656654 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7c4e8-e231-4846-b639-50ed54835bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:10.658288 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7c4e8-e231-4846-b639-50ed54835bc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:10.659179 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea7c4e8-e231-4846-b639-50ed54835bc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:10.662633 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea7c4e8-e231-4846-b639-50ed54835bc1 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:10.768079 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 830/1660] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 04:59:10 2021] POST /identity/v3/projects => generated 405 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:59:10.772015 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec9ab0-c0a7-454c-85e4-6eb87386cca6 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:10.789054 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec9ab0-c0a7-454c-85e4-6eb87386cca6 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:10.875123 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e7bb52-f6a8-4d48-8877-a96b8a25a7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:10.875905 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7bb52-f6a8-4d48-8877-a96b8a25a7ea admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:10.876344 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7bb52-f6a8-4d48-8877-a96b8a25a7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:10.876867 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7bb52-f6a8-4d48-8877-a96b8a25a7ea admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:10.877656 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e7bb52-f6a8-4d48-8877-a96b8a25a7ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:10.879638 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e7bb52-f6a8-4d48-8877-a96b8a25a7ea admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:10.912742 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 831/1661] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 04:59:10 2021] POST /identity/v3/users => generated 309 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:59:10.913731 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea7c4e8-e231-4846-b639-50ed54835bc1 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:10.928994 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea7c4e8-e231-4846-b639-50ed54835bc1 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:10.934149 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7858b-59aa-4fe7-b716-a1accefa033b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:10.935580 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7858b-59aa-4fe7-b716-a1accefa033b admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:10.936797 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7858b-59aa-4fe7-b716-a1accefa033b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:10.936797 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7858b-59aa-4fe7-b716-a1accefa033b admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:10.937260 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a7858b-59aa-4fe7-b716-a1accefa033b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:10.939728 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a7858b-59aa-4fe7-b716-a1accefa033b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:10.974819 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa2ac9-16af-4212-ae47-318c41da4fbf None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:10.975400 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa2ac9-16af-4212-ae47-318c41da4fbf None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:10.976033 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa2ac9-16af-4212-ae47-318c41da4fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:10.983543 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 831/1662] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 04:59:10 2021] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 24 04:59:10.984866 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7858b-59aa-4fe7-b716-a1accefa033b admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:11.014841 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7858b-59aa-4fe7-b716-a1accefa033b admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:11.017091 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-70fa2ac9-16af-4212-ae47-318c41da4fbf None None] MFA Rules not processed for user `f29f576d3a98449b8077c0df53968f07`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:11.018708 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-70fa2ac9-16af-4212-ae47-318c41da4fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:11.032145 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7288e2d3-799a-4836-8759-c54258fb5383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:11.033273 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288e2d3-799a-4836-8759-c54258fb5383 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:11.033656 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288e2d3-799a-4836-8759-c54258fb5383 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:11.034032 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288e2d3-799a-4836-8759-c54258fb5383 admin admin] PATH_INFO: `/v3/projects/e58266cfa29a4eb9bcff4786a5161fac/users/3175dc8b9b4145ad9351b0bc8b16b644/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:11.092884 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7288e2d3-799a-4836-8759-c54258fb5383 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e58266cfa29a4eb9bcff4786a5161fac, user_id=3175dc8b9b4145ad9351b0bc8b16b644, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:11.095910 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7288e2d3-799a-4836-8759-c54258fb5383 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:11.107797 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 832/1663] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:10 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:11.107797 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa2ac9-16af-4212-ae47-318c41da4fbf None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:11.107797 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-70fa2ac9-16af-4212-ae47-318c41da4fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:11.125518 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa2ac9-16af-4212-ae47-318c41da4fbf None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:11.126127 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 832/1664] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 04:59:10 2021] PUT /identity/v3/projects/e58266cfa29a4eb9bcff4786a5161fac/users/3175dc8b9b4145ad9351b0bc8b16b644/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:59:11.128266 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e9cda-a85e-410a-b33e-8757f023ff34 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:11.128773 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e9cda-a85e-410a-b33e-8757f023ff34 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:11.129809 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e9cda-a85e-410a-b33e-8757f023ff34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:11.156903 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-1c9e9cda-a85e-410a-b33e-8757f023ff34 None None] MFA Rules not processed for user `f29f576d3a98449b8077c0df53968f07`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:11.159976 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-1c9e9cda-a85e-410a-b33e-8757f023ff34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:11.233276 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a17bf55-398a-4d3c-90ae-da0c8c1f6ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:11.234658 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17bf55-398a-4d3c-90ae-da0c8c1f6ad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:11.235661 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17bf55-398a-4d3c-90ae-da0c8c1f6ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:11.236097 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17bf55-398a-4d3c-90ae-da0c8c1f6ad6 admin admin] PATH_INFO: `/v3/projects/a0a31201e2084a198f151b0bfc556fa1` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:11.237595 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a17bf55-398a-4d3c-90ae-da0c8c1f6ad6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0a31201e2084a198f151b0bfc556fa1)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:11.239704 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a17bf55-398a-4d3c-90ae-da0c8c1f6ad6 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:11.248971 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 833/1665] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:11 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:11.250319 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e9cda-a85e-410a-b33e-8757f023ff34 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:11.262745 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e9cda-a85e-410a-b33e-8757f023ff34 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:11.270097 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d7db8-77c9-4b04-8c98-785fb5c670f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:11.271724 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d7db8-77c9-4b04-8c98-785fb5c670f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:11.272048 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d7db8-77c9-4b04-8c98-785fb5c670f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:11.272333 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d7db8-77c9-4b04-8c98-785fb5c670f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:11.273137 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d7db8-77c9-4b04-8c98-785fb5c670f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:11.274776 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d7db8-77c9-4b04-8c98-785fb5c670f6 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:11.294181 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 834/1666] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 04:59:11 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 04:59:11.295198 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d7db8-77c9-4b04-8c98-785fb5c670f6 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:11.297215 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-9c7d7db8-77c9-4b04-8c98-785fb5c670f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:11.349296 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-0a17bf55-398a-4d3c-90ae-da0c8c1f6ad6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0a31201e2084a198f151b0bfc556fa1', 'request_id': 'req-0a17bf55-398a-4d3c-90ae-da0c8c1f6ad6'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:11.366103 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-0a17bf55-398a-4d3c-90ae-da0c8c1f6ad6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0a31201e2084a198f151b0bfc556fa1', 'request_id': 'req-0a17bf55-398a-4d3c-90ae-da0c8c1f6ad6'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:11.377489 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-0a17bf55-398a-4d3c-90ae-da0c8c1f6ad6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0a31201e2084a198f151b0bfc556fa1', 'request_id': 'req-0a17bf55-398a-4d3c-90ae-da0c8c1f6ad6'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:11.403791 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d7db8-77c9-4b04-8c98-785fb5c670f6 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:11.407188 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-0a17bf55-398a-4d3c-90ae-da0c8c1f6ad6 admin admin] The token cache is being invalidate because project a0a31201e2084a198f151b0bfc556fa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 04:59:11.408826 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-0a17bf55-398a-4d3c-90ae-da0c8c1f6ad6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:11.411176 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-0a17bf55-398a-4d3c-90ae-da0c8c1f6ad6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:11.418691 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 833/1667] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 04:59:11 2021] DELETE /identity/v3/projects/a0a31201e2084a198f151b0bfc556fa1 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:59:11.419735 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a17bf55-398a-4d3c-90ae-da0c8c1f6ad6 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:11.424922 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-0a17bf55-398a-4d3c-90ae-da0c8c1f6ad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:11.512000 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a17bf55-398a-4d3c-90ae-da0c8c1f6ad6 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:11.519498 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7327295a-6126-40ad-8b7c-a1e078711ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:11.520802 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327295a-6126-40ad-8b7c-a1e078711ab9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:11.521659 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327295a-6126-40ad-8b7c-a1e078711ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:11.522167 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327295a-6126-40ad-8b7c-a1e078711ab9 admin admin] PATH_INFO: `/v3/projects/e58266cfa29a4eb9bcff4786a5161fac/users/3175dc8b9b4145ad9351b0bc8b16b644/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:11.525109 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7327295a-6126-40ad-8b7c-a1e078711ab9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e58266cfa29a4eb9bcff4786a5161fac, user_id=3175dc8b9b4145ad9351b0bc8b16b644, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:11.528261 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7327295a-6126-40ad-8b7c-a1e078711ab9 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:11.544729 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7128bd8d-b9bc-49ce-a939-2c879cd2e797 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f9ad1e8f8f74edcb44aabe17eb59648', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:11.548592 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128bd8d-b9bc-49ce-a939-2c879cd2e797 service nova] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:11.548592 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128bd8d-b9bc-49ce-a939-2c879cd2e797 service nova] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:11.548592 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128bd8d-b9bc-49ce-a939-2c879cd2e797 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:11.549194 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 834/1668] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 04:59:11 2021] PUT /identity/v3/projects/e58266cfa29a4eb9bcff4786a5161fac/users/3175dc8b9b4145ad9351b0bc8b16b644/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:59:11.550006 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-7128bd8d-b9bc-49ce-a939-2c879cd2e797 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:11.552936 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f446c3-7d2e-4e99-8e5f-f833764ddba4 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:11.554068 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f446c3-7d2e-4e99-8e5f-f833764ddba4 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:11.554783 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f446c3-7d2e-4e99-8e5f-f833764ddba4 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:11.558574 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 835/1669] 10.222.0.43 () {54 vars in 912 bytes} [Fri Dec 24 04:59:11 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:59:11.565194 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3207503-c80b-4f58-9104-13ea185f9ca7 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:11.565566 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3207503-c80b-4f58-9104-13ea185f9ca7 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:11.565930 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3207503-c80b-4f58-9104-13ea185f9ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:11.588175 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-e3207503-c80b-4f58-9104-13ea185f9ca7 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:11.589540 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-e3207503-c80b-4f58-9104-13ea185f9ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:11.630067 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7128bd8d-b9bc-49ce-a939-2c879cd2e797 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:11.632317 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7128bd8d-b9bc-49ce-a939-2c879cd2e797 service nova] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:11.645650 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 835/1670] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:59:11 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:59:11.647479 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d20243-ffe2-41a6-855b-05472f1ff8d6 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:11.647834 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d20243-ffe2-41a6-855b-05472f1ff8d6 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:11.648178 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d20243-ffe2-41a6-855b-05472f1ff8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:11.686180 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 836/1671] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:11.691591 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30fd28-c808-460a-82d5-90a865b83cca None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:11.692202 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30fd28-c808-460a-82d5-90a865b83cca None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:11.692717 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30fd28-c808-460a-82d5-90a865b83cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:11.706693 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-07d20243-ffe2-41a6-855b-05472f1ff8d6 None None] MFA Rules not processed for user `b36f253fbce04e9ea028f02ff57fb272`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:11.707983 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-07d20243-ffe2-41a6-855b-05472f1ff8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:11.731977 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-9f30fd28-c808-460a-82d5-90a865b83cca None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:11.738999 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-9f30fd28-c808-460a-82d5-90a865b83cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:11.761463 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 837/1672] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:11.762922 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30fd28-c808-460a-82d5-90a865b83cca None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:11.775113 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30fd28-c808-460a-82d5-90a865b83cca None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:11.782302 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1950f9f4-d5a8-4057-b743-628963bdaf9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:11.783204 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950f9f4-d5a8-4057-b743-628963bdaf9f admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:11.783688 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950f9f4-d5a8-4057-b743-628963bdaf9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:11.784146 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950f9f4-d5a8-4057-b743-628963bdaf9f admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:11.785169 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1950f9f4-d5a8-4057-b743-628963bdaf9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:59:11.785683 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1950f9f4-d5a8-4057-b743-628963bdaf9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:11.787637 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1950f9f4-d5a8-4057-b743-628963bdaf9f admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:11.793298 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 836/1673] 10.222.0.43 () {58 vars in 1009 bytes} [Fri Dec 24 04:59:11 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:11.807467 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 838/1674] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 04:59:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:59:11.812433 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d20243-ffe2-41a6-855b-05472f1ff8d6 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:11.828326 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d20243-ffe2-41a6-855b-05472f1ff8d6 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:11.834415 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c893c3-26fb-402f-b421-01ec62dc5916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:11.835409 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c893c3-26fb-402f-b421-01ec62dc5916 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:11.835689 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c893c3-26fb-402f-b421-01ec62dc5916 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:11.836164 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c893c3-26fb-402f-b421-01ec62dc5916 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:11.836936 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c893c3-26fb-402f-b421-01ec62dc5916 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:11.839095 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c893c3-26fb-402f-b421-01ec62dc5916 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:11.880740 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 837/1675] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 04:59:11 2021] POST /identity/v3/projects => generated 385 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 04:59:11.882054 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1950f9f4-d5a8-4057-b743-628963bdaf9f admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:11.892577 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1950f9f4-d5a8-4057-b743-628963bdaf9f admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:11.925849 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c893c3-26fb-402f-b421-01ec62dc5916 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:11.928611 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-37c893c3-26fb-402f-b421-01ec62dc5916 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:12.009784 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c893c3-26fb-402f-b421-01ec62dc5916 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:12.013670 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf8e97-8750-4dc5-b9b2-5b75de6a8b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:12.014045 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0221784-76e5-4a46-a27e-a8b3dbdb9e9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:12.014714 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0221784-76e5-4a46-a27e-a8b3dbdb9e9a service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:12.015002 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0221784-76e5-4a46-a27e-a8b3dbdb9e9a service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:12.015277 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0221784-76e5-4a46-a27e-a8b3dbdb9e9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:12.015786 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf8e97-8750-4dc5-b9b2-5b75de6a8b3e admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:12.016430 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf8e97-8750-4dc5-b9b2-5b75de6a8b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:12.017215 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf8e97-8750-4dc5-b9b2-5b75de6a8b3e admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:12.018193 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecf8e97-8750-4dc5-b9b2-5b75de6a8b3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:12.024822 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0221784-76e5-4a46-a27e-a8b3dbdb9e9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:12.025238 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecf8e97-8750-4dc5-b9b2-5b75de6a8b3e admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:12.026696 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0221784-76e5-4a46-a27e-a8b3dbdb9e9a service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:12.039574 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 838/1676] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:59:11 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:59:12.065743 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 839/1677] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 04:59:11 2021] POST /identity/v3/users => generated 293 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 04:59:12.070425 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0221784-76e5-4a46-a27e-a8b3dbdb9e9a service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:12.084322 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0221784-76e5-4a46-a27e-a8b3dbdb9e9a service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:12.090797 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8843d7a-ec21-4c06-a6be-55c287dcd832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:12.091637 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8843d7a-ec21-4c06-a6be-55c287dcd832 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:12.091923 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8843d7a-ec21-4c06-a6be-55c287dcd832 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:12.092200 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8843d7a-ec21-4c06-a6be-55c287dcd832 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:12.093894 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8843d7a-ec21-4c06-a6be-55c287dcd832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:12.096517 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8843d7a-ec21-4c06-a6be-55c287dcd832 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:12.115890 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 839/1678] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 04:59:12 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 04:59:12.116505 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf8e97-8750-4dc5-b9b2-5b75de6a8b3e admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:12.127873 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf8e97-8750-4dc5-b9b2-5b75de6a8b3e admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:12.132682 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609df87e-7cd5-4085-ac32-ae6148f32a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:12.133447 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609df87e-7cd5-4085-ac32-ae6148f32a3d admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:12.133803 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609df87e-7cd5-4085-ac32-ae6148f32a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:12.134151 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609df87e-7cd5-4085-ac32-ae6148f32a3d admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:12.134988 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609df87e-7cd5-4085-ac32-ae6148f32a3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:12.136718 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609df87e-7cd5-4085-ac32-ae6148f32a3d admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:12.150580 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 840/1679] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 04:59:12 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 24 04:59:12.151875 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8843d7a-ec21-4c06-a6be-55c287dcd832 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:12.163175 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8843d7a-ec21-4c06-a6be-55c287dcd832 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:12.172715 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ea3b9-b88a-49b5-bceb-aac083cbfae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:12.173824 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ea3b9-b88a-49b5-bceb-aac083cbfae3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:12.174172 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ea3b9-b88a-49b5-bceb-aac083cbfae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:12.174512 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ea3b9-b88a-49b5-bceb-aac083cbfae3 admin admin] PATH_INFO: `/v3/projects/ce275b31fb3c485b97d01509c24c3c58/users/943f35f334b043e38f4303b38631de91/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:12.191851 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02ea3b9-b88a-49b5-bceb-aac083cbfae3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce275b31fb3c485b97d01509c24c3c58, user_id=943f35f334b043e38f4303b38631de91, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:12.194477 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02ea3b9-b88a-49b5-bceb-aac083cbfae3 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:12.211320 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 840/1680] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 04:59:12 2021] PUT /identity/v3/projects/ce275b31fb3c485b97d01509c24c3c58/users/943f35f334b043e38f4303b38631de91/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:59:12.266097 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d070db-706c-4d60-8101-d8cf78dd81d5 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:12.267034 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d070db-706c-4d60-8101-d8cf78dd81d5 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:12.267340 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d070db-706c-4d60-8101-d8cf78dd81d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:12.344043 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-f2d070db-706c-4d60-8101-d8cf78dd81d5 None None] MFA Rules not processed for user `943f35f334b043e38f4303b38631de91`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:12.349054 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-f2d070db-706c-4d60-8101-d8cf78dd81d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:12.442748 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f11a126-2304-476e-9b1b-838081866f13 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:12.443430 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f11a126-2304-476e-9b1b-838081866f13 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:12.443945 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f11a126-2304-476e-9b1b-838081866f13 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:12.446515 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 841/1681] 10.222.0.43 () {54 vars in 912 bytes} [Fri Dec 24 04:59:12 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:59:12.456973 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a4d5ac-a387-4138-af0c-88aa61b06a8f None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:12.457586 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a4d5ac-a387-4138-af0c-88aa61b06a8f None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:12.458084 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a4d5ac-a387-4138-af0c-88aa61b06a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:12.492507 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-f3a4d5ac-a387-4138-af0c-88aa61b06a8f None None] MFA Rules not processed for user `b36f253fbce04e9ea028f02ff57fb272`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:12.500598 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-f3a4d5ac-a387-4138-af0c-88aa61b06a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:12.501433 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 841/1682] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:12 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:12.503983 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d070db-706c-4d60-8101-d8cf78dd81d5 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:12.589517 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 842/1683] 10.222.0.43 () {58 vars in 1009 bytes} [Fri Dec 24 04:59:12 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 04:59:12.611376 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a4d5ac-a387-4138-af0c-88aa61b06a8f None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:12.613709 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-f3a4d5ac-a387-4138-af0c-88aa61b06a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:12.639213 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a4d5ac-a387-4138-af0c-88aa61b06a8f None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:12.652346 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc249668-59f4-4c05-9999-addc442c44e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:12.654303 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc249668-59f4-4c05-9999-addc442c44e8 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:12.655274 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc249668-59f4-4c05-9999-addc442c44e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:12.656300 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc249668-59f4-4c05-9999-addc442c44e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:12.658774 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d070db-706c-4d60-8101-d8cf78dd81d5 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:12.676574 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a33281-1927-49b9-a239-b44d6d06c5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:12.680057 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a33281-1927-49b9-a239-b44d6d06c5db admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:12.680355 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a33281-1927-49b9-a239-b44d6d06c5db admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:12.680662 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a33281-1927-49b9-a239-b44d6d06c5db admin admin] PATH_INFO: `/v3/projects` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:12.683737 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc249668-59f4-4c05-9999-addc442c44e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:12.685379 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a33281-1927-49b9-a239-b44d6d06c5db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:12.689614 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc249668-59f4-4c05-9999-addc442c44e8 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:12.694489 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a33281-1927-49b9-a239-b44d6d06c5db admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:12.725405 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 843/1684] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:59:12 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:59:12.761158 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 842/1685] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 04:59:12 2021] POST /identity/v3/projects => generated 387 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:59:12.766733 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc249668-59f4-4c05-9999-addc442c44e8 service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:12.792463 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc249668-59f4-4c05-9999-addc442c44e8 service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:12.894977 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d00d2c-d899-4404-a615-c52ecbfc3390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:12.895573 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d00d2c-d899-4404-a615-c52ecbfc3390 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:12.895814 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d00d2c-d899-4404-a615-c52ecbfc3390 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:12.896342 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d00d2c-d899-4404-a615-c52ecbfc3390 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:12.897003 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d00d2c-d899-4404-a615-c52ecbfc3390 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:12.898938 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d00d2c-d899-4404-a615-c52ecbfc3390 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:12.947817 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 844/1686] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 04:59:12 2021] POST /identity/v3/users => generated 300 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:59:12.952175 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a33281-1927-49b9-a239-b44d6d06c5db admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:12.971014 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a33281-1927-49b9-a239-b44d6d06c5db admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:12.976038 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6fc38-aede-4518-b6b7-3ee06c5b2526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:12.976974 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6fc38-aede-4518-b6b7-3ee06c5b2526 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:12.977466 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6fc38-aede-4518-b6b7-3ee06c5b2526 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:12.977918 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6fc38-aede-4518-b6b7-3ee06c5b2526 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:12.978879 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a6fc38-aede-4518-b6b7-3ee06c5b2526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:12.981243 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a6fc38-aede-4518-b6b7-3ee06c5b2526 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:13.031309 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 843/1687] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 04:59:12 2021] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 04:59:13.037850 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d00d2c-d899-4404-a615-c52ecbfc3390 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:13.056342 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d00d2c-d899-4404-a615-c52ecbfc3390 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:13.071966 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c37075-9743-4b1f-851c-84cc782dc4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:13.072933 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c37075-9743-4b1f-851c-84cc782dc4ad admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:13.077675 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6fc38-aede-4518-b6b7-3ee06c5b2526 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:13.079469 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-f7a6fc38-aede-4518-b6b7-3ee06c5b2526 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:13.086253 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c37075-9743-4b1f-851c-84cc782dc4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:13.086453 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c37075-9743-4b1f-851c-84cc782dc4ad admin admin] PATH_INFO: `/v3/projects/ae09310e88544d5595573c7cd859b803/users/91741c560b874307aa4675b9fcd201fe/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:13.134105 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c37075-9743-4b1f-851c-84cc782dc4ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae09310e88544d5595573c7cd859b803, user_id=91741c560b874307aa4675b9fcd201fe, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:13.137248 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c37075-9743-4b1f-851c-84cc782dc4ad admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:13.157353 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 845/1688] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 04:59:13 2021] PUT /identity/v3/projects/ae09310e88544d5595573c7cd859b803/users/91741c560b874307aa4675b9fcd201fe/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:59:13.165565 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c37075-9743-4b1f-851c-84cc782dc4ad admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:13.199815 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6fc38-aede-4518-b6b7-3ee06c5b2526 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:13.286157 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c37075-9743-4b1f-851c-84cc782dc4ad admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:13.298787 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4897eb-2d00-45d1-a12b-2c0f6f294d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:13.299377 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4897eb-2d00-45d1-a12b-2c0f6f294d97 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:13.299654 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4897eb-2d00-45d1-a12b-2c0f6f294d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:13.299925 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4897eb-2d00-45d1-a12b-2c0f6f294d97 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:13.300567 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e64998-9fe4-49af-8dfd-25d7cdd7ff01 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '430d6177e74c4dbda7fb83d04c75617e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:13.300794 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4897eb-2d00-45d1-a12b-2c0f6f294d97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:13.301669 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e64998-9fe4-49af-8dfd-25d7cdd7ff01 service placement] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:13.302165 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e64998-9fe4-49af-8dfd-25d7cdd7ff01 service placement] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:13.302446 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4897eb-2d00-45d1-a12b-2c0f6f294d97 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:13.305560 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e64998-9fe4-49af-8dfd-25d7cdd7ff01 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:13.310096 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-41e64998-9fe4-49af-8dfd-25d7cdd7ff01 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:13.335857 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 846/1689] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 04:59:13 2021] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 04:59:13.336900 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4897eb-2d00-45d1-a12b-2c0f6f294d97 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:13.337947 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e64998-9fe4-49af-8dfd-25d7cdd7ff01 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:13.339949 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e64998-9fe4-49af-8dfd-25d7cdd7ff01 service placement] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:13.347373 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4897eb-2d00-45d1-a12b-2c0f6f294d97 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:13.353233 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476dafa2-9b00-4374-8cde-6b44d621f8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:13.354123 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476dafa2-9b00-4374-8cde-6b44d621f8fc admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:13.354394 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476dafa2-9b00-4374-8cde-6b44d621f8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:13.354671 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476dafa2-9b00-4374-8cde-6b44d621f8fc admin admin] PATH_INFO: `/v3/projects/ae09310e88544d5595573c7cd859b803/users/91741c560b874307aa4675b9fcd201fe/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:13.356856 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476dafa2-9b00-4374-8cde-6b44d621f8fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae09310e88544d5595573c7cd859b803, user_id=91741c560b874307aa4675b9fcd201fe, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:13.359499 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476dafa2-9b00-4374-8cde-6b44d621f8fc admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:13.365655 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 844/1690] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:59:13 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:59:13.372230 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 847/1691] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 04:59:13 2021] PUT /identity/v3/projects/ae09310e88544d5595573c7cd859b803/users/91741c560b874307aa4675b9fcd201fe/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:59:13.382940 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb366b-d719-403c-bb3d-1c4e664d8716 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:13.383584 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb366b-d719-403c-bb3d-1c4e664d8716 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:13.384096 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb366b-d719-403c-bb3d-1c4e664d8716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:13.446253 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-06bb366b-d719-403c-bb3d-1c4e664d8716 None None] MFA Rules not processed for user `91741c560b874307aa4675b9fcd201fe`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:13.449415 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-06bb366b-d719-403c-bb3d-1c4e664d8716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:13.625306 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 845/1692] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:13 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:13.642805 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476dafa2-9b00-4374-8cde-6b44d621f8fc admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:13.645592 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-476dafa2-9b00-4374-8cde-6b44d621f8fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:13.863548 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476dafa2-9b00-4374-8cde-6b44d621f8fc admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:13.875075 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29430444-4a70-4a2e-90c2-d27e85a64acf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:13.876615 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29430444-4a70-4a2e-90c2-d27e85a64acf service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:13.878634 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29430444-4a70-4a2e-90c2-d27e85a64acf service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:13.879458 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29430444-4a70-4a2e-90c2-d27e85a64acf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:13.898835 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78b74e-70f1-4efa-a8db-7cef861da53e None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:13.899560 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78b74e-70f1-4efa-a8db-7cef861da53e None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:13.899560 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78b74e-70f1-4efa-a8db-7cef861da53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:13.918905 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29430444-4a70-4a2e-90c2-d27e85a64acf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:13.921184 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29430444-4a70-4a2e-90c2-d27e85a64acf service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:13.950110 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 848/1693] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:59:13 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:59:14.002029 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-cc78b74e-70f1-4efa-a8db-7cef861da53e None None] MFA Rules not processed for user `3175dc8b9b4145ad9351b0bc8b16b644`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:14.012019 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-cc78b74e-70f1-4efa-a8db-7cef861da53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:14.246360 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 846/1694] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:13 2021] POST /identity/v3/auth/tokens => generated 3339 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 04:59:15.370748 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29430444-4a70-4a2e-90c2-d27e85a64acf service cinder] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:15.487343 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29430444-4a70-4a2e-90c2-d27e85a64acf service cinder] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:15.500695 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b5d08-dce8-4820-9097-662114973ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:15.503660 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b5d08-dce8-4820-9097-662114973ca1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:15.504216 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b5d08-dce8-4820-9097-662114973ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:15.504742 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b5d08-dce8-4820-9097-662114973ca1 admin admin] PATH_INFO: `/v3/users/943f35f334b043e38f4303b38631de91` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:15.506816 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90b5d08-dce8-4820-9097-662114973ca1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=943f35f334b043e38f4303b38631de91)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:15.511817 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90b5d08-dce8-4820-9097-662114973ca1 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:15.601539 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-e90b5d08-dce8-4820-9097-662114973ca1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '943f35f334b043e38f4303b38631de91'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:15.603518 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-e90b5d08-dce8-4820-9097-662114973ca1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '943f35f334b043e38f4303b38631de91'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:15.616204 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-e90b5d08-dce8-4820-9097-662114973ca1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '943f35f334b043e38f4303b38631de91'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:15.626496 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-e90b5d08-dce8-4820-9097-662114973ca1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '943f35f334b043e38f4303b38631de91'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:15.646385 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-e90b5d08-dce8-4820-9097-662114973ca1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '943f35f334b043e38f4303b38631de91'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:15.654275 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 849/1695] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 04:59:15 2021] DELETE /identity/v3/users/943f35f334b043e38f4303b38631de91 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:59:15.658985 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f261c-a6c9-4dfb-9206-061511320ac7 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:15.659484 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f261c-a6c9-4dfb-9206-061511320ac7 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:15.659576 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f261c-a6c9-4dfb-9206-061511320ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:15.693620 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-0f6f261c-a6c9-4dfb-9206-061511320ac7 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:15.695472 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-0f6f261c-a6c9-4dfb-9206-061511320ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:15.786498 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 847/1696] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:15.808071 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b5d08-dce8-4820-9097-662114973ca1 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:15.810378 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-e90b5d08-dce8-4820-9097-662114973ca1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:15.895865 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b5d08-dce8-4820-9097-662114973ca1 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:15.899916 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53e477-3f06-4b00-b415-04ef37bc6592 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:15.900633 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53e477-3f06-4b00-b415-04ef37bc6592 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:15.900968 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53e477-3f06-4b00-b415-04ef37bc6592 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:15.901243 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53e477-3f06-4b00-b415-04ef37bc6592 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:15.918872 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af53e477-3f06-4b00-b415-04ef37bc6592 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:15.924355 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af53e477-3f06-4b00-b415-04ef37bc6592 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:15.942128 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 850/1697] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:59:15 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:59:16.583834 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f261c-a6c9-4dfb-9206-061511320ac7 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:16.585811 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-0f6f261c-a6c9-4dfb-9206-061511320ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:16.622308 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f261c-a6c9-4dfb-9206-061511320ac7 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:16.628694 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581247b6-7c32-47f4-9879-8123e23d4a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:16.629930 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581247b6-7c32-47f4-9879-8123e23d4a62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:16.630650 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581247b6-7c32-47f4-9879-8123e23d4a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:16.631111 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581247b6-7c32-47f4-9879-8123e23d4a62 admin admin] PATH_INFO: `/v3/projects/ce275b31fb3c485b97d01509c24c3c58` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:16.632938 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581247b6-7c32-47f4-9879-8123e23d4a62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce275b31fb3c485b97d01509c24c3c58)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:16.636033 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581247b6-7c32-47f4-9879-8123e23d4a62 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:16.714313 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-581247b6-7c32-47f4-9879-8123e23d4a62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce275b31fb3c485b97d01509c24c3c58', 'request_id': 'req-581247b6-7c32-47f4-9879-8123e23d4a62'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:16.724677 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-581247b6-7c32-47f4-9879-8123e23d4a62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce275b31fb3c485b97d01509c24c3c58', 'request_id': 'req-581247b6-7c32-47f4-9879-8123e23d4a62'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:16.734621 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-581247b6-7c32-47f4-9879-8123e23d4a62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce275b31fb3c485b97d01509c24c3c58', 'request_id': 'req-581247b6-7c32-47f4-9879-8123e23d4a62'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:16.757426 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-581247b6-7c32-47f4-9879-8123e23d4a62 admin admin] The token cache is being invalidate because project ce275b31fb3c485b97d01509c24c3c58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 04:59:16.757781 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-581247b6-7c32-47f4-9879-8123e23d4a62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:16.759774 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-581247b6-7c32-47f4-9879-8123e23d4a62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:16.762274 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 848/1698] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 04:59:16 2021] DELETE /identity/v3/projects/ce275b31fb3c485b97d01509c24c3c58 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:59:16.765995 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53e477-3f06-4b00-b415-04ef37bc6592 service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:16.777573 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53e477-3f06-4b00-b415-04ef37bc6592 service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:16.886475 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3c724-f362-4094-ae9f-56b67b03a907 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:16.887152 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3c724-f362-4094-ae9f-56b67b03a907 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:16.887435 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3c724-f362-4094-ae9f-56b67b03a907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:16.940568 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-4fe3c724-f362-4094-ae9f-56b67b03a907 None None] MFA Rules not processed for user `979cc4a0723b4543a16197d393c7929a`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:16.942024 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-4fe3c724-f362-4094-ae9f-56b67b03a907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:16.944500 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c8c079-789b-402f-a054-7c15649c1800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:16.945423 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8c079-789b-402f-a054-7c15649c1800 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:16.945703 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8c079-789b-402f-a054-7c15649c1800 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:16.945979 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8c079-789b-402f-a054-7c15649c1800 admin admin] PATH_INFO: `/v3/users/91741c560b874307aa4675b9fcd201fe` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:16.949296 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c8c079-789b-402f-a054-7c15649c1800 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91741c560b874307aa4675b9fcd201fe)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:16.951756 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c8c079-789b-402f-a054-7c15649c1800 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:17.067954 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 849/1699] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:16 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 04:59:17.069986 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-e0c8c079-789b-402f-a054-7c15649c1800 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91741c560b874307aa4675b9fcd201fe'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:17.080871 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-e0c8c079-789b-402f-a054-7c15649c1800 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91741c560b874307aa4675b9fcd201fe'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:17.082527 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe3c724-f362-4094-ae9f-56b67b03a907 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:17.084308 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-4fe3c724-f362-4094-ae9f-56b67b03a907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:17.096943 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-e0c8c079-789b-402f-a054-7c15649c1800 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91741c560b874307aa4675b9fcd201fe'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:17.121150 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-e0c8c079-789b-402f-a054-7c15649c1800 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91741c560b874307aa4675b9fcd201fe'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:17.148554 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-e0c8c079-789b-402f-a054-7c15649c1800 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91741c560b874307aa4675b9fcd201fe'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:17.163274 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 851/1700] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 04:59:16 2021] DELETE /identity/v3/users/91741c560b874307aa4675b9fcd201fe => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:59:17.259081 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe3c724-f362-4094-ae9f-56b67b03a907 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:17.354202 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea12f6-e221-48f6-8e20-8ba61f32e481 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f9ad1e8f8f74edcb44aabe17eb59648', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:17.354976 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea12f6-e221-48f6-8e20-8ba61f32e481 service nova] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:17.355333 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea12f6-e221-48f6-8e20-8ba61f32e481 service nova] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:17.355703 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea12f6-e221-48f6-8e20-8ba61f32e481 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:17.358646 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-8bea12f6-e221-48f6-8e20-8ba61f32e481 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:17.431129 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea12f6-e221-48f6-8e20-8ba61f32e481 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:17.432967 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea12f6-e221-48f6-8e20-8ba61f32e481 service nova] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:17.445952 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 850/1701] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:59:17 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 24 04:59:17.580467 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c8c079-789b-402f-a054-7c15649c1800 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:17.582054 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-e0c8c079-789b-402f-a054-7c15649c1800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:17.737311 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c8c079-789b-402f-a054-7c15649c1800 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:17.743910 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f35ac04-a9ef-462c-b839-df2e0912ac74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:17.744905 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35ac04-a9ef-462c-b839-df2e0912ac74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:17.745193 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35ac04-a9ef-462c-b839-df2e0912ac74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:17.745471 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35ac04-a9ef-462c-b839-df2e0912ac74 admin admin] PATH_INFO: `/v3/users/ca9159ba116140d2ad234b4b8d948215` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:17.746714 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f35ac04-a9ef-462c-b839-df2e0912ac74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca9159ba116140d2ad234b4b8d948215)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:17.748710 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f35ac04-a9ef-462c-b839-df2e0912ac74 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:17.864148 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea12f6-e221-48f6-8e20-8ba61f32e481 service nova] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:17.864778 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-7f35ac04-a9ef-462c-b839-df2e0912ac74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca9159ba116140d2ad234b4b8d948215'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:17.864778 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-7f35ac04-a9ef-462c-b839-df2e0912ac74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca9159ba116140d2ad234b4b8d948215'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:17.866012 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-8bea12f6-e221-48f6-8e20-8ba61f32e481 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:17.866162 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-7f35ac04-a9ef-462c-b839-df2e0912ac74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca9159ba116140d2ad234b4b8d948215'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:17.869385 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-7f35ac04-a9ef-462c-b839-df2e0912ac74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca9159ba116140d2ad234b4b8d948215'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:17.889094 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-7f35ac04-a9ef-462c-b839-df2e0912ac74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca9159ba116140d2ad234b4b8d948215'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:17.910819 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 852/1702] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 04:59:17 2021] DELETE /identity/v3/users/ca9159ba116140d2ad234b4b8d948215 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:59:17.912436 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea12f6-e221-48f6-8e20-8ba61f32e481 service nova] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:18.050195 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d59015-7e23-43f1-8ade-b0797339a6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:18.051353 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d59015-7e23-43f1-8ade-b0797339a6ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:18.051777 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d59015-7e23-43f1-8ade-b0797339a6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:18.052910 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d59015-7e23-43f1-8ade-b0797339a6ff admin admin] PATH_INFO: `/v3/projects/ae09310e88544d5595573c7cd859b803` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:18.054364 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d59015-7e23-43f1-8ade-b0797339a6ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae09310e88544d5595573c7cd859b803)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:18.056935 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d59015-7e23-43f1-8ade-b0797339a6ff admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:18.149437 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-43d59015-7e23-43f1-8ade-b0797339a6ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae09310e88544d5595573c7cd859b803', 'request_id': 'req-43d59015-7e23-43f1-8ade-b0797339a6ff'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:18.167695 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-43d59015-7e23-43f1-8ade-b0797339a6ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae09310e88544d5595573c7cd859b803', 'request_id': 'req-43d59015-7e23-43f1-8ade-b0797339a6ff'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:18.176228 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-43d59015-7e23-43f1-8ade-b0797339a6ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae09310e88544d5595573c7cd859b803', 'request_id': 'req-43d59015-7e23-43f1-8ade-b0797339a6ff'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:18.204273 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-43d59015-7e23-43f1-8ade-b0797339a6ff admin admin] The token cache is being invalidate because project ae09310e88544d5595573c7cd859b803 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 04:59:18.204640 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-43d59015-7e23-43f1-8ade-b0797339a6ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:18.205553 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-43d59015-7e23-43f1-8ade-b0797339a6ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:18.210973 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 851/1703] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 04:59:17 2021] DELETE /identity/v3/projects/ae09310e88544d5595573c7cd859b803 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:59:18.216838 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582cf9bd-99b4-4dd2-9aa9-6d0193b3ee4a None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:18.217122 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582cf9bd-99b4-4dd2-9aa9-6d0193b3ee4a None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:18.217394 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582cf9bd-99b4-4dd2-9aa9-6d0193b3ee4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:18.263612 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-582cf9bd-99b4-4dd2-9aa9-6d0193b3ee4a None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:18.264927 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-582cf9bd-99b4-4dd2-9aa9-6d0193b3ee4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:18.404125 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d59015-7e23-43f1-8ade-b0797339a6ff admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:18.405916 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-43d59015-7e23-43f1-8ade-b0797339a6ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:18.481612 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 853/1704] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:18.491720 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f32bf-739c-4624-8588-fbbce6cd7f59 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:18.492043 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f32bf-739c-4624-8588-fbbce6cd7f59 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:18.492326 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f32bf-739c-4624-8588-fbbce6cd7f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:18.563327 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-758f32bf-739c-4624-8588-fbbce6cd7f59 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:18.567171 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-758f32bf-739c-4624-8588-fbbce6cd7f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:18.600444 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 854/1705] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:18.603309 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f32bf-739c-4624-8588-fbbce6cd7f59 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:18.626410 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d59015-7e23-43f1-8ade-b0797339a6ff admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:18.636246 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f32bf-739c-4624-8588-fbbce6cd7f59 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:18.656576 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e98ff2-8861-4d92-92ad-af161f0edd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:18.658334 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e98ff2-8861-4d92-92ad-af161f0edd3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:18.658828 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e98ff2-8861-4d92-92ad-af161f0edd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:18.659352 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e98ff2-8861-4d92-92ad-af161f0edd3d admin admin] PATH_INFO: `/v3/projects/e1b7efd121ac4cf9a0965e95479e8da8` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:18.661284 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e98ff2-8861-4d92-92ad-af161f0edd3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1b7efd121ac4cf9a0965e95479e8da8)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:18.664476 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e98ff2-8861-4d92-92ad-af161f0edd3d admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:18.673727 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a778d80-538f-4799-af2d-95fbfacbe2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:18.676610 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a778d80-538f-4799-af2d-95fbfacbe2b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:18.676900 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a778d80-538f-4799-af2d-95fbfacbe2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:18.677173 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a778d80-538f-4799-af2d-95fbfacbe2b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:18.677980 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a778d80-538f-4799-af2d-95fbfacbe2b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:59:18.678260 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a778d80-538f-4799-af2d-95fbfacbe2b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:18.679934 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a778d80-538f-4799-af2d-95fbfacbe2b0 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:18.731861 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 855/1706] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 04:59:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:59:18.738846 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a778d80-538f-4799-af2d-95fbfacbe2b0 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:18.767875 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a778d80-538f-4799-af2d-95fbfacbe2b0 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:18.809198 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-a5e98ff2-8861-4d92-92ad-af161f0edd3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1b7efd121ac4cf9a0965e95479e8da8', 'request_id': 'req-a5e98ff2-8861-4d92-92ad-af161f0edd3d'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:18.824891 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-a5e98ff2-8861-4d92-92ad-af161f0edd3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1b7efd121ac4cf9a0965e95479e8da8', 'request_id': 'req-a5e98ff2-8861-4d92-92ad-af161f0edd3d'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:18.853299 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-a5e98ff2-8861-4d92-92ad-af161f0edd3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1b7efd121ac4cf9a0965e95479e8da8', 'request_id': 'req-a5e98ff2-8861-4d92-92ad-af161f0edd3d'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:18.900454 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ad13bb-453f-44d5-942c-d61babeafd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:18.901301 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-a5e98ff2-8861-4d92-92ad-af161f0edd3d admin admin] The token cache is being invalidate because project e1b7efd121ac4cf9a0965e95479e8da8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 04:59:18.901707 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad13bb-453f-44d5-942c-d61babeafd78 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:18.901785 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-a5e98ff2-8861-4d92-92ad-af161f0edd3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:18.902024 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad13bb-453f-44d5-942c-d61babeafd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:18.902307 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad13bb-453f-44d5-942c-d61babeafd78 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:18.904976 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ad13bb-453f-44d5-942c-d61babeafd78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:18.909909 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ad13bb-453f-44d5-942c-d61babeafd78 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:18.910671 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-a5e98ff2-8861-4d92-92ad-af161f0edd3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:18.914352 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 852/1707] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 04:59:18 2021] DELETE /identity/v3/projects/e1b7efd121ac4cf9a0965e95479e8da8 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 04:59:18.915162 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e98ff2-8861-4d92-92ad-af161f0edd3d admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:18.923480 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-a5e98ff2-8861-4d92-92ad-af161f0edd3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:18.963889 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e98ff2-8861-4d92-92ad-af161f0edd3d admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:19.004574 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 856/1708] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 04:59:18 2021] POST /identity/v3/projects => generated 381 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:59:19.008150 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ad13bb-453f-44d5-942c-d61babeafd78 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:19.017195 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-55ad13bb-453f-44d5-942c-d61babeafd78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:19.088711 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977781f-3763-42b9-b504-a277daf7f431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:19.089597 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977781f-3763-42b9-b504-a277daf7f431 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:19.091158 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977781f-3763-42b9-b504-a277daf7f431 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:19.091435 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977781f-3763-42b9-b504-a277daf7f431 admin admin] PATH_INFO: `/v3/users/97e3f4fb77bf41378fe4682392906764` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:19.095479 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f977781f-3763-42b9-b504-a277daf7f431 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97e3f4fb77bf41378fe4682392906764)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:19.099040 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f977781f-3763-42b9-b504-a277daf7f431 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:19.176111 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ad13bb-453f-44d5-942c-d61babeafd78 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:19.192947 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb12c0f3-687b-42b1-aa06-1d3856e79fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:19.193835 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12c0f3-687b-42b1-aa06-1d3856e79fb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:19.194111 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12c0f3-687b-42b1-aa06-1d3856e79fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:19.194473 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12c0f3-687b-42b1-aa06-1d3856e79fb2 admin admin] PATH_INFO: `/v3/users/3175dc8b9b4145ad9351b0bc8b16b644` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:19.195841 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb12c0f3-687b-42b1-aa06-1d3856e79fb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3175dc8b9b4145ad9351b0bc8b16b644)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:19.197977 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb12c0f3-687b-42b1-aa06-1d3856e79fb2 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:19.271999 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-f977781f-3763-42b9-b504-a277daf7f431 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97e3f4fb77bf41378fe4682392906764'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:19.274646 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-f977781f-3763-42b9-b504-a277daf7f431 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97e3f4fb77bf41378fe4682392906764'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:19.316110 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-f977781f-3763-42b9-b504-a277daf7f431 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97e3f4fb77bf41378fe4682392906764'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:19.337961 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-cb12c0f3-687b-42b1-aa06-1d3856e79fb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3175dc8b9b4145ad9351b0bc8b16b644'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:19.338686 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-cb12c0f3-687b-42b1-aa06-1d3856e79fb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3175dc8b9b4145ad9351b0bc8b16b644'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:19.347007 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-f977781f-3763-42b9-b504-a277daf7f431 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97e3f4fb77bf41378fe4682392906764'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:19.347989 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-f977781f-3763-42b9-b504-a277daf7f431 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97e3f4fb77bf41378fe4682392906764'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:19.366301 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-cb12c0f3-687b-42b1-aa06-1d3856e79fb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3175dc8b9b4145ad9351b0bc8b16b644'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:19.390548 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-cb12c0f3-687b-42b1-aa06-1d3856e79fb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3175dc8b9b4145ad9351b0bc8b16b644'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:19.408036 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 853/1709] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 04:59:18 2021] DELETE /identity/v3/users/97e3f4fb77bf41378fe4682392906764 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:59:19.409000 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977781f-3763-42b9-b504-a277daf7f431 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:19.412233 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-f977781f-3763-42b9-b504-a277daf7f431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:19.420767 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-cb12c0f3-687b-42b1-aa06-1d3856e79fb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3175dc8b9b4145ad9351b0bc8b16b644'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:19.435367 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 857/1710] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 04:59:19 2021] DELETE /identity/v3/users/3175dc8b9b4145ad9351b0bc8b16b644 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:59:19.438109 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298274a8-41c7-4b46-aef1-f4287b969202 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:19.438865 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298274a8-41c7-4b46-aef1-f4287b969202 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:19.439277 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298274a8-41c7-4b46-aef1-f4287b969202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:19.550703 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-298274a8-41c7-4b46-aef1-f4287b969202 None None] MFA Rules not processed for user `fa2aab5929e746dbbc011b42927b8e37`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:19.552199 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-298274a8-41c7-4b46-aef1-f4287b969202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:19.664958 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977781f-3763-42b9-b504-a277daf7f431 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:19.675609 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 858/1711] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:19 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:19.677171 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775cadca-797f-4e6e-828a-3bf46ffa9173 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:19.677570 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775cadca-797f-4e6e-828a-3bf46ffa9173 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:19.677939 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775cadca-797f-4e6e-828a-3bf46ffa9173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:19.712705 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-775cadca-797f-4e6e-828a-3bf46ffa9173 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:19.714166 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-775cadca-797f-4e6e-828a-3bf46ffa9173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:19.808987 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e1faf-692e-4b6f-88d8-5b73576e45d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:19.810615 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e1faf-692e-4b6f-88d8-5b73576e45d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:19.811165 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e1faf-692e-4b6f-88d8-5b73576e45d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:19.811573 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e1faf-692e-4b6f-88d8-5b73576e45d4 admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:19.812870 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e1faf-692e-4b6f-88d8-5b73576e45d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:19.814002 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 859/1712] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:19.817776 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1f819-e2f2-4b97-aba1-029d60bb9664 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:19.818181 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1f819-e2f2-4b97-aba1-029d60bb9664 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:19.818378 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e1faf-692e-4b6f-88d8-5b73576e45d4 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:19.818493 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1f819-e2f2-4b97-aba1-029d60bb9664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:19.882291 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 854/1713] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 04:59:19 2021] POST /identity/v3/users => generated 291 bytes in 474 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:59:19.883408 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e1faf-692e-4b6f-88d8-5b73576e45d4 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:19.889208 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-ec5e1faf-692e-4b6f-88d8-5b73576e45d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:19.912608 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-d3e1f819-e2f2-4b97-aba1-029d60bb9664 None None] MFA Rules not processed for user `fa2aab5929e746dbbc011b42927b8e37`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:19.913841 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-d3e1f819-e2f2-4b97-aba1-029d60bb9664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:19.968273 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 860/1714] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:19 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:19.972430 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e1f819-e2f2-4b97-aba1-029d60bb9664 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:19.976828 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-d3e1f819-e2f2-4b97-aba1-029d60bb9664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:20.021957 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e1faf-692e-4b6f-88d8-5b73576e45d4 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:20.031208 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63c9d11-102c-466b-8dd6-f9a66d89f1f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:20.032430 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c9d11-102c-466b-8dd6-f9a66d89f1f5 service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:20.032922 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c9d11-102c-466b-8dd6-f9a66d89f1f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:20.033543 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c9d11-102c-466b-8dd6-f9a66d89f1f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:20.045769 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63c9d11-102c-466b-8dd6-f9a66d89f1f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:20.048117 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63c9d11-102c-466b-8dd6-f9a66d89f1f5 service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:20.048229 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e1f819-e2f2-4b97-aba1-029d60bb9664 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:20.073650 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e00b2-fca3-44a5-96c2-ac0dd22e17d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:20.074519 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e00b2-fca3-44a5-96c2-ac0dd22e17d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:20.075795 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e00b2-fca3-44a5-96c2-ac0dd22e17d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:20.077010 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e00b2-fca3-44a5-96c2-ac0dd22e17d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:20.077912 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514e00b2-fca3-44a5-96c2-ac0dd22e17d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:20.080971 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 855/1715] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:59:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:59:20.082426 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63c9d11-102c-466b-8dd6-f9a66d89f1f5 service neutron] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:20.085133 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514e00b2-fca3-44a5-96c2-ac0dd22e17d3 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:20.087710 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-a63c9d11-102c-466b-8dd6-f9a66d89f1f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:20.155783 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 861/1716] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 04:59:19 2021] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 04:59:20.163443 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e00b2-fca3-44a5-96c2-ac0dd22e17d3 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:20.210707 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e00b2-fca3-44a5-96c2-ac0dd22e17d3 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:20.227364 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aaf7b2-2878-40a1-89d9-fb136695e765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:20.229822 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aaf7b2-2878-40a1-89d9-fb136695e765 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:20.230111 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aaf7b2-2878-40a1-89d9-fb136695e765 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:20.230392 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aaf7b2-2878-40a1-89d9-fb136695e765 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:20.231144 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aaf7b2-2878-40a1-89d9-fb136695e765 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:20.240163 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aaf7b2-2878-40a1-89d9-fb136695e765 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:20.274478 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 862/1717] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 04:59:20 2021] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 04:59:20.286134 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5e557-3066-4bd9-99af-dc78550113aa None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:20.289564 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5e557-3066-4bd9-99af-dc78550113aa None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:20.290257 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5e557-3066-4bd9-99af-dc78550113aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:20.295980 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63c9d11-102c-466b-8dd6-f9a66d89f1f5 service neutron] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:20.339301 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa1d2b-6019-4d74-ac00-3e3e09db0f7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f9ad1e8f8f74edcb44aabe17eb59648', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:20.340344 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa1d2b-6019-4d74-ac00-3e3e09db0f7c service nova] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:20.345026 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa1d2b-6019-4d74-ac00-3e3e09db0f7c service nova] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:20.345606 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa1d2b-6019-4d74-ac00-3e3e09db0f7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:20.359197 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-13e5e557-3066-4bd9-99af-dc78550113aa None None] MFA Rules not processed for user `3d0ee2c830754741b0f9eedabf6bded8`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:20.364720 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-13e5e557-3066-4bd9-99af-dc78550113aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:20.400002 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa1d2b-6019-4d74-ac00-3e3e09db0f7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:20.401969 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa1d2b-6019-4d74-ac00-3e3e09db0f7c service nova] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:20.440144 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 856/1718] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:59:20 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:59:20.445750 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa1d2b-6019-4d74-ac00-3e3e09db0f7c service nova] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:20.478589 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa1d2b-6019-4d74-ac00-3e3e09db0f7c service nova] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:20.489670 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 863/1719] 10.222.0.43 () {58 vars in 1009 bytes} [Fri Dec 24 04:59:20 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:20.492183 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eecd51-c12d-42d2-ac04-337e02325e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:20.493304 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eecd51-c12d-42d2-ac04-337e02325e19 admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:20.493805 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eecd51-c12d-42d2-ac04-337e02325e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:20.494912 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eecd51-c12d-42d2-ac04-337e02325e19 admin admin] PATH_INFO: `/v3/projects/2a8f3c66c30b4707b2f64b05adaad276/users/2254be8fe87748eeaf20fe8b2570c97c/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:20.549516 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eecd51-c12d-42d2-ac04-337e02325e19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a8f3c66c30b4707b2f64b05adaad276, user_id=2254be8fe87748eeaf20fe8b2570c97c, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:20.553249 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eecd51-c12d-42d2-ac04-337e02325e19 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:20.614373 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 857/1720] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 04:59:20 2021] PUT /identity/v3/projects/2a8f3c66c30b4707b2f64b05adaad276/users/2254be8fe87748eeaf20fe8b2570c97c/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:59:20.630368 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5922bf5-8e6a-4422-8618-05ed6d860598 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:20.631340 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5922bf5-8e6a-4422-8618-05ed6d860598 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:20.638333 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5922bf5-8e6a-4422-8618-05ed6d860598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:20.674043 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eecd51-c12d-42d2-ac04-337e02325e19 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:20.676313 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-46eecd51-c12d-42d2-ac04-337e02325e19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:20.717374 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-a5922bf5-8e6a-4422-8618-05ed6d860598 None None] MFA Rules not processed for user `2254be8fe87748eeaf20fe8b2570c97c`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:20.720544 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-a5922bf5-8e6a-4422-8618-05ed6d860598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:20.906254 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eecd51-c12d-42d2-ac04-337e02325e19 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:20.929198 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 864/1721] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:20 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 04:59:20.942628 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5922bf5-8e6a-4422-8618-05ed6d860598 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:20.964518 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72203e67-0e6d-4950-be01-da2627f3b885 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218ae7d29b71487d86b11aeb380788ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:20.965671 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72203e67-0e6d-4950-be01-da2627f3b885 service swift] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:20.966813 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72203e67-0e6d-4950-be01-da2627f3b885 service swift] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:20.967311 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72203e67-0e6d-4950-be01-da2627f3b885 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:21.111538 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5922bf5-8e6a-4422-8618-05ed6d860598 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:21.132404 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d83738-25a7-400e-8203-6dc57b088603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:21.133357 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d83738-25a7-400e-8203-6dc57b088603 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:21.133941 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d83738-25a7-400e-8203-6dc57b088603 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:21.134374 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d83738-25a7-400e-8203-6dc57b088603 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:21.138978 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d83738-25a7-400e-8203-6dc57b088603 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:21.143739 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d83738-25a7-400e-8203-6dc57b088603 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:21.148369 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72203e67-0e6d-4950-be01-da2627f3b885 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:21.150331 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72203e67-0e6d-4950-be01-da2627f3b885 service swift] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:21.177863 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 858/1722] 10.222.0.43 () {60 vars in 1384 bytes} [Fri Dec 24 04:59:20 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 24 04:59:21.180716 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72203e67-0e6d-4950-be01-da2627f3b885 service swift] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:21.192727 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-72203e67-0e6d-4950-be01-da2627f3b885 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:21.277925 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 865/1723] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 04:59:20 2021] POST /identity/v3/projects => generated 377 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:59:21.278986 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d83738-25a7-400e-8203-6dc57b088603 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:21.284253 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-c2d83738-25a7-400e-8203-6dc57b088603 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:21.301250 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72203e67-0e6d-4950-be01-da2627f3b885 service swift] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:21.477815 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d83738-25a7-400e-8203-6dc57b088603 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:21.494335 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aaa556-1df9-453c-8a8e-7ec5a9e9ef11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:21.495232 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aaa556-1df9-453c-8a8e-7ec5a9e9ef11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:21.495533 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aaa556-1df9-453c-8a8e-7ec5a9e9ef11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:21.495803 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aaa556-1df9-453c-8a8e-7ec5a9e9ef11 admin admin] PATH_INFO: `/v3/projects/1d8144fae2194b5e96dc3900a7f5a276` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:21.500885 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aaa556-1df9-453c-8a8e-7ec5a9e9ef11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d8144fae2194b5e96dc3900a7f5a276)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:21.501946 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: WARNING py.warnings [None req-b3aaa556-1df9-453c-8a8e-7ec5a9e9ef11 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:21.501946 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: warnings.warn(msg) Dec 24 04:59:21.501946 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: Dec 24 04:59:21.510781 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aaa556-1df9-453c-8a8e-7ec5a9e9ef11 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:21.529297 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e77306-dcb1-437e-a7f3-21602818e65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:21.540110 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e77306-dcb1-437e-a7f3-21602818e65b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:21.540363 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e77306-dcb1-437e-a7f3-21602818e65b admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:21.545259 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e77306-dcb1-437e-a7f3-21602818e65b admin admin] PATH_INFO: `/v3/projects/e58266cfa29a4eb9bcff4786a5161fac` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:21.549747 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e77306-dcb1-437e-a7f3-21602818e65b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e58266cfa29a4eb9bcff4786a5161fac)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:21.556170 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e77306-dcb1-437e-a7f3-21602818e65b admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:21.669433 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-d8e77306-dcb1-437e-a7f3-21602818e65b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e58266cfa29a4eb9bcff4786a5161fac', 'request_id': 'req-d8e77306-dcb1-437e-a7f3-21602818e65b'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:21.683980 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-d8e77306-dcb1-437e-a7f3-21602818e65b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e58266cfa29a4eb9bcff4786a5161fac', 'request_id': 'req-d8e77306-dcb1-437e-a7f3-21602818e65b'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:21.692084 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-d8e77306-dcb1-437e-a7f3-21602818e65b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e58266cfa29a4eb9bcff4786a5161fac', 'request_id': 'req-d8e77306-dcb1-437e-a7f3-21602818e65b'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:21.709239 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-d8e77306-dcb1-437e-a7f3-21602818e65b admin admin] The token cache is being invalidate because project e58266cfa29a4eb9bcff4786a5161fac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 04:59:21.709540 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-d8e77306-dcb1-437e-a7f3-21602818e65b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:21.710682 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-d8e77306-dcb1-437e-a7f3-21602818e65b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:21.717977 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 859/1724] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 04:59:21 2021] DELETE /identity/v3/projects/e58266cfa29a4eb9bcff4786a5161fac => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:59:21.719322 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e77306-dcb1-437e-a7f3-21602818e65b admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:21.721246 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-d8e77306-dcb1-437e-a7f3-21602818e65b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:21.765177 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b3aaa556-1df9-453c-8a8e-7ec5a9e9ef11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d8144fae2194b5e96dc3900a7f5a276', 'request_id': 'req-b3aaa556-1df9-453c-8a8e-7ec5a9e9ef11'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:21.794977 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b3aaa556-1df9-453c-8a8e-7ec5a9e9ef11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d8144fae2194b5e96dc3900a7f5a276', 'request_id': 'req-b3aaa556-1df9-453c-8a8e-7ec5a9e9ef11'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:21.803197 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b3aaa556-1df9-453c-8a8e-7ec5a9e9ef11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d8144fae2194b5e96dc3900a7f5a276', 'request_id': 'req-b3aaa556-1df9-453c-8a8e-7ec5a9e9ef11'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:21.873145 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b3aaa556-1df9-453c-8a8e-7ec5a9e9ef11 admin admin] The token cache is being invalidate because project 1d8144fae2194b5e96dc3900a7f5a276 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 04:59:21.873788 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b3aaa556-1df9-453c-8a8e-7ec5a9e9ef11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:21.874681 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b3aaa556-1df9-453c-8a8e-7ec5a9e9ef11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:21.881932 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 866/1725] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 04:59:21 2021] DELETE /identity/v3/projects/1d8144fae2194b5e96dc3900a7f5a276 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:59:21.883811 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab2c07-f2ca-42b9-b368-5b1a714176d6 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:21.888965 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab2c07-f2ca-42b9-b368-5b1a714176d6 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:21.889498 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab2c07-f2ca-42b9-b368-5b1a714176d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:21.932454 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e77306-dcb1-437e-a7f3-21602818e65b admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:21.936959 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-bdab2c07-f2ca-42b9-b368-5b1a714176d6 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:21.940158 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-bdab2c07-f2ca-42b9-b368-5b1a714176d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:22.054735 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a46f54-90a2-4b71-b11c-38f5742054d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:22.055665 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a46f54-90a2-4b71-b11c-38f5742054d7 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:22.055951 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a46f54-90a2-4b71-b11c-38f5742054d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:22.057495 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a46f54-90a2-4b71-b11c-38f5742054d7 admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:22.058472 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a46f54-90a2-4b71-b11c-38f5742054d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:22.060586 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a46f54-90a2-4b71-b11c-38f5742054d7 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:22.065300 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 867/1726] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:22.069477 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f2e58-ac81-4d92-9092-68d74ed605b9 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:22.072985 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f2e58-ac81-4d92-9092-68d74ed605b9 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:22.074336 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f2e58-ac81-4d92-9092-68d74ed605b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:22.089546 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 860/1727] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 04:59:21 2021] POST /identity/v3/users => generated 295 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:59:22.091892 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4722f2e-6c53-420f-968d-6e15962ec23a None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:22.092946 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4722f2e-6c53-420f-968d-6e15962ec23a None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:22.092946 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4722f2e-6c53-420f-968d-6e15962ec23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:22.121076 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-a4722f2e-6c53-420f-968d-6e15962ec23a None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:22.123469 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-a4722f2e-6c53-420f-968d-6e15962ec23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:22.147915 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-628f2e58-ac81-4d92-9092-68d74ed605b9 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:22.149475 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-628f2e58-ac81-4d92-9092-68d74ed605b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:22.161108 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 861/1728] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:22.164837 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4722f2e-6c53-420f-968d-6e15962ec23a None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:22.170148 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-a4722f2e-6c53-420f-968d-6e15962ec23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:22.181553 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 868/1729] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:22.189156 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628f2e58-ac81-4d92-9092-68d74ed605b9 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:22.206341 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4722f2e-6c53-420f-968d-6e15962ec23a None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:22.220929 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628f2e58-ac81-4d92-9092-68d74ed605b9 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:22.221979 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b32ba9f-df27-4016-a487-a54dfe2d8cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:22.224170 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32ba9f-df27-4016-a487-a54dfe2d8cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:22.224816 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32ba9f-df27-4016-a487-a54dfe2d8cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:22.225762 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32ba9f-df27-4016-a487-a54dfe2d8cb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:22.227749 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b32ba9f-df27-4016-a487-a54dfe2d8cb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:22.233646 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b32ba9f-df27-4016-a487-a54dfe2d8cb4 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:22.242769 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c515d6e6-3e6e-47e2-8e89-b3970ea41496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:22.243534 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515d6e6-3e6e-47e2-8e89-b3970ea41496 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:22.243845 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515d6e6-3e6e-47e2-8e89-b3970ea41496 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:22.244273 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515d6e6-3e6e-47e2-8e89-b3970ea41496 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:22.245248 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c515d6e6-3e6e-47e2-8e89-b3970ea41496 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:59:22.245604 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c515d6e6-3e6e-47e2-8e89-b3970ea41496 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:22.255730 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c515d6e6-3e6e-47e2-8e89-b3970ea41496 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:22.260715 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 862/1730] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 04:59:22 2021] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 04:59:22.262476 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be2aa9-1045-4eec-be3f-4655abb92440 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:22.263103 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be2aa9-1045-4eec-be3f-4655abb92440 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:22.263615 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be2aa9-1045-4eec-be3f-4655abb92440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:22.305143 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-53be2aa9-1045-4eec-be3f-4655abb92440 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:22.307177 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-53be2aa9-1045-4eec-be3f-4655abb92440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:22.338169 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 869/1731] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 04:59:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:59:22.339207 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c515d6e6-3e6e-47e2-8e89-b3970ea41496 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:22.357126 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 863/1732] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:22.362779 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be2aa9-1045-4eec-be3f-4655abb92440 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:22.404616 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c515d6e6-3e6e-47e2-8e89-b3970ea41496 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:22.405292 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be2aa9-1045-4eec-be3f-4655abb92440 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:22.417175 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71e1f6d-39bc-48a7-8206-7deec1b981f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:22.418097 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e1f6d-39bc-48a7-8206-7deec1b981f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:22.418441 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e1f6d-39bc-48a7-8206-7deec1b981f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:22.418850 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e1f6d-39bc-48a7-8206-7deec1b981f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:22.419752 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71e1f6d-39bc-48a7-8206-7deec1b981f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:59:22.420199 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71e1f6d-39bc-48a7-8206-7deec1b981f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:22.422946 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71e1f6d-39bc-48a7-8206-7deec1b981f3 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:22.424862 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a8261-91b0-4e2e-b78b-856640150d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:22.425946 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a8261-91b0-4e2e-b78b-856640150d14 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:22.426281 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a8261-91b0-4e2e-b78b-856640150d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:22.426623 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a8261-91b0-4e2e-b78b-856640150d14 admin admin] PATH_INFO: `/v3/projects/53de305faadf4e7da3152a0a568436be/users/53cb9af8b8534f1bb52687b582368add/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:22.439387 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 864/1733] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 04:59:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:59:22.441143 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71e1f6d-39bc-48a7-8206-7deec1b981f3 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:22.466630 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71e1f6d-39bc-48a7-8206-7deec1b981f3 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:22.472091 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153a8261-91b0-4e2e-b78b-856640150d14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53de305faadf4e7da3152a0a568436be, user_id=53cb9af8b8534f1bb52687b582368add, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:22.473751 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ace27b-5e1d-4d68-9507-fb8b78500ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:22.475246 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153a8261-91b0-4e2e-b78b-856640150d14 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:22.477638 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ace27b-5e1d-4d68-9507-fb8b78500ca8 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:22.478019 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ace27b-5e1d-4d68-9507-fb8b78500ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:22.478461 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ace27b-5e1d-4d68-9507-fb8b78500ca8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:22.479594 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ace27b-5e1d-4d68-9507-fb8b78500ca8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:22.483273 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ace27b-5e1d-4d68-9507-fb8b78500ca8 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:22.511115 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 870/1734] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 04:59:22 2021] PUT /identity/v3/projects/53de305faadf4e7da3152a0a568436be/users/53cb9af8b8534f1bb52687b582368add/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:59:22.512277 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a8261-91b0-4e2e-b78b-856640150d14 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:22.552575 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 865/1735] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 04:59:22 2021] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:59:22.557022 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ace27b-5e1d-4d68-9507-fb8b78500ca8 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:22.679446 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a8261-91b0-4e2e-b78b-856640150d14 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:22.680465 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ace27b-5e1d-4d68-9507-fb8b78500ca8 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:22.687253 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ebe4b-2078-47e3-b49b-6803a5aa8444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:22.688674 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ebe4b-2078-47e3-b49b-6803a5aa8444 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:22.689149 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ebe4b-2078-47e3-b49b-6803a5aa8444 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:22.689597 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ebe4b-2078-47e3-b49b-6803a5aa8444 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:22.690991 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3ebe4b-2078-47e3-b49b-6803a5aa8444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:22.693840 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3ebe4b-2078-47e3-b49b-6803a5aa8444 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:22.700820 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd68035-9200-4fcd-a2b4-85f3361f2f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:22.701501 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd68035-9200-4fcd-a2b4-85f3361f2f42 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:22.701784 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd68035-9200-4fcd-a2b4-85f3361f2f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:22.702059 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd68035-9200-4fcd-a2b4-85f3361f2f42 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:22.702784 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd68035-9200-4fcd-a2b4-85f3361f2f42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:22.705184 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd68035-9200-4fcd-a2b4-85f3361f2f42 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:22.714575 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 866/1736] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 04:59:22 2021] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 04:59:22.716499 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ebe4b-2078-47e3-b49b-6803a5aa8444 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:22.735576 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ebe4b-2078-47e3-b49b-6803a5aa8444 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:22.744999 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac6ee4a-c48f-42b3-bb2d-81370b78242a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:22.745693 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6ee4a-c48f-42b3-bb2d-81370b78242a admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:22.746492 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6ee4a-c48f-42b3-bb2d-81370b78242a admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:22.748394 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6ee4a-c48f-42b3-bb2d-81370b78242a admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:22.751530 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac6ee4a-c48f-42b3-bb2d-81370b78242a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:22.754657 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac6ee4a-c48f-42b3-bb2d-81370b78242a admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:22.792550 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 867/1737] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 04:59:22 2021] POST /identity/v3/users => generated 287 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:59:22.792550 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac6ee4a-c48f-42b3-bb2d-81370b78242a admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:22.799139 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 871/1738] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 04:59:22 2021] POST /identity/v3/projects => generated 365 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:59:22.800131 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd68035-9200-4fcd-a2b4-85f3361f2f42 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:22.810257 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac6ee4a-c48f-42b3-bb2d-81370b78242a admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:23.007736 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743810d9-d029-486e-9273-1e6a917f2e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:23.009277 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743810d9-d029-486e-9273-1e6a917f2e1a admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:23.011225 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743810d9-d029-486e-9273-1e6a917f2e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:23.012205 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743810d9-d029-486e-9273-1e6a917f2e1a admin admin] PATH_INFO: `/v3/projects/53de305faadf4e7da3152a0a568436be/users/53cb9af8b8534f1bb52687b582368add/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:23.018773 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743810d9-d029-486e-9273-1e6a917f2e1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=53de305faadf4e7da3152a0a568436be, user_id=53cb9af8b8534f1bb52687b582368add, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:23.024416 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743810d9-d029-486e-9273-1e6a917f2e1a admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:23.036571 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd68035-9200-4fcd-a2b4-85f3361f2f42 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:23.053947 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f06018c-8cd1-4b78-b133-7117098d3f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:23.054636 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06018c-8cd1-4b78-b133-7117098d3f48 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:23.054918 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06018c-8cd1-4b78-b133-7117098d3f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:23.055193 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06018c-8cd1-4b78-b133-7117098d3f48 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:23.055949 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f06018c-8cd1-4b78-b133-7117098d3f48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:23.058951 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f06018c-8cd1-4b78-b133-7117098d3f48 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:23.067802 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 868/1739] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 04:59:22 2021] PUT /identity/v3/projects/53de305faadf4e7da3152a0a568436be/users/53cb9af8b8534f1bb52687b582368add/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:59:23.072490 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743810d9-d029-486e-9273-1e6a917f2e1a admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:23.094822 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 872/1740] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 04:59:22 2021] GET /identity/v3/roles => generated 1420 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 04:59:23.096275 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01200762-e9ee-4df7-9687-0543f68846a2 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:23.099599 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01200762-e9ee-4df7-9687-0543f68846a2 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:23.099938 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01200762-e9ee-4df7-9687-0543f68846a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:23.162704 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-01200762-e9ee-4df7-9687-0543f68846a2 None None] MFA Rules not processed for user `53cb9af8b8534f1bb52687b582368add`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:23.164473 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-01200762-e9ee-4df7-9687-0543f68846a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:23.258072 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743810d9-d029-486e-9273-1e6a917f2e1a admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:23.274113 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f20f9-64fc-4317-b737-5b45ca67ae4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:23.274835 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f20f9-64fc-4317-b737-5b45ca67ae4c admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:23.275214 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f20f9-64fc-4317-b737-5b45ca67ae4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:23.275540 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f20f9-64fc-4317-b737-5b45ca67ae4c admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:23.276489 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f20f9-64fc-4317-b737-5b45ca67ae4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:23.279129 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f20f9-64fc-4317-b737-5b45ca67ae4c admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:23.342492 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 873/1741] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:23 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:23.342492 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01200762-e9ee-4df7-9687-0543f68846a2 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:23.372181 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01200762-e9ee-4df7-9687-0543f68846a2 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:23.383119 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 869/1742] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 04:59:23 2021] POST /identity/v3/users => generated 283 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:59:23.384894 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f20f9-64fc-4317-b737-5b45ca67ae4c admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:23.385775 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23732032-0bcd-4fde-a886-dc8c3a99c429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:23.386471 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23732032-0bcd-4fde-a886-dc8c3a99c429 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:23.386757 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23732032-0bcd-4fde-a886-dc8c3a99c429 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:23.387034 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23732032-0bcd-4fde-a886-dc8c3a99c429 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:23.387789 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23732032-0bcd-4fde-a886-dc8c3a99c429 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:23.389486 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-c91f20f9-64fc-4317-b737-5b45ca67ae4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:23.405860 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23732032-0bcd-4fde-a886-dc8c3a99c429 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:23.448722 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f20f9-64fc-4317-b737-5b45ca67ae4c admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:23.454131 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 874/1743] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 04:59:23 2021] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 04:59:23.455661 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23732032-0bcd-4fde-a886-dc8c3a99c429 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:23.464028 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4040ae-4134-40fd-829d-128fae137bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:23.466238 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4040ae-4134-40fd-829d-128fae137bd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:23.466533 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4040ae-4134-40fd-829d-128fae137bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:23.468942 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4040ae-4134-40fd-829d-128fae137bd1 admin admin] PATH_INFO: `/v3/users/6fe6cde1c4c94cb88bc41407cfca79e1` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:23.470685 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-23732032-0bcd-4fde-a886-dc8c3a99c429 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:23.473597 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4040ae-4134-40fd-829d-128fae137bd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fe6cde1c4c94cb88bc41407cfca79e1)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:23.481577 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4040ae-4134-40fd-829d-128fae137bd1 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:23.598395 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-ac4040ae-4134-40fd-829d-128fae137bd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fe6cde1c4c94cb88bc41407cfca79e1'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:23.599868 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-ac4040ae-4134-40fd-829d-128fae137bd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fe6cde1c4c94cb88bc41407cfca79e1'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:23.616275 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-ac4040ae-4134-40fd-829d-128fae137bd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fe6cde1c4c94cb88bc41407cfca79e1'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:23.629501 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-ac4040ae-4134-40fd-829d-128fae137bd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fe6cde1c4c94cb88bc41407cfca79e1'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:23.632365 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-ac4040ae-4134-40fd-829d-128fae137bd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fe6cde1c4c94cb88bc41407cfca79e1'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:23.644982 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23732032-0bcd-4fde-a886-dc8c3a99c429 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:23.660468 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d7d50-11a3-4a35-b9ca-4a653937f68a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:23.661195 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d7d50-11a3-4a35-b9ca-4a653937f68a service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:23.661479 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d7d50-11a3-4a35-b9ca-4a653937f68a service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:23.661777 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d7d50-11a3-4a35-b9ca-4a653937f68a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:23.671029 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-461d7d50-11a3-4a35-b9ca-4a653937f68a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:23.706808 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 870/1744] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 04:59:23 2021] DELETE /identity/v3/users/6fe6cde1c4c94cb88bc41407cfca79e1 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:59:23.718799 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4040ae-4134-40fd-829d-128fae137bd1 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:23.725854 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-ac4040ae-4134-40fd-829d-128fae137bd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:23.748965 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461d7d50-11a3-4a35-b9ca-4a653937f68a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:23.752130 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461d7d50-11a3-4a35-b9ca-4a653937f68a service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:23.774327 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 875/1745] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:59:23 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:59:23.782812 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d7d50-11a3-4a35-b9ca-4a653937f68a service cinder] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:23.793540 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-461d7d50-11a3-4a35-b9ca-4a653937f68a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:23.853967 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4040ae-4134-40fd-829d-128fae137bd1 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:23.869006 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef2c137-74fa-4806-9530-af8f47330b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:23.869944 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2c137-74fa-4806-9530-af8f47330b7b admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:23.871897 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2c137-74fa-4806-9530-af8f47330b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:23.872317 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2c137-74fa-4806-9530-af8f47330b7b admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:23.875807 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef2c137-74fa-4806-9530-af8f47330b7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:23.881769 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d7d50-11a3-4a35-b9ca-4a653937f68a service cinder] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:23.883025 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef2c137-74fa-4806-9530-af8f47330b7b admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:23.908085 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c2da7-29f2-458c-888b-f5b41ea64e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:23.910854 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c2da7-29f2-458c-888b-f5b41ea64e12 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:23.911501 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c2da7-29f2-458c-888b-f5b41ea64e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:23.911961 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c2da7-29f2-458c-888b-f5b41ea64e12 admin admin] PATH_INFO: `/v3/projects/fa032ffc1c2b4d1eb7b79823490028d2/users/eb4951ba4d134031ac394ec823979ccc/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:23.917607 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 871/1746] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 04:59:23 2021] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 04:59:23.919048 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca2bf7-4fc6-4764-897d-d62e052c1540 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:23.919348 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca2bf7-4fc6-4764-897d-d62e052c1540 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:23.919631 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca2bf7-4fc6-4764-897d-d62e052c1540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:23.970317 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364c2da7-29f2-458c-888b-f5b41ea64e12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa032ffc1c2b4d1eb7b79823490028d2, user_id=eb4951ba4d134031ac394ec823979ccc, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:23.983767 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-0dca2bf7-4fc6-4764-897d-d62e052c1540 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:23.992671 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-0dca2bf7-4fc6-4764-897d-d62e052c1540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:24.005443 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364c2da7-29f2-458c-888b-f5b41ea64e12 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:24.019786 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 872/1747] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:24.023203 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45eb31-4d7e-4176-ab7e-653c631e9c83 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:24.024759 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45eb31-4d7e-4176-ab7e-653c631e9c83 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:24.025048 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45eb31-4d7e-4176-ab7e-653c631e9c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:24.039459 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 876/1748] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 04:59:23 2021] PUT /identity/v3/projects/fa032ffc1c2b4d1eb7b79823490028d2/users/eb4951ba4d134031ac394ec823979ccc/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:59:24.046003 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c2da7-29f2-458c-888b-f5b41ea64e12 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:24.073523 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-ca45eb31-4d7e-4176-ab7e-653c631e9c83 None None] MFA Rules not processed for user `fa2aab5929e746dbbc011b42927b8e37`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:24.075877 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-ca45eb31-4d7e-4176-ab7e-653c631e9c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:24.239770 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 873/1749] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:24 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:24.241249 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277fb9d3-95b5-4363-b39f-b65525e8c4ae None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:24.241543 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277fb9d3-95b5-4363-b39f-b65525e8c4ae None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:24.241825 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277fb9d3-95b5-4363-b39f-b65525e8c4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:24.323686 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-277fb9d3-95b5-4363-b39f-b65525e8c4ae None None] MFA Rules not processed for user `eb4951ba4d134031ac394ec823979ccc`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:24.324962 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-277fb9d3-95b5-4363-b39f-b65525e8c4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:24.347263 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c2da7-29f2-458c-888b-f5b41ea64e12 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:24.357707 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b33635-fcf2-49da-ba2e-1385c6462991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:24.360044 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b33635-fcf2-49da-ba2e-1385c6462991 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:24.361950 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b33635-fcf2-49da-ba2e-1385c6462991 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:24.362467 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b33635-fcf2-49da-ba2e-1385c6462991 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:24.363527 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b33635-fcf2-49da-ba2e-1385c6462991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:24.367942 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b33635-fcf2-49da-ba2e-1385c6462991 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:24.457925 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 877/1750] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 04:59:24 2021] GET /identity/v3/roles => generated 1420 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 04:59:24.464615 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b33635-fcf2-49da-ba2e-1385c6462991 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:24.472462 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-a6b33635-fcf2-49da-ba2e-1385c6462991 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:24.678243 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 874/1751] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:24 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 435 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:24.681385 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277fb9d3-95b5-4363-b39f-b65525e8c4ae None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:24.729453 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277fb9d3-95b5-4363-b39f-b65525e8c4ae None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:24.733687 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b33635-fcf2-49da-ba2e-1385c6462991 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:24.759753 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfade67-10fc-4e23-915d-676ba31ac807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:24.763575 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d358a-1122-43c8-a1a8-0f1da40ce6f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:24.764349 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d358a-1122-43c8-a1a8-0f1da40ce6f6 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:24.764647 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d358a-1122-43c8-a1a8-0f1da40ce6f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:24.767664 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfade67-10fc-4e23-915d-676ba31ac807 admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:24.767881 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfade67-10fc-4e23-915d-676ba31ac807 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:24.768192 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfade67-10fc-4e23-915d-676ba31ac807 admin admin] PATH_INFO: `/v3/projects/f65fb81402bc4237ae5f45bfe0915c73/users/f3277bcaee614d5090ba4804fc8b33b1/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:24.777465 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d358a-1122-43c8-a1a8-0f1da40ce6f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:24.861370 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315d358a-1122-43c8-a1a8-0f1da40ce6f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:24.878901 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315d358a-1122-43c8-a1a8-0f1da40ce6f6 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:24.892413 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfade67-10fc-4e23-915d-676ba31ac807 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f65fb81402bc4237ae5f45bfe0915c73, user_id=f3277bcaee614d5090ba4804fc8b33b1, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:24.905362 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfade67-10fc-4e23-915d-676ba31ac807 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:24.932404 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 878/1752] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:59:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:59:24.935220 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d358a-1122-43c8-a1a8-0f1da40ce6f6 service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:24.957354 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 875/1753] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 04:59:24 2021] PUT /identity/v3/projects/f65fb81402bc4237ae5f45bfe0915c73/users/f3277bcaee614d5090ba4804fc8b33b1/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:59:24.959492 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfade67-10fc-4e23-915d-676ba31ac807 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:24.965964 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d358a-1122-43c8-a1a8-0f1da40ce6f6 service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:24.967865 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-bdfade67-10fc-4e23-915d-676ba31ac807 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:25.142202 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6448141-8464-4edb-a72b-a901d7140d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:25.143066 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6448141-8464-4edb-a72b-a901d7140d60 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:25.143415 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6448141-8464-4edb-a72b-a901d7140d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:25.143966 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6448141-8464-4edb-a72b-a901d7140d60 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:25.145229 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6448141-8464-4edb-a72b-a901d7140d60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:25.147570 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6448141-8464-4edb-a72b-a901d7140d60 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:25.158585 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfade67-10fc-4e23-915d-676ba31ac807 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:25.174042 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e8b4f-f1b8-4e36-93ac-1919e570faf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:25.176351 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e8b4f-f1b8-4e36-93ac-1919e570faf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:25.178347 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e8b4f-f1b8-4e36-93ac-1919e570faf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:25.178692 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e8b4f-f1b8-4e36-93ac-1919e570faf8 admin admin] PATH_INFO: `/v3/users/2254be8fe87748eeaf20fe8b2570c97c` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:25.181477 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1e8b4f-f1b8-4e36-93ac-1919e570faf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2254be8fe87748eeaf20fe8b2570c97c)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:25.187353 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1e8b4f-f1b8-4e36-93ac-1919e570faf8 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:25.225389 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 879/1754] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 04:59:24 2021] POST /identity/v3/projects => generated 371 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:59:25.227005 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ab32e-77f0-49ae-9353-78ff51df7fb6 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:25.227279 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ab32e-77f0-49ae-9353-78ff51df7fb6 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:25.227556 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ab32e-77f0-49ae-9353-78ff51df7fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:25.268790 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-dc2ab32e-77f0-49ae-9353-78ff51df7fb6 None None] MFA Rules not processed for user `f3277bcaee614d5090ba4804fc8b33b1`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:25.270144 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-dc2ab32e-77f0-49ae-9353-78ff51df7fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:25.303224 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-ca1e8b4f-f1b8-4e36-93ac-1919e570faf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2254be8fe87748eeaf20fe8b2570c97c'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:25.305456 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-ca1e8b4f-f1b8-4e36-93ac-1919e570faf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2254be8fe87748eeaf20fe8b2570c97c'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:25.326692 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-ca1e8b4f-f1b8-4e36-93ac-1919e570faf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2254be8fe87748eeaf20fe8b2570c97c'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:25.345029 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-ca1e8b4f-f1b8-4e36-93ac-1919e570faf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2254be8fe87748eeaf20fe8b2570c97c'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:25.346140 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-ca1e8b4f-f1b8-4e36-93ac-1919e570faf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2254be8fe87748eeaf20fe8b2570c97c'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:25.381864 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 880/1755] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:25 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:25.382417 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ab32e-77f0-49ae-9353-78ff51df7fb6 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:25.383963 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-dc2ab32e-77f0-49ae-9353-78ff51df7fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:25.408892 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 876/1756] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 04:59:24 2021] DELETE /identity/v3/users/2254be8fe87748eeaf20fe8b2570c97c => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:59:25.411529 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e8b4f-f1b8-4e36-93ac-1919e570faf8 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:25.416280 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-ca1e8b4f-f1b8-4e36-93ac-1919e570faf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:25.466049 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ab32e-77f0-49ae-9353-78ff51df7fb6 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:25.546922 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d249f02e-b956-4d73-8514-b58f79793d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:25.548571 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249f02e-b956-4d73-8514-b58f79793d0f admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:25.548961 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249f02e-b956-4d73-8514-b58f79793d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:25.549892 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249f02e-b956-4d73-8514-b58f79793d0f admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:25.550898 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d249f02e-b956-4d73-8514-b58f79793d0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:25.553587 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d249f02e-b956-4d73-8514-b58f79793d0f admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:25.597988 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 881/1757] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 04:59:25 2021] POST /identity/v3/users => generated 292 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:59:25.599656 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a72fd-7eb6-4290-bbe9-61cadd21a36c None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:25.599934 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a72fd-7eb6-4290-bbe9-61cadd21a36c None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:25.600514 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a72fd-7eb6-4290-bbe9-61cadd21a36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:25.607804 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e8b4f-f1b8-4e36-93ac-1919e570faf8 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:25.620125 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee24afd8-89f8-4cd5-9143-ad9db7746b33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:25.627510 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24afd8-89f8-4cd5-9143-ad9db7746b33 service cinder] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:25.628599 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24afd8-89f8-4cd5-9143-ad9db7746b33 service cinder] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:25.628599 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24afd8-89f8-4cd5-9143-ad9db7746b33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:25.648051 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-731a72fd-7eb6-4290-bbe9-61cadd21a36c None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:25.654196 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-731a72fd-7eb6-4290-bbe9-61cadd21a36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:25.691990 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 882/1758] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:25.694719 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a72fd-7eb6-4290-bbe9-61cadd21a36c None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:25.728967 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a72fd-7eb6-4290-bbe9-61cadd21a36c None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:25.748818 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd4a2fa-772c-4a89-9eb4-bdfd4609333b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:25.750938 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4a2fa-772c-4a89-9eb4-bdfd4609333b admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:25.751219 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4a2fa-772c-4a89-9eb4-bdfd4609333b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:25.751529 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4a2fa-772c-4a89-9eb4-bdfd4609333b admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:25.755466 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd4a2fa-772c-4a89-9eb4-bdfd4609333b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:25.762383 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd4a2fa-772c-4a89-9eb4-bdfd4609333b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:25.802190 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee24afd8-89f8-4cd5-9143-ad9db7746b33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:25.804353 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee24afd8-89f8-4cd5-9143-ad9db7746b33 service cinder] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:25.810950 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 883/1759] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 04:59:25 2021] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 04:59:25.820724 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072160c4-a784-43e9-a853-bb842d82c7ea None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:25.822186 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072160c4-a784-43e9-a853-bb842d82c7ea None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:25.823452 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072160c4-a784-43e9-a853-bb842d82c7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:25.825799 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 877/1760] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:59:25 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:59:25.826672 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee24afd8-89f8-4cd5-9143-ad9db7746b33 service cinder] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:25.829954 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-ee24afd8-89f8-4cd5-9143-ad9db7746b33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:25.956448 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-072160c4-a784-43e9-a853-bb842d82c7ea None None] MFA Rules not processed for user `b36f253fbce04e9ea028f02ff57fb272`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:25.957331 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee24afd8-89f8-4cd5-9143-ad9db7746b33 service cinder] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:25.962997 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-072160c4-a784-43e9-a853-bb842d82c7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:25.963420 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe909f0-288e-4c18-9493-069e3cdee692 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:25.967261 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe909f0-288e-4c18-9493-069e3cdee692 service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:25.967552 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe909f0-288e-4c18-9493-069e3cdee692 service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:25.969483 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe909f0-288e-4c18-9493-069e3cdee692 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:26.001818 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe909f0-288e-4c18-9493-069e3cdee692 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:26.001818 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe909f0-288e-4c18-9493-069e3cdee692 service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:26.021573 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 878/1761] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:59:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:59:26.022460 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe909f0-288e-4c18-9493-069e3cdee692 service neutron] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:26.024061 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 884/1762] 10.222.0.46 () {58 vars in 1015 bytes} [Fri Dec 24 04:59:25 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:26.050497 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe909f0-288e-4c18-9493-069e3cdee692 service neutron] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:26.075298 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192af6ea-0a1c-4473-9d72-a3b72bec1ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:26.075298 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192af6ea-0a1c-4473-9d72-a3b72bec1ee2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:26.075298 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192af6ea-0a1c-4473-9d72-a3b72bec1ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:26.075298 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192af6ea-0a1c-4473-9d72-a3b72bec1ee2 admin admin] PATH_INFO: `/v3/projects/bc922bd3163241709335f896e0fbb543/users/c6ee8eb06fa849babd56b954dd459f72/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:26.137635 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072160c4-a784-43e9-a853-bb842d82c7ea None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:26.141390 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-072160c4-a784-43e9-a853-bb842d82c7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:26.148098 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192af6ea-0a1c-4473-9d72-a3b72bec1ee2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc922bd3163241709335f896e0fbb543, user_id=c6ee8eb06fa849babd56b954dd459f72, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:26.151177 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192af6ea-0a1c-4473-9d72-a3b72bec1ee2 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:26.194238 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 879/1763] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 04:59:26 2021] PUT /identity/v3/projects/bc922bd3163241709335f896e0fbb543/users/c6ee8eb06fa849babd56b954dd459f72/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:59:26.198066 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192af6ea-0a1c-4473-9d72-a3b72bec1ee2 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:26.199348 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072160c4-a784-43e9-a853-bb842d82c7ea None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:26.375686 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80617e14-45af-4157-a0e8-b505428d9523 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:26.376328 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80617e14-45af-4157-a0e8-b505428d9523 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:26.379094 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80617e14-45af-4157-a0e8-b505428d9523 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:26.379293 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80617e14-45af-4157-a0e8-b505428d9523 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:26.391247 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192af6ea-0a1c-4473-9d72-a3b72bec1ee2 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:26.410039 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86012d7-cc4e-4a84-a591-015285456012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:26.411314 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86012d7-cc4e-4a84-a591-015285456012 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:26.411685 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86012d7-cc4e-4a84-a591-015285456012 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:26.412098 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86012d7-cc4e-4a84-a591-015285456012 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:26.413599 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86012d7-cc4e-4a84-a591-015285456012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:26.415364 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86012d7-cc4e-4a84-a591-015285456012 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:26.427532 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80617e14-45af-4157-a0e8-b505428d9523 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:26.439790 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80617e14-45af-4157-a0e8-b505428d9523 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:26.461215 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 880/1764] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 04:59:26 2021] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 04:59:26.462255 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86012d7-cc4e-4a84-a591-015285456012 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:26.466331 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 885/1765] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:59:26 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:59:26.469615 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad6e64-fd7b-4c97-ae5c-0f61e7cb2116 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:26.469903 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad6e64-fd7b-4c97-ae5c-0f61e7cb2116 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:26.470176 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad6e64-fd7b-4c97-ae5c-0f61e7cb2116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:26.518522 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86012d7-cc4e-4a84-a591-015285456012 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:26.545228 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a813159e-4a6e-4af5-8f7a-0a96c5c4ed36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:26.547074 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813159e-4a6e-4af5-8f7a-0a96c5c4ed36 service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:26.547557 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813159e-4a6e-4af5-8f7a-0a96c5c4ed36 service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:26.547944 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813159e-4a6e-4af5-8f7a-0a96c5c4ed36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:26.566500 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a813159e-4a6e-4af5-8f7a-0a96c5c4ed36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:26.568098 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a813159e-4a6e-4af5-8f7a-0a96c5c4ed36 service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:26.569142 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-3dad6e64-fd7b-4c97-ae5c-0f61e7cb2116 None None] MFA Rules not processed for user `979cc4a0723b4543a16197d393c7929a`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:26.572337 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-3dad6e64-fd7b-4c97-ae5c-0f61e7cb2116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:26.599536 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 881/1766] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:59:26 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:59:26.600490 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a813159e-4a6e-4af5-8f7a-0a96c5c4ed36 service neutron] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:26.622830 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a813159e-4a6e-4af5-8f7a-0a96c5c4ed36 service neutron] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:26.633773 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e351680-659f-43a4-bc4b-521f5ecc163e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:26.636040 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e351680-659f-43a4-bc4b-521f5ecc163e admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:26.637795 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e351680-659f-43a4-bc4b-521f5ecc163e admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:26.638224 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e351680-659f-43a4-bc4b-521f5ecc163e admin admin] PATH_INFO: `/v3/projects/bc922bd3163241709335f896e0fbb543/users/c6ee8eb06fa849babd56b954dd459f72/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:26.647419 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e351680-659f-43a4-bc4b-521f5ecc163e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc922bd3163241709335f896e0fbb543, user_id=c6ee8eb06fa849babd56b954dd459f72, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:26.661119 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e351680-659f-43a4-bc4b-521f5ecc163e admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:26.710644 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 882/1767] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 04:59:26 2021] PUT /identity/v3/projects/bc922bd3163241709335f896e0fbb543/users/c6ee8eb06fa849babd56b954dd459f72/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:59:26.726938 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fabeda4-58d5-487e-b0a1-db2fb96b4cf8 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:26.730020 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fabeda4-58d5-487e-b0a1-db2fb96b4cf8 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:26.732764 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fabeda4-58d5-487e-b0a1-db2fb96b4cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:26.881197 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 886/1768] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:26 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:26.885147 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-1fabeda4-58d5-487e-b0a1-db2fb96b4cf8 None None] MFA Rules not processed for user `c6ee8eb06fa849babd56b954dd459f72`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:26.904434 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-1fabeda4-58d5-487e-b0a1-db2fb96b4cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:27.043008 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 883/1769] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:26 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:27.052121 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad6e64-fd7b-4c97-ae5c-0f61e7cb2116 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:27.214812 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad6e64-fd7b-4c97-ae5c-0f61e7cb2116 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:27.338798 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482339d6-5fb7-47f1-ae91-92983e25e828 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:27.339825 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482339d6-5fb7-47f1-ae91-92983e25e828 service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:27.340247 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482339d6-5fb7-47f1-ae91-92983e25e828 service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:27.340684 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482339d6-5fb7-47f1-ae91-92983e25e828 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:27.374293 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482339d6-5fb7-47f1-ae91-92983e25e828 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:27.389309 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482339d6-5fb7-47f1-ae91-92983e25e828 service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:27.441360 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 887/1770] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:59:27 2021] GET /identity/v3/auth/tokens => generated 3305 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:59:27.593551 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fabeda4-58d5-487e-b0a1-db2fb96b4cf8 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:27.615804 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fabeda4-58d5-487e-b0a1-db2fb96b4cf8 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:27.623847 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f32ba-ca0e-4099-89aa-65926cc11941 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:27.626101 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f32ba-ca0e-4099-89aa-65926cc11941 service cinder] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:27.626101 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f32ba-ca0e-4099-89aa-65926cc11941 service cinder] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:27.626536 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f32ba-ca0e-4099-89aa-65926cc11941 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:27.629984 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-f03f32ba-ca0e-4099-89aa-65926cc11941 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:27.784025 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03f32ba-ca0e-4099-89aa-65926cc11941 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:27.786744 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03f32ba-ca0e-4099-89aa-65926cc11941 service cinder] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:27.818271 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 884/1771] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:59:27 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:59:28.404490 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f32ba-ca0e-4099-89aa-65926cc11941 service cinder] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:28.405440 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482339d6-5fb7-47f1-ae91-92983e25e828 service cinder] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:28.409423 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-f03f32ba-ca0e-4099-89aa-65926cc11941 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:28.409804 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-482339d6-5fb7-47f1-ae91-92983e25e828 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:28.549641 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482339d6-5fb7-47f1-ae91-92983e25e828 service cinder] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:28.554864 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf57e35-df19-4548-a39e-2128ab534acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:28.556055 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf57e35-df19-4548-a39e-2128ab534acf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:28.556544 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf57e35-df19-4548-a39e-2128ab534acf admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:28.557027 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf57e35-df19-4548-a39e-2128ab534acf admin admin] PATH_INFO: `/v3/projects/2a8f3c66c30b4707b2f64b05adaad276` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:28.558392 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf57e35-df19-4548-a39e-2128ab534acf admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a8f3c66c30b4707b2f64b05adaad276)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:28.560753 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf57e35-df19-4548-a39e-2128ab534acf admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:28.597923 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f32ba-ca0e-4099-89aa-65926cc11941 service cinder] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:28.629057 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef111b9-e70a-4916-bad2-057fd3dca51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:28.631882 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef111b9-e70a-4916-bad2-057fd3dca51e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:28.633473 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef111b9-e70a-4916-bad2-057fd3dca51e admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:28.633769 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef111b9-e70a-4916-bad2-057fd3dca51e admin admin] PATH_INFO: `/v3/projects/bb4c0810c1124ffa823c4a28f0f4887d` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:28.645370 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef111b9-e70a-4916-bad2-057fd3dca51e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb4c0810c1124ffa823c4a28f0f4887d)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:28.650887 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-9bf57e35-df19-4548-a39e-2128ab534acf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a8f3c66c30b4707b2f64b05adaad276', 'request_id': 'req-9bf57e35-df19-4548-a39e-2128ab534acf'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:28.654004 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef111b9-e70a-4916-bad2-057fd3dca51e admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:28.677351 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-9bf57e35-df19-4548-a39e-2128ab534acf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a8f3c66c30b4707b2f64b05adaad276', 'request_id': 'req-9bf57e35-df19-4548-a39e-2128ab534acf'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:28.685376 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-9bf57e35-df19-4548-a39e-2128ab534acf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a8f3c66c30b4707b2f64b05adaad276', 'request_id': 'req-9bf57e35-df19-4548-a39e-2128ab534acf'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:28.722856 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-9bf57e35-df19-4548-a39e-2128ab534acf admin admin] The token cache is being invalidate because project 2a8f3c66c30b4707b2f64b05adaad276 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 04:59:28.723151 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-9bf57e35-df19-4548-a39e-2128ab534acf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:28.723856 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-9bf57e35-df19-4548-a39e-2128ab534acf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:28.728349 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 888/1772] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 04:59:28 2021] DELETE /identity/v3/projects/2a8f3c66c30b4707b2f64b05adaad276 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:59:28.729585 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf57e35-df19-4548-a39e-2128ab534acf admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:28.731137 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-9bf57e35-df19-4548-a39e-2128ab534acf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:28.802213 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-6ef111b9-e70a-4916-bad2-057fd3dca51e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb4c0810c1124ffa823c4a28f0f4887d', 'request_id': 'req-6ef111b9-e70a-4916-bad2-057fd3dca51e'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:28.820808 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-6ef111b9-e70a-4916-bad2-057fd3dca51e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb4c0810c1124ffa823c4a28f0f4887d', 'request_id': 'req-6ef111b9-e70a-4916-bad2-057fd3dca51e'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:28.829600 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-6ef111b9-e70a-4916-bad2-057fd3dca51e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb4c0810c1124ffa823c4a28f0f4887d', 'request_id': 'req-6ef111b9-e70a-4916-bad2-057fd3dca51e'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:28.854215 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-6ef111b9-e70a-4916-bad2-057fd3dca51e admin admin] The token cache is being invalidate because project bb4c0810c1124ffa823c4a28f0f4887d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 04:59:28.854615 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-6ef111b9-e70a-4916-bad2-057fd3dca51e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:28.861258 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-6ef111b9-e70a-4916-bad2-057fd3dca51e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:28.863365 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 885/1773] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 04:59:28 2021] DELETE /identity/v3/projects/bb4c0810c1124ffa823c4a28f0f4887d => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:59:28.867445 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef111b9-e70a-4916-bad2-057fd3dca51e admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:28.870388 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-6ef111b9-e70a-4916-bad2-057fd3dca51e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:28.956439 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf57e35-df19-4548-a39e-2128ab534acf admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:29.055993 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef111b9-e70a-4916-bad2-057fd3dca51e admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:29.069562 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c9134-d8f3-4cf9-ae48-9b17a2d3af2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:29.070764 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c9134-d8f3-4cf9-ae48-9b17a2d3af2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:29.071238 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c9134-d8f3-4cf9-ae48-9b17a2d3af2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:29.071689 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c9134-d8f3-4cf9-ae48-9b17a2d3af2f admin admin] PATH_INFO: `/v3/users/1da91a7c317a4600b63e02099b124080` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:29.073299 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359c9134-d8f3-4cf9-ae48-9b17a2d3af2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1da91a7c317a4600b63e02099b124080)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:29.075710 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359c9134-d8f3-4cf9-ae48-9b17a2d3af2f admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:29.087572 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d753cc1f-1b6e-4763-a25d-d8c0717b3e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:29.088623 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753cc1f-1b6e-4763-a25d-d8c0717b3e9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:29.089036 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753cc1f-1b6e-4763-a25d-d8c0717b3e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:29.089457 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753cc1f-1b6e-4763-a25d-d8c0717b3e9d admin admin] PATH_INFO: `/v3/users/53cb9af8b8534f1bb52687b582368add` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:29.093726 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d753cc1f-1b6e-4763-a25d-d8c0717b3e9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=53cb9af8b8534f1bb52687b582368add)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:29.100580 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d753cc1f-1b6e-4763-a25d-d8c0717b3e9d admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:29.185302 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-359c9134-d8f3-4cf9-ae48-9b17a2d3af2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1da91a7c317a4600b63e02099b124080'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:29.186537 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-359c9134-d8f3-4cf9-ae48-9b17a2d3af2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1da91a7c317a4600b63e02099b124080'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:29.222543 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-359c9134-d8f3-4cf9-ae48-9b17a2d3af2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1da91a7c317a4600b63e02099b124080'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:29.241282 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-359c9134-d8f3-4cf9-ae48-9b17a2d3af2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1da91a7c317a4600b63e02099b124080'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:29.242083 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-359c9134-d8f3-4cf9-ae48-9b17a2d3af2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1da91a7c317a4600b63e02099b124080'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:29.278307 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 886/1774] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 04:59:28 2021] DELETE /identity/v3/users/1da91a7c317a4600b63e02099b124080 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 04:59:29.280494 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-d753cc1f-1b6e-4763-a25d-d8c0717b3e9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53cb9af8b8534f1bb52687b582368add'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:29.281281 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-d753cc1f-1b6e-4763-a25d-d8c0717b3e9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53cb9af8b8534f1bb52687b582368add'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:29.297117 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-d753cc1f-1b6e-4763-a25d-d8c0717b3e9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53cb9af8b8534f1bb52687b582368add'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:29.313177 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-d753cc1f-1b6e-4763-a25d-d8c0717b3e9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53cb9af8b8534f1bb52687b582368add'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:29.352180 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-d753cc1f-1b6e-4763-a25d-d8c0717b3e9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53cb9af8b8534f1bb52687b582368add'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:29.376861 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 889/1775] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 04:59:28 2021] DELETE /identity/v3/users/53cb9af8b8534f1bb52687b582368add => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:59:29.438061 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9f088-6988-423b-835d-479e3241e188 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:29.438349 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9f088-6988-423b-835d-479e3241e188 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:29.438963 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9f088-6988-423b-835d-479e3241e188 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:29.441278 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 887/1776] 10.222.0.43 () {54 vars in 921 bytes} [Fri Dec 24 04:59:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:59:29.457087 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b75a73-93ae-4270-92e8-ec522d442c98 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:29.457588 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b75a73-93ae-4270-92e8-ec522d442c98 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:29.457774 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b75a73-93ae-4270-92e8-ec522d442c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:29.481958 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-b0b75a73-93ae-4270-92e8-ec522d442c98 None None] MFA Rules not processed for user `6f9ad1e8f8f74edcb44aabe17eb59648`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:29.484022 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-b0b75a73-93ae-4270-92e8-ec522d442c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:29.592669 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 890/1777] 10.222.0.43 () {58 vars in 1018 bytes} [Fri Dec 24 04:59:29 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:30.099310 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb9f088-6988-423b-835d-479e3241e188 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:30.101786 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-4bb9f088-6988-423b-835d-479e3241e188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:30.161523 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb9f088-6988-423b-835d-479e3241e188 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:30.191918 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e77ac-8d29-40bf-88a5-070246feeb43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f9ad1e8f8f74edcb44aabe17eb59648', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:30.192633 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e77ac-8d29-40bf-88a5-070246feeb43 service nova] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:30.192917 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e77ac-8d29-40bf-88a5-070246feeb43 service nova] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:30.193213 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e77ac-8d29-40bf-88a5-070246feeb43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:30.257508 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e77ac-8d29-40bf-88a5-070246feeb43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:30.259123 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e77ac-8d29-40bf-88a5-070246feeb43 service nova] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:30.323128 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 888/1778] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:59:30 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:59:30.903077 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b75a73-93ae-4270-92e8-ec522d442c98 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:30.905133 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-b0b75a73-93ae-4270-92e8-ec522d442c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:31.079029 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b75a73-93ae-4270-92e8-ec522d442c98 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:31.090350 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd98d26f-ba2b-4f93-9918-13fb5547fb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:31.091435 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98d26f-ba2b-4f93-9918-13fb5547fb20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:31.091861 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98d26f-ba2b-4f93-9918-13fb5547fb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:31.092447 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98d26f-ba2b-4f93-9918-13fb5547fb20 admin admin] PATH_INFO: `/v3/projects/8091752497d14ce0935026b6e200c825` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:31.093869 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd98d26f-ba2b-4f93-9918-13fb5547fb20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8091752497d14ce0935026b6e200c825)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:31.096086 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd98d26f-ba2b-4f93-9918-13fb5547fb20 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:31.144078 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e77ac-8d29-40bf-88a5-070246feeb43 service nova] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:31.145640 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-c62e77ac-8d29-40bf-88a5-070246feeb43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:31.164116 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e77ac-8d29-40bf-88a5-070246feeb43 service nova] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:31.226478 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-dd98d26f-ba2b-4f93-9918-13fb5547fb20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8091752497d14ce0935026b6e200c825', 'request_id': 'req-dd98d26f-ba2b-4f93-9918-13fb5547fb20'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:31.245226 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-dd98d26f-ba2b-4f93-9918-13fb5547fb20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8091752497d14ce0935026b6e200c825', 'request_id': 'req-dd98d26f-ba2b-4f93-9918-13fb5547fb20'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:31.254064 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-dd98d26f-ba2b-4f93-9918-13fb5547fb20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8091752497d14ce0935026b6e200c825', 'request_id': 'req-dd98d26f-ba2b-4f93-9918-13fb5547fb20'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:31.297004 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-dd98d26f-ba2b-4f93-9918-13fb5547fb20 admin admin] The token cache is being invalidate because project 8091752497d14ce0935026b6e200c825 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 04:59:31.298527 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf1d1d-6fc5-4fc5-a27c-358c59f9de4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:31.299066 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-dd98d26f-ba2b-4f93-9918-13fb5547fb20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:31.301032 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf1d1d-6fc5-4fc5-a27c-358c59f9de4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:31.301496 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf1d1d-6fc5-4fc5-a27c-358c59f9de4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:31.303130 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf1d1d-6fc5-4fc5-a27c-358c59f9de4e admin admin] PATH_INFO: `/v3/projects/53de305faadf4e7da3152a0a568436be` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:31.304420 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-dd98d26f-ba2b-4f93-9918-13fb5547fb20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:31.305402 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabf1d1d-6fc5-4fc5-a27c-358c59f9de4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=53de305faadf4e7da3152a0a568436be)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:31.308927 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabf1d1d-6fc5-4fc5-a27c-358c59f9de4e admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:31.319379 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 891/1779] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 04:59:30 2021] DELETE /identity/v3/projects/8091752497d14ce0935026b6e200c825 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:59:31.321207 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b376ac-45a1-475a-91de-4e29e74086ec None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:31.321495 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b376ac-45a1-475a-91de-4e29e74086ec None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:31.321772 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b376ac-45a1-475a-91de-4e29e74086ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:31.389884 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-26b376ac-45a1-475a-91de-4e29e74086ec None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:31.393104 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-26b376ac-45a1-475a-91de-4e29e74086ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:31.426573 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-dabf1d1d-6fc5-4fc5-a27c-358c59f9de4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53de305faadf4e7da3152a0a568436be', 'request_id': 'req-dabf1d1d-6fc5-4fc5-a27c-358c59f9de4e'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:31.446137 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-dabf1d1d-6fc5-4fc5-a27c-358c59f9de4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53de305faadf4e7da3152a0a568436be', 'request_id': 'req-dabf1d1d-6fc5-4fc5-a27c-358c59f9de4e'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:31.460916 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-dabf1d1d-6fc5-4fc5-a27c-358c59f9de4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53de305faadf4e7da3152a0a568436be', 'request_id': 'req-dabf1d1d-6fc5-4fc5-a27c-358c59f9de4e'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:31.501628 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-dabf1d1d-6fc5-4fc5-a27c-358c59f9de4e admin admin] The token cache is being invalidate because project 53de305faadf4e7da3152a0a568436be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 04:59:31.501916 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-dabf1d1d-6fc5-4fc5-a27c-358c59f9de4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:31.503687 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-dabf1d1d-6fc5-4fc5-a27c-358c59f9de4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:31.506276 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 889/1780] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 04:59:31 2021] DELETE /identity/v3/projects/53de305faadf4e7da3152a0a568436be => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:59:31.526175 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1d694-3c55-42b4-93b7-8c71b0821ab2 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:31.526811 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1d694-3c55-42b4-93b7-8c71b0821ab2 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:31.527232 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1d694-3c55-42b4-93b7-8c71b0821ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:31.545388 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 892/1781] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:31.546984 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff0002-d64a-4a20-896e-151460491266 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:31.547480 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff0002-d64a-4a20-896e-151460491266 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:31.547906 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff0002-d64a-4a20-896e-151460491266 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:31.563914 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 893/1782] 10.222.0.43 () {54 vars in 921 bytes} [Fri Dec 24 04:59:31 2021] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 04:59:31.590553 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-11a1d694-3c55-42b4-93b7-8c71b0821ab2 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:31.592079 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-11a1d694-3c55-42b4-93b7-8c71b0821ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:31.597180 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f7a852-c030-44a1-a4e1-e655fc2d7bad None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:31.597467 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f7a852-c030-44a1-a4e1-e655fc2d7bad None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:31.597748 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f7a852-c030-44a1-a4e1-e655fc2d7bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:31.601788 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 890/1783] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:31.603401 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616bfa5d-682b-440c-925b-99ce92c92103 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:31.603846 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616bfa5d-682b-440c-925b-99ce92c92103 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:31.604293 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616bfa5d-682b-440c-925b-99ce92c92103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:31.630852 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-616bfa5d-682b-440c-925b-99ce92c92103 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:31.632516 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-616bfa5d-682b-440c-925b-99ce92c92103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:31.632668 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-d0f7a852-c030-44a1-a4e1-e655fc2d7bad None None] MFA Rules not processed for user `6f9ad1e8f8f74edcb44aabe17eb59648`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:31.633868 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-d0f7a852-c030-44a1-a4e1-e655fc2d7bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:31.643485 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 891/1784] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:31.645152 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d44bd-5211-4ef9-8797-28554c912fd4 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:31.646048 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d44bd-5211-4ef9-8797-28554c912fd4 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:31.646561 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d44bd-5211-4ef9-8797-28554c912fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:31.667595 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-388d44bd-5211-4ef9-8797-28554c912fd4 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:31.669293 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-388d44bd-5211-4ef9-8797-28554c912fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:31.679514 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 892/1785] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:31.680690 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d44bd-5211-4ef9-8797-28554c912fd4 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:31.704463 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d44bd-5211-4ef9-8797-28554c912fd4 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:31.714296 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a5c13-e2a1-4b26-b0f4-96fd4e149673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:31.715168 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a5c13-e2a1-4b26-b0f4-96fd4e149673 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:31.715586 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a5c13-e2a1-4b26-b0f4-96fd4e149673 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:31.716130 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a5c13-e2a1-4b26-b0f4-96fd4e149673 admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:31.717104 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940a5c13-e2a1-4b26-b0f4-96fd4e149673 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:59:31.717596 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940a5c13-e2a1-4b26-b0f4-96fd4e149673 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:31.719662 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940a5c13-e2a1-4b26-b0f4-96fd4e149673 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:31.734267 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 893/1786] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 04:59:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:59:31.735651 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a5c13-e2a1-4b26-b0f4-96fd4e149673 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:31.754448 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a5c13-e2a1-4b26-b0f4-96fd4e149673 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:31.773834 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6ad35-7d2a-4da1-aeec-a020922b0753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:31.774677 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 894/1787] 10.222.0.43 () {58 vars in 1018 bytes} [Fri Dec 24 04:59:31 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:31.775548 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6ad35-7d2a-4da1-aeec-a020922b0753 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:31.776198 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f7a852-c030-44a1-a4e1-e655fc2d7bad None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:31.776629 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6ad35-7d2a-4da1-aeec-a020922b0753 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:31.778555 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6ad35-7d2a-4da1-aeec-a020922b0753 admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:31.779448 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b6ad35-7d2a-4da1-aeec-a020922b0753 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:59:31.788232 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b6ad35-7d2a-4da1-aeec-a020922b0753 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:31.790391 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b6ad35-7d2a-4da1-aeec-a020922b0753 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:31.803175 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f7a852-c030-44a1-a4e1-e655fc2d7bad None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:31.818128 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce3fe8-29e4-417d-a6e9-8ab4d3a1a934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:31.818286 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 894/1788] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 04:59:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:59:31.819113 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6ad35-7d2a-4da1-aeec-a020922b0753 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:31.819578 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce3fe8-29e4-417d-a6e9-8ab4d3a1a934 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:31.820290 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce3fe8-29e4-417d-a6e9-8ab4d3a1a934 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:31.820840 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-05b6ad35-7d2a-4da1-aeec-a020922b0753 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:31.820998 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce3fe8-29e4-417d-a6e9-8ab4d3a1a934 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:31.822403 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce3fe8-29e4-417d-a6e9-8ab4d3a1a934 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:31.825007 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce3fe8-29e4-417d-a6e9-8ab4d3a1a934 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:31.861773 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6ad35-7d2a-4da1-aeec-a020922b0753 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:31.876419 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 895/1789] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 04:59:31 2021] POST /identity/v3/projects => generated 391 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:59:31.877782 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce3fe8-29e4-417d-a6e9-8ab4d3a1a934 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:31.878914 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f152b-41f8-4a70-bbc4-839533c76314 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f9ad1e8f8f74edcb44aabe17eb59648', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:31.879594 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f152b-41f8-4a70-bbc4-839533c76314 service nova] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:31.879874 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f152b-41f8-4a70-bbc4-839533c76314 service nova] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:31.881633 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f152b-41f8-4a70-bbc4-839533c76314 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:31.910285 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f152b-41f8-4a70-bbc4-839533c76314 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:31.912545 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f152b-41f8-4a70-bbc4-839533c76314 service nova] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:31.939072 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 895/1790] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:59:31 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:59:31.940250 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f152b-41f8-4a70-bbc4-839533c76314 service nova] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:31.944656 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce3fe8-29e4-417d-a6e9-8ab4d3a1a934 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:31.950941 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc072e7-31c3-4e3b-853e-22504624d7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:31.951893 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc072e7-31c3-4e3b-853e-22504624d7fe admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:31.952344 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc072e7-31c3-4e3b-853e-22504624d7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:31.952719 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc072e7-31c3-4e3b-853e-22504624d7fe admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:31.954224 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc072e7-31c3-4e3b-853e-22504624d7fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:31.956450 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc072e7-31c3-4e3b-853e-22504624d7fe admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:31.973467 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f152b-41f8-4a70-bbc4-839533c76314 service nova] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:31.978399 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c80d0-117d-4ff0-b7b2-55907d1635f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:31.979080 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c80d0-117d-4ff0-b7b2-55907d1635f5 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:31.979363 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c80d0-117d-4ff0-b7b2-55907d1635f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:31.980022 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c80d0-117d-4ff0-b7b2-55907d1635f5 admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:31.981058 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c80d0-117d-4ff0-b7b2-55907d1635f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:31.983359 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c80d0-117d-4ff0-b7b2-55907d1635f5 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:31.995451 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 896/1791] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 04:59:31 2021] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:59:31.996556 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc072e7-31c3-4e3b-853e-22504624d7fe admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:32.009348 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 896/1792] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 04:59:31 2021] POST /identity/v3/users => generated 296 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:59:32.010899 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c80d0-117d-4ff0-b7b2-55907d1635f5 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:32.022081 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c80d0-117d-4ff0-b7b2-55907d1635f5 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:32.077950 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc072e7-31c3-4e3b-853e-22504624d7fe admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:32.083651 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721678a4-9f77-4e0f-9bf2-2eea0b2b2084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:32.085126 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721678a4-9f77-4e0f-9bf2-2eea0b2b2084 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:32.085482 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721678a4-9f77-4e0f-9bf2-2eea0b2b2084 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:32.085760 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721678a4-9f77-4e0f-9bf2-2eea0b2b2084 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:32.086508 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721678a4-9f77-4e0f-9bf2-2eea0b2b2084 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:32.088455 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721678a4-9f77-4e0f-9bf2-2eea0b2b2084 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:32.108143 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760860e1-fb31-47a9-ace6-723c58d69b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:32.108864 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760860e1-fb31-47a9-ace6-723c58d69b25 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:32.109145 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760860e1-fb31-47a9-ace6-723c58d69b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:32.109415 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760860e1-fb31-47a9-ace6-723c58d69b25 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:32.110411 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760860e1-fb31-47a9-ace6-723c58d69b25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:32.112616 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 897/1793] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 04:59:31 2021] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 04:59:32.112753 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760860e1-fb31-47a9-ace6-723c58d69b25 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:32.115205 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721678a4-9f77-4e0f-9bf2-2eea0b2b2084 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:32.122097 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 897/1794] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 04:59:32 2021] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 04:59:32.124865 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721678a4-9f77-4e0f-9bf2-2eea0b2b2084 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:32.126258 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760860e1-fb31-47a9-ace6-723c58d69b25 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:32.130407 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44b843-7d2e-4af7-9107-42d02559848e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:32.131371 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44b843-7d2e-4af7-9107-42d02559848e admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:32.131653 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44b843-7d2e-4af7-9107-42d02559848e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:32.131946 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44b843-7d2e-4af7-9107-42d02559848e admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:32.132757 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b44b843-7d2e-4af7-9107-42d02559848e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:32.134406 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b44b843-7d2e-4af7-9107-42d02559848e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:32.136812 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760860e1-fb31-47a9-ace6-723c58d69b25 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:32.146128 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e986820b-1369-49de-aa2e-3412868153f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:32.147253 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986820b-1369-49de-aa2e-3412868153f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:32.147253 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986820b-1369-49de-aa2e-3412868153f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:32.147631 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986820b-1369-49de-aa2e-3412868153f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:32.148488 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e986820b-1369-49de-aa2e-3412868153f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:32.150204 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e986820b-1369-49de-aa2e-3412868153f2 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:32.152581 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 898/1795] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 04:59:32 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 24 04:59:32.155166 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44b843-7d2e-4af7-9107-42d02559848e admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:32.161289 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 898/1796] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 04:59:32 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 24 04:59:32.165203 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e986820b-1369-49de-aa2e-3412868153f2 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:32.165652 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44b843-7d2e-4af7-9107-42d02559848e admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:32.170250 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62b827-981d-4f66-8894-a78c1c075fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:32.170912 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62b827-981d-4f66-8894-a78c1c075fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:32.171196 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62b827-981d-4f66-8894-a78c1c075fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:32.171473 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62b827-981d-4f66-8894-a78c1c075fd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:32.172243 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b62b827-981d-4f66-8894-a78c1c075fd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:32.173887 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b62b827-981d-4f66-8894-a78c1c075fd7 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:32.174777 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e986820b-1369-49de-aa2e-3412868153f2 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:32.179516 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2356089a-db22-47d8-879c-279168b4fc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:32.180380 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356089a-db22-47d8-879c-279168b4fc13 admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:32.180697 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356089a-db22-47d8-879c-279168b4fc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:32.180978 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356089a-db22-47d8-879c-279168b4fc13 admin admin] PATH_INFO: `/v3/projects/1902a6ad87414fb187bc9daafee87d64/users/6d18b372ede14291a2383cb3067c7ca4/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:32.184088 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 899/1797] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 04:59:32 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 24 04:59:32.188273 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62b827-981d-4f66-8894-a78c1c075fd7 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:32.196928 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2356089a-db22-47d8-879c-279168b4fc13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1902a6ad87414fb187bc9daafee87d64, user_id=6d18b372ede14291a2383cb3067c7ca4, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:32.198436 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62b827-981d-4f66-8894-a78c1c075fd7 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:32.200285 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2356089a-db22-47d8-879c-279168b4fc13 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:32.220287 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4724ac6-0da1-4d29-8989-7068fbac2778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:32.221443 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4724ac6-0da1-4d29-8989-7068fbac2778 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:32.221748 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4724ac6-0da1-4d29-8989-7068fbac2778 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:32.222028 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4724ac6-0da1-4d29-8989-7068fbac2778 admin admin] PATH_INFO: `/v3/projects/e000c1da87114220b94ae4e923090064/users/50bc9402c6744294810aa51be9b55b4f/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:32.225688 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 899/1798] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 04:59:32 2021] PUT /identity/v3/projects/1902a6ad87414fb187bc9daafee87d64/users/6d18b372ede14291a2383cb3067c7ca4/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 04:59:32.236243 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6208c-d5bd-4487-8e99-bb5ae6981732 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:32.237005 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6208c-d5bd-4487-8e99-bb5ae6981732 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:32.237185 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6208c-d5bd-4487-8e99-bb5ae6981732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:32.250675 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4724ac6-0da1-4d29-8989-7068fbac2778 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e000c1da87114220b94ae4e923090064, user_id=50bc9402c6744294810aa51be9b55b4f, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:32.253450 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4724ac6-0da1-4d29-8989-7068fbac2778 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:32.283389 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-21c6208c-d5bd-4487-8e99-bb5ae6981732 None None] MFA Rules not processed for user `6d18b372ede14291a2383cb3067c7ca4`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:32.284708 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-21c6208c-d5bd-4487-8e99-bb5ae6981732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:32.288666 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 900/1799] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 04:59:32 2021] PUT /identity/v3/projects/e000c1da87114220b94ae4e923090064/users/50bc9402c6744294810aa51be9b55b4f/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 04:59:32.296119 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba2eae-d610-41e8-bb07-d88b8fc3f14c None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:32.296562 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba2eae-d610-41e8-bb07-d88b8fc3f14c None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:32.296918 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba2eae-d610-41e8-bb07-d88b8fc3f14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:32.342804 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-99ba2eae-d610-41e8-bb07-d88b8fc3f14c None None] MFA Rules not processed for user `50bc9402c6744294810aa51be9b55b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:32.344188 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-99ba2eae-d610-41e8-bb07-d88b8fc3f14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:32.371827 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 900/1800] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:32 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:32.373757 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6208c-d5bd-4487-8e99-bb5ae6981732 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:32.444014 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 901/1801] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:32 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 04:59:32.463273 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ba2eae-d610-41e8-bb07-d88b8fc3f14c None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:32.464864 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-99ba2eae-d610-41e8-bb07-d88b8fc3f14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:32.497638 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6208c-d5bd-4487-8e99-bb5ae6981732 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:32.507059 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd54a98d-2d7a-465e-af91-7c5778bb3afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:32.507160 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54a98d-2d7a-465e-af91-7c5778bb3afc admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:32.507657 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54a98d-2d7a-465e-af91-7c5778bb3afc admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:32.508015 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54a98d-2d7a-465e-af91-7c5778bb3afc admin admin] PATH_INFO: `/v3/projects` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:32.509030 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd54a98d-2d7a-465e-af91-7c5778bb3afc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:32.512052 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd54a98d-2d7a-465e-af91-7c5778bb3afc admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:32.546154 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ba2eae-d610-41e8-bb07-d88b8fc3f14c None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:32.546629 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 901/1802] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 04:59:32 2021] POST /identity/v3/projects => generated 393 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 04:59:32.553805 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd54a98d-2d7a-465e-af91-7c5778bb3afc admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:32.633931 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48f82d4-1902-4e4d-ba9f-68b947472fa2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:32.634937 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f82d4-1902-4e4d-ba9f-68b947472fa2 service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:32.635233 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f82d4-1902-4e4d-ba9f-68b947472fa2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:32.635513 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f82d4-1902-4e4d-ba9f-68b947472fa2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:32.642012 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd54a98d-2d7a-465e-af91-7c5778bb3afc admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:32.647280 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d6ab85-7dae-4e1f-a53f-35e156cec00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:32.648669 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6ab85-7dae-4e1f-a53f-35e156cec00f admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:32.649040 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6ab85-7dae-4e1f-a53f-35e156cec00f admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:32.649389 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6ab85-7dae-4e1f-a53f-35e156cec00f admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:32.650361 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d6ab85-7dae-4e1f-a53f-35e156cec00f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:32.652456 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d6ab85-7dae-4e1f-a53f-35e156cec00f admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:32.684452 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 902/1803] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 04:59:32 2021] POST /identity/v3/users => generated 303 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:59:32.685916 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d6ab85-7dae-4e1f-a53f-35e156cec00f admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:32.698123 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d6ab85-7dae-4e1f-a53f-35e156cec00f admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:32.703995 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536b71d7-ef59-4313-b435-b457e0403ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:32.704783 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b71d7-ef59-4313-b435-b457e0403ddc admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:32.705178 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b71d7-ef59-4313-b435-b457e0403ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:32.705523 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b71d7-ef59-4313-b435-b457e0403ddc admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:32.706388 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536b71d7-ef59-4313-b435-b457e0403ddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:32.707566 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48f82d4-1902-4e4d-ba9f-68b947472fa2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:32.708351 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536b71d7-ef59-4313-b435-b457e0403ddc admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:32.709117 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48f82d4-1902-4e4d-ba9f-68b947472fa2 service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:32.729912 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 903/1804] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 04:59:32 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 04:59:32.735544 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536b71d7-ef59-4313-b435-b457e0403ddc admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:32.761490 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536b71d7-ef59-4313-b435-b457e0403ddc admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:32.767740 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 902/1805] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:59:32 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:59:32.772181 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076991fd-62bd-4f67-a625-b28f46201dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:32.773685 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076991fd-62bd-4f67-a625-b28f46201dc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:32.774188 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076991fd-62bd-4f67-a625-b28f46201dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:32.774756 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076991fd-62bd-4f67-a625-b28f46201dc0 admin admin] PATH_INFO: `/v3/projects/397e8dfbbe584e879a829c8e8acb2b86/users/796be842fd7c4d7097237300ef5efb49/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:32.796268 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48f82d4-1902-4e4d-ba9f-68b947472fa2 service cinder] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:32.808396 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48f82d4-1902-4e4d-ba9f-68b947472fa2 service cinder] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:32.820120 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2767c-566f-4513-ba3a-b4b569639961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:32.821044 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2767c-566f-4513-ba3a-b4b569639961 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:32.821322 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2767c-566f-4513-ba3a-b4b569639961 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:32.821622 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2767c-566f-4513-ba3a-b4b569639961 admin admin] PATH_INFO: `/v3/users/50bc9402c6744294810aa51be9b55b4f` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:32.823695 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076991fd-62bd-4f67-a625-b28f46201dc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=397e8dfbbe584e879a829c8e8acb2b86, user_id=796be842fd7c4d7097237300ef5efb49, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:32.828071 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce2767c-566f-4513-ba3a-b4b569639961 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50bc9402c6744294810aa51be9b55b4f)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:32.830127 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce2767c-566f-4513-ba3a-b4b569639961 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:32.831115 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076991fd-62bd-4f67-a625-b28f46201dc0 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:32.869416 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 904/1806] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 04:59:32 2021] PUT /identity/v3/projects/397e8dfbbe584e879a829c8e8acb2b86/users/796be842fd7c4d7097237300ef5efb49/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:59:32.873147 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076991fd-62bd-4f67-a625-b28f46201dc0 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:32.944222 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-bce2767c-566f-4513-ba3a-b4b569639961 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50bc9402c6744294810aa51be9b55b4f'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:32.944916 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-bce2767c-566f-4513-ba3a-b4b569639961 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50bc9402c6744294810aa51be9b55b4f'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:32.956221 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-bce2767c-566f-4513-ba3a-b4b569639961 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50bc9402c6744294810aa51be9b55b4f'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:32.977273 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-bce2767c-566f-4513-ba3a-b4b569639961 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50bc9402c6744294810aa51be9b55b4f'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:33.003768 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076991fd-62bd-4f67-a625-b28f46201dc0 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:33.012364 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114bf8ad-4e58-4ffa-a6f2-1f13eef7c705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:33.014460 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114bf8ad-4e58-4ffa-a6f2-1f13eef7c705 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:33.014754 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114bf8ad-4e58-4ffa-a6f2-1f13eef7c705 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:33.015078 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114bf8ad-4e58-4ffa-a6f2-1f13eef7c705 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:33.015366 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-bce2767c-566f-4513-ba3a-b4b569639961 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50bc9402c6744294810aa51be9b55b4f'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:33.015980 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114bf8ad-4e58-4ffa-a6f2-1f13eef7c705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:33.018101 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114bf8ad-4e58-4ffa-a6f2-1f13eef7c705 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:33.044038 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 905/1807] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 04:59:32 2021] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 04:59:33.049189 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114bf8ad-4e58-4ffa-a6f2-1f13eef7c705 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:33.051510 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-114bf8ad-4e58-4ffa-a6f2-1f13eef7c705 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:33.052861 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 903/1808] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 04:59:32 2021] DELETE /identity/v3/users/50bc9402c6744294810aa51be9b55b4f => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:59:33.061628 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41230ba-eb0f-418c-9f54-ab7e77647a65 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:33.061628 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41230ba-eb0f-418c-9f54-ab7e77647a65 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:33.061628 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41230ba-eb0f-418c-9f54-ab7e77647a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:33.067744 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114bf8ad-4e58-4ffa-a6f2-1f13eef7c705 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:33.090987 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-b41230ba-eb0f-418c-9f54-ab7e77647a65 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:33.092490 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-b41230ba-eb0f-418c-9f54-ab7e77647a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:33.156324 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4eb7ac-85cd-4100-94d7-7ddf27941fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:33.157549 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4eb7ac-85cd-4100-94d7-7ddf27941fbd admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:33.157729 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4eb7ac-85cd-4100-94d7-7ddf27941fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:33.158019 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4eb7ac-85cd-4100-94d7-7ddf27941fbd admin admin] PATH_INFO: `/v3/projects/397e8dfbbe584e879a829c8e8acb2b86/users/796be842fd7c4d7097237300ef5efb49/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:33.160601 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4eb7ac-85cd-4100-94d7-7ddf27941fbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=397e8dfbbe584e879a829c8e8acb2b86, user_id=796be842fd7c4d7097237300ef5efb49, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:33.163886 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4eb7ac-85cd-4100-94d7-7ddf27941fbd admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:33.175749 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 906/1809] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 04:59:33 2021] PUT /identity/v3/projects/397e8dfbbe584e879a829c8e8acb2b86/users/796be842fd7c4d7097237300ef5efb49/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 04:59:33.187993 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3489a5e-a9d4-4c35-8c9a-f3b0565400aa None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:33.188119 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3489a5e-a9d4-4c35-8c9a-f3b0565400aa None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:33.188473 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3489a5e-a9d4-4c35-8c9a-f3b0565400aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:33.230057 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 904/1810] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:33.241879 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41230ba-eb0f-418c-9f54-ab7e77647a65 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:33.243639 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-b41230ba-eb0f-418c-9f54-ab7e77647a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:33.251798 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-e3489a5e-a9d4-4c35-8c9a-f3b0565400aa None None] MFA Rules not processed for user `796be842fd7c4d7097237300ef5efb49`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:33.253248 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-e3489a5e-a9d4-4c35-8c9a-f3b0565400aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:33.403249 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41230ba-eb0f-418c-9f54-ab7e77647a65 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:33.409143 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 907/1811] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:33 2021] POST /identity/v3/auth/tokens => generated 3327 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:33.416253 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3489a5e-a9d4-4c35-8c9a-f3b0565400aa None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:33.417880 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-e3489a5e-a9d4-4c35-8c9a-f3b0565400aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:33.487713 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3489a5e-a9d4-4c35-8c9a-f3b0565400aa None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:33.489896 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7406f-7439-4c6a-9680-aee279671255 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:33.490648 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7406f-7439-4c6a-9680-aee279671255 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:33.491110 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7406f-7439-4c6a-9680-aee279671255 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:33.491452 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7406f-7439-4c6a-9680-aee279671255 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:33.491548 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f092b-9301-446a-97a4-2df6b381278d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:33.492168 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f092b-9301-446a-97a4-2df6b381278d service cinder] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:33.492496 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f092b-9301-446a-97a4-2df6b381278d service cinder] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:33.492810 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f092b-9301-446a-97a4-2df6b381278d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:33.503177 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855f092b-9301-446a-97a4-2df6b381278d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:33.504672 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855f092b-9301-446a-97a4-2df6b381278d service cinder] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:33.524384 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 908/1812] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:59:33 2021] GET /identity/v3/auth/tokens => generated 3327 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 24 04:59:33.567682 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa7406f-7439-4c6a-9680-aee279671255 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:33.569332 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa7406f-7439-4c6a-9680-aee279671255 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:33.583094 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f092b-9301-446a-97a4-2df6b381278d service cinder] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:33.584513 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-855f092b-9301-446a-97a4-2df6b381278d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:33.592816 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 905/1813] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:59:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:59:33.598884 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f092b-9301-446a-97a4-2df6b381278d service cinder] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:33.602873 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc24f63-fcf0-4cac-ba5e-645df3b63328 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:33.603601 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc24f63-fcf0-4cac-ba5e-645df3b63328 service cinder] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:33.603888 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc24f63-fcf0-4cac-ba5e-645df3b63328 service cinder] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:33.604161 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc24f63-fcf0-4cac-ba5e-645df3b63328 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:33.606528 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-2dc24f63-fcf0-4cac-ba5e-645df3b63328 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:33.699818 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc24f63-fcf0-4cac-ba5e-645df3b63328 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:33.701707 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc24f63-fcf0-4cac-ba5e-645df3b63328 service cinder] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:33.713176 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 909/1814] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:59:33 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 24 04:59:34.020624 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7406f-7439-4c6a-9680-aee279671255 service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:34.022237 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-3aa7406f-7439-4c6a-9680-aee279671255 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:34.038629 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7406f-7439-4c6a-9680-aee279671255 service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:34.044467 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc37862c-d944-4164-aedd-973966daf11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:34.045471 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37862c-d944-4164-aedd-973966daf11a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:34.045860 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37862c-d944-4164-aedd-973966daf11a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:34.046257 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37862c-d944-4164-aedd-973966daf11a admin admin] PATH_INFO: `/v3/projects/e000c1da87114220b94ae4e923090064` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:34.047678 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc37862c-d944-4164-aedd-973966daf11a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e000c1da87114220b94ae4e923090064)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:34.049734 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc37862c-d944-4164-aedd-973966daf11a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:34.114034 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-bc37862c-d944-4164-aedd-973966daf11a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e000c1da87114220b94ae4e923090064', 'request_id': 'req-bc37862c-d944-4164-aedd-973966daf11a'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:34.123567 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-bc37862c-d944-4164-aedd-973966daf11a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e000c1da87114220b94ae4e923090064', 'request_id': 'req-bc37862c-d944-4164-aedd-973966daf11a'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:34.129984 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-bc37862c-d944-4164-aedd-973966daf11a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e000c1da87114220b94ae4e923090064', 'request_id': 'req-bc37862c-d944-4164-aedd-973966daf11a'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:34.142644 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-bc37862c-d944-4164-aedd-973966daf11a admin admin] The token cache is being invalidate because project e000c1da87114220b94ae4e923090064 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 04:59:34.142938 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-bc37862c-d944-4164-aedd-973966daf11a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:34.143664 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-bc37862c-d944-4164-aedd-973966daf11a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:34.145246 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 906/1815] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 04:59:34 2021] DELETE /identity/v3/projects/e000c1da87114220b94ae4e923090064 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:59:34.151285 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e86d92-4b2e-4984-bbba-1d9bf7178367 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:34.151582 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e86d92-4b2e-4984-bbba-1d9bf7178367 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:34.151865 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e86d92-4b2e-4984-bbba-1d9bf7178367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:34.170231 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-74e86d92-4b2e-4984-bbba-1d9bf7178367 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:34.171431 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-74e86d92-4b2e-4984-bbba-1d9bf7178367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:34.230022 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 910/1816] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 04:59:34.238641 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72174aca-6396-4bd8-9ea1-650c81c53450 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:34.238976 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72174aca-6396-4bd8-9ea1-650c81c53450 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:34.239271 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72174aca-6396-4bd8-9ea1-650c81c53450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:34.259574 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-72174aca-6396-4bd8-9ea1-650c81c53450 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:34.260929 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-72174aca-6396-4bd8-9ea1-650c81c53450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:34.270818 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 907/1817] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:34.275386 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e86d92-4b2e-4984-bbba-1d9bf7178367 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:34.285370 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e86d92-4b2e-4984-bbba-1d9bf7178367 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:34.290274 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725ccc6-56c2-4def-89e0-5ae4bc9357dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:34.290923 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725ccc6-56c2-4def-89e0-5ae4bc9357dd admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:34.291208 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725ccc6-56c2-4def-89e0-5ae4bc9357dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:34.291486 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725ccc6-56c2-4def-89e0-5ae4bc9357dd admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:34.292271 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2725ccc6-56c2-4def-89e0-5ae4bc9357dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:59:34.292615 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2725ccc6-56c2-4def-89e0-5ae4bc9357dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:34.294248 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2725ccc6-56c2-4def-89e0-5ae4bc9357dd admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:34.305756 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 911/1818] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 04:59:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:59:34.310170 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72174aca-6396-4bd8-9ea1-650c81c53450 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:34.319937 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72174aca-6396-4bd8-9ea1-650c81c53450 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:34.325129 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b76820d-2734-4d7b-8188-43adaba24205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:34.325766 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76820d-2734-4d7b-8188-43adaba24205 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:34.326039 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76820d-2734-4d7b-8188-43adaba24205 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:34.326308 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76820d-2734-4d7b-8188-43adaba24205 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:34.327022 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b76820d-2734-4d7b-8188-43adaba24205 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:34.329132 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b76820d-2734-4d7b-8188-43adaba24205 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:34.356271 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 908/1819] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 04:59:34 2021] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 04:59:34.360467 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725ccc6-56c2-4def-89e0-5ae4bc9357dd admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:34.371361 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725ccc6-56c2-4def-89e0-5ae4bc9357dd admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:34.430933 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1bcbdb-19fa-4767-bb3e-b8a5e5abe874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:34.431615 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1bcbdb-19fa-4767-bb3e-b8a5e5abe874 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:34.431898 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1bcbdb-19fa-4767-bb3e-b8a5e5abe874 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:34.432172 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1bcbdb-19fa-4767-bb3e-b8a5e5abe874 admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:34.432928 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1bcbdb-19fa-4767-bb3e-b8a5e5abe874 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:34.434888 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1bcbdb-19fa-4767-bb3e-b8a5e5abe874 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:34.455357 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 912/1820] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 04:59:34 2021] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:59:34.459456 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b76820d-2734-4d7b-8188-43adaba24205 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:34.471449 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b76820d-2734-4d7b-8188-43adaba24205 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:34.477689 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e3c72-808e-4722-8e71-ad797751dc8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:34.478369 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e3c72-808e-4722-8e71-ad797751dc8a admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:34.478651 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e3c72-808e-4722-8e71-ad797751dc8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:34.478924 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e3c72-808e-4722-8e71-ad797751dc8a admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:34.479676 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e3c72-808e-4722-8e71-ad797751dc8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:34.481324 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e3c72-808e-4722-8e71-ad797751dc8a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:34.492390 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 909/1821] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 04:59:34 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 04:59:34.497977 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1bcbdb-19fa-4767-bb3e-b8a5e5abe874 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:34.508997 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1bcbdb-19fa-4767-bb3e-b8a5e5abe874 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:34.515522 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519437b3-43ef-4a04-8360-bfe791823d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:34.516199 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519437b3-43ef-4a04-8360-bfe791823d97 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:34.516414 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519437b3-43ef-4a04-8360-bfe791823d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:34.516755 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519437b3-43ef-4a04-8360-bfe791823d97 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:34.517516 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519437b3-43ef-4a04-8360-bfe791823d97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:34.519126 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519437b3-43ef-4a04-8360-bfe791823d97 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:34.530553 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 913/1822] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 04:59:34 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 04:59:34.534750 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e3c72-808e-4722-8e71-ad797751dc8a admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:34.544836 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e3c72-808e-4722-8e71-ad797751dc8a admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:34.550361 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcb6171-7c0b-4d4a-9464-59f834ebef2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:34.551237 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb6171-7c0b-4d4a-9464-59f834ebef2c admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:34.551518 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb6171-7c0b-4d4a-9464-59f834ebef2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:34.551796 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb6171-7c0b-4d4a-9464-59f834ebef2c admin admin] PATH_INFO: `/v3/projects/02dd5afff89945a8ae8c718fcbbb18e5/users/01eeac6dd0d44ac89d566f9098984c78/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:34.567903 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcb6171-7c0b-4d4a-9464-59f834ebef2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=02dd5afff89945a8ae8c718fcbbb18e5, user_id=01eeac6dd0d44ac89d566f9098984c78, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:34.570603 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcb6171-7c0b-4d4a-9464-59f834ebef2c admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:34.587818 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 910/1823] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 04:59:34 2021] PUT /identity/v3/projects/02dd5afff89945a8ae8c718fcbbb18e5/users/01eeac6dd0d44ac89d566f9098984c78/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:59:34.601265 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51fa7cc-8371-4f38-bb65-81860275ac60 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:34.601815 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51fa7cc-8371-4f38-bb65-81860275ac60 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:34.602373 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51fa7cc-8371-4f38-bb65-81860275ac60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:34.634709 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-f51fa7cc-8371-4f38-bb65-81860275ac60 None None] MFA Rules not processed for user `01eeac6dd0d44ac89d566f9098984c78`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:34.635931 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-f51fa7cc-8371-4f38-bb65-81860275ac60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:34.703057 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 914/1824] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:34 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:34.708239 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcb6171-7c0b-4d4a-9464-59f834ebef2c admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:34.771744 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcb6171-7c0b-4d4a-9464-59f834ebef2c admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:34.777845 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e314720-023a-476f-8ee9-8bd0725d9617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:34.778599 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e314720-023a-476f-8ee9-8bd0725d9617 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:34.778880 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e314720-023a-476f-8ee9-8bd0725d9617 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:34.779199 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e314720-023a-476f-8ee9-8bd0725d9617 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:34.780084 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e314720-023a-476f-8ee9-8bd0725d9617 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:34.782590 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e314720-023a-476f-8ee9-8bd0725d9617 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:34.809522 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 911/1825] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 04:59:34 2021] POST /identity/v3/projects => generated 375 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:59:34.814075 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51fa7cc-8371-4f38-bb65-81860275ac60 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:34.824702 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51fa7cc-8371-4f38-bb65-81860275ac60 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:34.894706 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45e08c-c112-4c07-ad85-e3a0569c548f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:34.895377 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45e08c-c112-4c07-ad85-e3a0569c548f admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:34.895655 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45e08c-c112-4c07-ad85-e3a0569c548f admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:34.895926 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45e08c-c112-4c07-ad85-e3a0569c548f admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:34.896668 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b45e08c-c112-4c07-ad85-e3a0569c548f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:34.898642 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b45e08c-c112-4c07-ad85-e3a0569c548f admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:34.920773 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 915/1826] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 04:59:34 2021] POST /identity/v3/users => generated 294 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:59:34.925777 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e314720-023a-476f-8ee9-8bd0725d9617 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:34.942034 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e314720-023a-476f-8ee9-8bd0725d9617 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:34.950772 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6404c19-3e92-45ea-8ae3-575075a8bae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:34.951644 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6404c19-3e92-45ea-8ae3-575075a8bae9 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:34.952036 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6404c19-3e92-45ea-8ae3-575075a8bae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:34.952424 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6404c19-3e92-45ea-8ae3-575075a8bae9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:34.953749 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6404c19-3e92-45ea-8ae3-575075a8bae9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:34.956634 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6404c19-3e92-45ea-8ae3-575075a8bae9 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:34.970725 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 912/1827] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 04:59:34 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 04:59:34.975732 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45e08c-c112-4c07-ad85-e3a0569c548f admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:34.989434 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45e08c-c112-4c07-ad85-e3a0569c548f admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:34.994848 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e998a402-4d21-44aa-91c7-0e5d22371544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:34.995722 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998a402-4d21-44aa-91c7-0e5d22371544 admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:34.996007 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998a402-4d21-44aa-91c7-0e5d22371544 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:34.996275 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998a402-4d21-44aa-91c7-0e5d22371544 admin admin] PATH_INFO: `/v3/projects/d13b030d8dcf4f56a602d519618ba88d/users/e9f52beeaa5b4d5288cf655dd33bf231/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:35.011418 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e998a402-4d21-44aa-91c7-0e5d22371544 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d13b030d8dcf4f56a602d519618ba88d, user_id=e9f52beeaa5b4d5288cf655dd33bf231, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:35.014197 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e998a402-4d21-44aa-91c7-0e5d22371544 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:35.029468 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 916/1828] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 04:59:34 2021] PUT /identity/v3/projects/d13b030d8dcf4f56a602d519618ba88d/users/e9f52beeaa5b4d5288cf655dd33bf231/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 04:59:35.033881 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6404c19-3e92-45ea-8ae3-575075a8bae9 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:35.045264 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6404c19-3e92-45ea-8ae3-575075a8bae9 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:35.103442 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb68b6-5f28-40d9-b0f6-d1b6bb76cfaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:35.104910 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb68b6-5f28-40d9-b0f6-d1b6bb76cfaf admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:35.105402 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb68b6-5f28-40d9-b0f6-d1b6bb76cfaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:35.105857 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb68b6-5f28-40d9-b0f6-d1b6bb76cfaf admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:35.106842 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcb68b6-5f28-40d9-b0f6-d1b6bb76cfaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:35.109044 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcb68b6-5f28-40d9-b0f6-d1b6bb76cfaf admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:35.126737 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 913/1829] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 04:59:35 2021] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 24 04:59:35.132252 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e998a402-4d21-44aa-91c7-0e5d22371544 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:35.152518 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e998a402-4d21-44aa-91c7-0e5d22371544 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:35.166769 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4872968c-4059-46ec-b5d1-706f8bbd45be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:35.167739 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872968c-4059-46ec-b5d1-706f8bbd45be admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:35.168021 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872968c-4059-46ec-b5d1-706f8bbd45be admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:35.168290 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872968c-4059-46ec-b5d1-706f8bbd45be admin admin] PATH_INFO: `/v3/projects/d13b030d8dcf4f56a602d519618ba88d/users/e9f52beeaa5b4d5288cf655dd33bf231/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:35.170336 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4872968c-4059-46ec-b5d1-706f8bbd45be admin admin] RBAC: Authorizing `identity:create_grant(project_id=d13b030d8dcf4f56a602d519618ba88d, user_id=e9f52beeaa5b4d5288cf655dd33bf231, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:35.173782 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4872968c-4059-46ec-b5d1-706f8bbd45be admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:35.186763 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 917/1830] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 04:59:35 2021] PUT /identity/v3/projects/d13b030d8dcf4f56a602d519618ba88d/users/e9f52beeaa5b4d5288cf655dd33bf231/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:59:35.199492 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcce965-f73a-4c9f-979a-1a1d08440c65 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:35.199965 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcce965-f73a-4c9f-979a-1a1d08440c65 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:35.200268 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcce965-f73a-4c9f-979a-1a1d08440c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:35.232506 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-ebcce965-f73a-4c9f-979a-1a1d08440c65 None None] MFA Rules not processed for user `e9f52beeaa5b4d5288cf655dd33bf231`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:35.233919 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-ebcce965-f73a-4c9f-979a-1a1d08440c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:35.305307 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 914/1831] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:35 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 04:59:35.315792 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4872968c-4059-46ec-b5d1-706f8bbd45be admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:35.317722 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-4872968c-4059-46ec-b5d1-706f8bbd45be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:35.375004 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4872968c-4059-46ec-b5d1-706f8bbd45be admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:35.378840 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb4e55-b206-44ae-827e-e2b0e906e1a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:35.379489 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb4e55-b206-44ae-827e-e2b0e906e1a6 service cinder] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:35.379801 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb4e55-b206-44ae-827e-e2b0e906e1a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:35.380060 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb4e55-b206-44ae-827e-e2b0e906e1a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:35.435881 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabb4e55-b206-44ae-827e-e2b0e906e1a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:35.437448 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabb4e55-b206-44ae-827e-e2b0e906e1a6 service cinder] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:35.447264 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 918/1832] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:59:35 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:59:42.228217 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcce965-f73a-4c9f-979a-1a1d08440c65 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:42.298852 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcce965-f73a-4c9f-979a-1a1d08440c65 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:42.303766 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e815f2-1101-4a24-9574-42b68b44af44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:42.304697 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e815f2-1101-4a24-9574-42b68b44af44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:42.310727 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e815f2-1101-4a24-9574-42b68b44af44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:42.310727 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e815f2-1101-4a24-9574-42b68b44af44 admin admin] PATH_INFO: `/v3/users/01eeac6dd0d44ac89d566f9098984c78` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:42.310727 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e815f2-1101-4a24-9574-42b68b44af44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01eeac6dd0d44ac89d566f9098984c78)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:42.310727 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e815f2-1101-4a24-9574-42b68b44af44 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:42.374249 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-47e815f2-1101-4a24-9574-42b68b44af44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01eeac6dd0d44ac89d566f9098984c78'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:42.374984 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-47e815f2-1101-4a24-9574-42b68b44af44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01eeac6dd0d44ac89d566f9098984c78'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:42.384516 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-47e815f2-1101-4a24-9574-42b68b44af44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01eeac6dd0d44ac89d566f9098984c78'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:42.393507 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-47e815f2-1101-4a24-9574-42b68b44af44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01eeac6dd0d44ac89d566f9098984c78'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:42.408811 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-47e815f2-1101-4a24-9574-42b68b44af44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01eeac6dd0d44ac89d566f9098984c78'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:42.418664 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 915/1833] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 04:59:42 2021] DELETE /identity/v3/users/01eeac6dd0d44ac89d566f9098984c78 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 04:59:42.421573 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622899d-0a9a-4cbe-92e2-b874df336ae6 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:42.422218 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622899d-0a9a-4cbe-92e2-b874df336ae6 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:42.422218 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622899d-0a9a-4cbe-92e2-b874df336ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:42.439583 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-8622899d-0a9a-4cbe-92e2-b874df336ae6 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:42.440825 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-8622899d-0a9a-4cbe-92e2-b874df336ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:42.513045 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 919/1834] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:42.525302 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e815f2-1101-4a24-9574-42b68b44af44 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:42.526783 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-47e815f2-1101-4a24-9574-42b68b44af44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:42.587339 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e815f2-1101-4a24-9574-42b68b44af44 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:42.592594 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae2000-c884-4d41-b897-3f6ba903be74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:42.593435 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae2000-c884-4d41-b897-3f6ba903be74 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:42.593728 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae2000-c884-4d41-b897-3f6ba903be74 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:42.594079 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae2000-c884-4d41-b897-3f6ba903be74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:42.607060 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ae2000-c884-4d41-b897-3f6ba903be74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:42.608984 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ae2000-c884-4d41-b897-3f6ba903be74 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:42.621557 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 916/1835] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:59:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:59:43.039138 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8622899d-0a9a-4cbe-92e2-b874df336ae6 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:43.040536 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-8622899d-0a9a-4cbe-92e2-b874df336ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:43.056217 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8622899d-0a9a-4cbe-92e2-b874df336ae6 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:43.068214 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da6175a-0b54-4273-8b6d-f828849e1dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:43.072307 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6175a-0b54-4273-8b6d-f828849e1dda admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:43.072819 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6175a-0b54-4273-8b6d-f828849e1dda admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:43.073547 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6175a-0b54-4273-8b6d-f828849e1dda admin admin] PATH_INFO: `/v3/projects/02dd5afff89945a8ae8c718fcbbb18e5` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:43.076245 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da6175a-0b54-4273-8b6d-f828849e1dda admin admin] RBAC: Authorizing `identity:delete_project(project_id=02dd5afff89945a8ae8c718fcbbb18e5)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:43.078250 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da6175a-0b54-4273-8b6d-f828849e1dda admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:43.182519 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-4da6175a-0b54-4273-8b6d-f828849e1dda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02dd5afff89945a8ae8c718fcbbb18e5', 'request_id': 'req-4da6175a-0b54-4273-8b6d-f828849e1dda'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:43.196239 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-4da6175a-0b54-4273-8b6d-f828849e1dda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02dd5afff89945a8ae8c718fcbbb18e5', 'request_id': 'req-4da6175a-0b54-4273-8b6d-f828849e1dda'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:43.205774 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-4da6175a-0b54-4273-8b6d-f828849e1dda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02dd5afff89945a8ae8c718fcbbb18e5', 'request_id': 'req-4da6175a-0b54-4273-8b6d-f828849e1dda'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:43.225881 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-4da6175a-0b54-4273-8b6d-f828849e1dda admin admin] The token cache is being invalidate because project 02dd5afff89945a8ae8c718fcbbb18e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 04:59:43.226148 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-4da6175a-0b54-4273-8b6d-f828849e1dda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:43.226896 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-4da6175a-0b54-4273-8b6d-f828849e1dda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:43.228488 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 920/1836] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 04:59:43 2021] DELETE /identity/v3/projects/02dd5afff89945a8ae8c718fcbbb18e5 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:59:43.233622 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae2000-c884-4d41-b897-3f6ba903be74 service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:43.261171 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae2000-c884-4d41-b897-3f6ba903be74 service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:43.357326 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21e076-d3c1-400b-a41d-0625ca84b7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:43.358381 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21e076-d3c1-400b-a41d-0625ca84b7db admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:43.358664 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21e076-d3c1-400b-a41d-0625ca84b7db admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:43.358919 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21e076-d3c1-400b-a41d-0625ca84b7db admin admin] PATH_INFO: `/v3/users/e9f52beeaa5b4d5288cf655dd33bf231` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:43.360570 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f21e076-d3c1-400b-a41d-0625ca84b7db admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9f52beeaa5b4d5288cf655dd33bf231)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:43.362283 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f21e076-d3c1-400b-a41d-0625ca84b7db admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:43.433807 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-4f21e076-d3c1-400b-a41d-0625ca84b7db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9f52beeaa5b4d5288cf655dd33bf231'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:43.434473 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-4f21e076-d3c1-400b-a41d-0625ca84b7db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9f52beeaa5b4d5288cf655dd33bf231'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:43.443342 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-4f21e076-d3c1-400b-a41d-0625ca84b7db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9f52beeaa5b4d5288cf655dd33bf231'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:43.450543 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-4f21e076-d3c1-400b-a41d-0625ca84b7db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9f52beeaa5b4d5288cf655dd33bf231'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:43.466865 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-4f21e076-d3c1-400b-a41d-0625ca84b7db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9f52beeaa5b4d5288cf655dd33bf231'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:43.474195 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 917/1837] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 04:59:43 2021] DELETE /identity/v3/users/e9f52beeaa5b4d5288cf655dd33bf231 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:59:43.634503 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da6175a-0b54-4273-8b6d-f828849e1dda admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:43.636645 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-4da6175a-0b54-4273-8b6d-f828849e1dda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:43.656297 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da6175a-0b54-4273-8b6d-f828849e1dda admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:43.726818 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c125f2db-5ca9-4411-a935-34564f3e9596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:43.727699 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125f2db-5ca9-4411-a935-34564f3e9596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:43.727977 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125f2db-5ca9-4411-a935-34564f3e9596 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:43.728244 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125f2db-5ca9-4411-a935-34564f3e9596 admin admin] PATH_INFO: `/v3/users/6d18b372ede14291a2383cb3067c7ca4` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:43.729492 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c125f2db-5ca9-4411-a935-34564f3e9596 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d18b372ede14291a2383cb3067c7ca4)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:43.731515 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c125f2db-5ca9-4411-a935-34564f3e9596 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:43.776395 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21e076-d3c1-400b-a41d-0625ca84b7db admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:43.778260 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-4f21e076-d3c1-400b-a41d-0625ca84b7db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:43.798898 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21e076-d3c1-400b-a41d-0625ca84b7db admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:43.818218 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad26c0-702c-4b14-944d-dc22427487aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:43.819271 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad26c0-702c-4b14-944d-dc22427487aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:43.819813 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad26c0-702c-4b14-944d-dc22427487aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:43.820375 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad26c0-702c-4b14-944d-dc22427487aa admin admin] PATH_INFO: `/v3/projects/d13b030d8dcf4f56a602d519618ba88d` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:43.821231 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-c125f2db-5ca9-4411-a935-34564f3e9596 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d18b372ede14291a2383cb3067c7ca4'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:43.821996 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-c125f2db-5ca9-4411-a935-34564f3e9596 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d18b372ede14291a2383cb3067c7ca4'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:43.824189 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cad26c0-702c-4b14-944d-dc22427487aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=d13b030d8dcf4f56a602d519618ba88d)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:43.826639 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cad26c0-702c-4b14-944d-dc22427487aa admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:43.830255 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-c125f2db-5ca9-4411-a935-34564f3e9596 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d18b372ede14291a2383cb3067c7ca4'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:43.842866 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-c125f2db-5ca9-4411-a935-34564f3e9596 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d18b372ede14291a2383cb3067c7ca4'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:43.843152 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-c125f2db-5ca9-4411-a935-34564f3e9596 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d18b372ede14291a2383cb3067c7ca4'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:43.895416 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 921/1838] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 04:59:43 2021] DELETE /identity/v3/users/6d18b372ede14291a2383cb3067c7ca4 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:59:43.900943 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875bc45-c137-491c-9962-7207e89b30a9 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:43.901226 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875bc45-c137-491c-9962-7207e89b30a9 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:43.901498 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875bc45-c137-491c-9962-7207e89b30a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:43.906171 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-5cad26c0-702c-4b14-944d-dc22427487aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd13b030d8dcf4f56a602d519618ba88d', 'request_id': 'req-5cad26c0-702c-4b14-944d-dc22427487aa'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:43.919336 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-5cad26c0-702c-4b14-944d-dc22427487aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd13b030d8dcf4f56a602d519618ba88d', 'request_id': 'req-5cad26c0-702c-4b14-944d-dc22427487aa'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:43.925727 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-5875bc45-c137-491c-9962-7207e89b30a9 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:43.926545 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-5875bc45-c137-491c-9962-7207e89b30a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:43.927261 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-5cad26c0-702c-4b14-944d-dc22427487aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd13b030d8dcf4f56a602d519618ba88d', 'request_id': 'req-5cad26c0-702c-4b14-944d-dc22427487aa'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:43.943237 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-5cad26c0-702c-4b14-944d-dc22427487aa admin admin] The token cache is being invalidate because project d13b030d8dcf4f56a602d519618ba88d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 04:59:43.943524 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-5cad26c0-702c-4b14-944d-dc22427487aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:43.946642 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-5cad26c0-702c-4b14-944d-dc22427487aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:43.949693 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 918/1839] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 04:59:43 2021] DELETE /identity/v3/projects/d13b030d8dcf4f56a602d519618ba88d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:59:43.955965 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79cea85-1822-4da0-ab65-68eb9061d4ff None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:43.956898 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79cea85-1822-4da0-ab65-68eb9061d4ff None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:43.957380 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79cea85-1822-4da0-ab65-68eb9061d4ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:43.980802 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-b79cea85-1822-4da0-ab65-68eb9061d4ff None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:43.982569 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-b79cea85-1822-4da0-ab65-68eb9061d4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:44.017910 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 922/1840] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:44.051513 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875bc45-c137-491c-9962-7207e89b30a9 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:44.057000 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-5875bc45-c137-491c-9962-7207e89b30a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:44.080482 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 919/1841] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:44.089295 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3764500-9b10-4c2c-a972-e45e6c58e8d6 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:44.089586 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3764500-9b10-4c2c-a972-e45e6c58e8d6 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:44.089866 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3764500-9b10-4c2c-a972-e45e6c58e8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:44.112500 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-e3764500-9b10-4c2c-a972-e45e6c58e8d6 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:44.114127 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-e3764500-9b10-4c2c-a972-e45e6c58e8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:44.127559 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 920/1842] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 04:59:44.128606 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3764500-9b10-4c2c-a972-e45e6c58e8d6 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:44.141553 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3764500-9b10-4c2c-a972-e45e6c58e8d6 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:44.141771 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875bc45-c137-491c-9962-7207e89b30a9 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:44.146530 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ecdc9-8dbf-45a3-a79a-c64d72c5bac1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:44.147184 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ecdc9-8dbf-45a3-a79a-c64d72c5bac1 service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:44.147461 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ecdc9-8dbf-45a3-a79a-c64d72c5bac1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:44.147731 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ecdc9-8dbf-45a3-a79a-c64d72c5bac1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:44.149430 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7a742-f93c-48f4-900d-f274ec46e999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:44.150328 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7a742-f93c-48f4-900d-f274ec46e999 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:44.150605 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7a742-f93c-48f4-900d-f274ec46e999 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:44.151197 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7a742-f93c-48f4-900d-f274ec46e999 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:44.151769 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc7a742-f93c-48f4-900d-f274ec46e999 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:59:44.152078 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc7a742-f93c-48f4-900d-f274ec46e999 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:44.155081 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc7a742-f93c-48f4-900d-f274ec46e999 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:44.163401 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ecdc9-8dbf-45a3-a79a-c64d72c5bac1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:44.166348 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ecdc9-8dbf-45a3-a79a-c64d72c5bac1 service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:44.168560 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 921/1843] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 04:59:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:59:44.173872 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7a742-f93c-48f4-900d-f274ec46e999 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:44.183534 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 923/1844] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:59:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 24 04:59:44.186557 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7a742-f93c-48f4-900d-f274ec46e999 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:44.193170 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074c757-dc9a-4aa1-b997-9d19623b87a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:44.194026 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074c757-dc9a-4aa1-b997-9d19623b87a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:44.194370 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074c757-dc9a-4aa1-b997-9d19623b87a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:44.194732 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074c757-dc9a-4aa1-b997-9d19623b87a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:44.195552 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6074c757-dc9a-4aa1-b997-9d19623b87a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:44.198884 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6074c757-dc9a-4aa1-b997-9d19623b87a7 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:44.241840 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 922/1845] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 04:59:44 2021] POST /identity/v3/projects => generated 371 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:59:44.245532 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ecdc9-8dbf-45a3-a79a-c64d72c5bac1 service neutron] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:44.256625 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ecdc9-8dbf-45a3-a79a-c64d72c5bac1 service neutron] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:44.354234 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df805c0e-571c-4094-a264-4ffcb0fa68b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:44.356269 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df805c0e-571c-4094-a264-4ffcb0fa68b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:44.357210 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df805c0e-571c-4094-a264-4ffcb0fa68b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:44.357625 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df805c0e-571c-4094-a264-4ffcb0fa68b5 admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:44.359707 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df805c0e-571c-4094-a264-4ffcb0fa68b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:44.363486 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df805c0e-571c-4094-a264-4ffcb0fa68b5 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:44.407814 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 924/1846] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 04:59:44 2021] POST /identity/v3/users => generated 286 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:59:44.412046 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074c757-dc9a-4aa1-b997-9d19623b87a7 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:44.433617 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074c757-dc9a-4aa1-b997-9d19623b87a7 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:44.445763 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1504f7-1856-4abf-91bf-eaae77c1f0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:44.447045 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1504f7-1856-4abf-91bf-eaae77c1f0ad admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:44.447452 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1504f7-1856-4abf-91bf-eaae77c1f0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:44.447890 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1504f7-1856-4abf-91bf-eaae77c1f0ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:44.449205 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1504f7-1856-4abf-91bf-eaae77c1f0ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:44.451986 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1504f7-1856-4abf-91bf-eaae77c1f0ad admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:44.461218 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df805c0e-571c-4094-a264-4ffcb0fa68b5 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:44.465049 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-df805c0e-571c-4094-a264-4ffcb0fa68b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:44.482143 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 923/1847] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 04:59:44 2021] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 04:59:44.485840 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df805c0e-571c-4094-a264-4ffcb0fa68b5 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:44.489479 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1504f7-1856-4abf-91bf-eaae77c1f0ad admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:44.495259 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f81ec-21e7-4495-a6d5-29974379d71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:44.497195 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f81ec-21e7-4495-a6d5-29974379d71b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:44.497559 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f81ec-21e7-4495-a6d5-29974379d71b admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:44.497904 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f81ec-21e7-4495-a6d5-29974379d71b admin admin] PATH_INFO: `/v3/users/f3277bcaee614d5090ba4804fc8b33b1` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:44.501404 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f81ec-21e7-4495-a6d5-29974379d71b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3277bcaee614d5090ba4804fc8b33b1)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:44.504277 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1504f7-1856-4abf-91bf-eaae77c1f0ad admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:44.511994 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7f34d-5168-4bfd-b2d0-0ff501d98495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:44.512708 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7f34d-5168-4bfd-b2d0-0ff501d98495 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:44.513081 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7f34d-5168-4bfd-b2d0-0ff501d98495 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:44.513657 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7f34d-5168-4bfd-b2d0-0ff501d98495 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:44.513813 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f81ec-21e7-4495-a6d5-29974379d71b admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:44.514321 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de7f34d-5168-4bfd-b2d0-0ff501d98495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:44.518550 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de7f34d-5168-4bfd-b2d0-0ff501d98495 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:44.534592 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 924/1848] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 04:59:44 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 04:59:44.539234 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7f34d-5168-4bfd-b2d0-0ff501d98495 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:44.552926 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7f34d-5168-4bfd-b2d0-0ff501d98495 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:44.560392 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf52bf1-a425-4342-8feb-ac751a260948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:44.562141 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf52bf1-a425-4342-8feb-ac751a260948 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:44.562430 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf52bf1-a425-4342-8feb-ac751a260948 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:44.562765 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf52bf1-a425-4342-8feb-ac751a260948 admin admin] PATH_INFO: `/v3/projects/1e014b3683d841968563e0aa0705e862/users/fbefbd7e98c94b7598f4af35532d60cb/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:44.598128 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf52bf1-a425-4342-8feb-ac751a260948 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e014b3683d841968563e0aa0705e862, user_id=fbefbd7e98c94b7598f4af35532d60cb, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:44.598296 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-1d0f81ec-21e7-4495-a6d5-29974379d71b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3277bcaee614d5090ba4804fc8b33b1'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:44.598874 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-1d0f81ec-21e7-4495-a6d5-29974379d71b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3277bcaee614d5090ba4804fc8b33b1'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:44.607557 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf52bf1-a425-4342-8feb-ac751a260948 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:44.608543 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-1d0f81ec-21e7-4495-a6d5-29974379d71b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3277bcaee614d5090ba4804fc8b33b1'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:44.619707 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-1d0f81ec-21e7-4495-a6d5-29974379d71b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3277bcaee614d5090ba4804fc8b33b1'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:44.620933 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-1d0f81ec-21e7-4495-a6d5-29974379d71b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3277bcaee614d5090ba4804fc8b33b1'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:44.641094 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 925/1849] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 04:59:44 2021] PUT /identity/v3/projects/1e014b3683d841968563e0aa0705e862/users/fbefbd7e98c94b7598f4af35532d60cb/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:59:44.649195 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b54666-1cdc-4a1c-b241-9250fd6045c0 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:44.649534 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b54666-1cdc-4a1c-b241-9250fd6045c0 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:44.649862 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b54666-1cdc-4a1c-b241-9250fd6045c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:44.695534 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-33b54666-1cdc-4a1c-b241-9250fd6045c0 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:44.697068 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-33b54666-1cdc-4a1c-b241-9250fd6045c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:44.705676 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 925/1850] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 04:59:44 2021] DELETE /identity/v3/users/f3277bcaee614d5090ba4804fc8b33b1 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:59:44.709030 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13615182-ad71-4dc3-a64c-05b40fa1e9a4 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:44.709273 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13615182-ad71-4dc3-a64c-05b40fa1e9a4 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:44.711496 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13615182-ad71-4dc3-a64c-05b40fa1e9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:44.756079 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-13615182-ad71-4dc3-a64c-05b40fa1e9a4 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:44.757444 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-13615182-ad71-4dc3-a64c-05b40fa1e9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:44.795462 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 926/1851] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:44.807701 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b54666-1cdc-4a1c-b241-9250fd6045c0 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:44.809980 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-33b54666-1cdc-4a1c-b241-9250fd6045c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:44.862386 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 926/1852] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 04:59:44.870524 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13615182-ad71-4dc3-a64c-05b40fa1e9a4 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:44.873541 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-13615182-ad71-4dc3-a64c-05b40fa1e9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:44.900814 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b54666-1cdc-4a1c-b241-9250fd6045c0 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:44.905988 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52914f8-77c1-4eee-a039-1c988eb6a03d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:44.906701 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52914f8-77c1-4eee-a039-1c988eb6a03d service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:44.907314 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52914f8-77c1-4eee-a039-1c988eb6a03d service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:44.908175 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52914f8-77c1-4eee-a039-1c988eb6a03d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:44.919835 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52914f8-77c1-4eee-a039-1c988eb6a03d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:44.921428 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52914f8-77c1-4eee-a039-1c988eb6a03d service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:44.933569 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 927/1853] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:59:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 24 04:59:44.965937 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13615182-ad71-4dc3-a64c-05b40fa1e9a4 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:44.971693 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0af9b-5460-4728-b82d-28f2e6bd2e11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:44.972736 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0af9b-5460-4728-b82d-28f2e6bd2e11 service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:44.973099 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0af9b-5460-4728-b82d-28f2e6bd2e11 service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:44.973522 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0af9b-5460-4728-b82d-28f2e6bd2e11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:44.989469 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa0af9b-5460-4728-b82d-28f2e6bd2e11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:44.991310 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa0af9b-5460-4728-b82d-28f2e6bd2e11 service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:45.003770 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 927/1854] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:59:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:59:45.742258 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52914f8-77c1-4eee-a039-1c988eb6a03d service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:45.744563 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-b52914f8-77c1-4eee-a039-1c988eb6a03d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:45.769114 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52914f8-77c1-4eee-a039-1c988eb6a03d service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:45.781873 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331bda5d-69c8-481a-936f-e6207fc8223e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:45.784158 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331bda5d-69c8-481a-936f-e6207fc8223e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:45.784710 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331bda5d-69c8-481a-936f-e6207fc8223e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:45.786515 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331bda5d-69c8-481a-936f-e6207fc8223e admin admin] PATH_INFO: `/v3/projects/1902a6ad87414fb187bc9daafee87d64` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:45.789203 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331bda5d-69c8-481a-936f-e6207fc8223e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1902a6ad87414fb187bc9daafee87d64)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:45.795763 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331bda5d-69c8-481a-936f-e6207fc8223e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:45.862100 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0af9b-5460-4728-b82d-28f2e6bd2e11 service neutron] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:45.865391 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-daa0af9b-5460-4728-b82d-28f2e6bd2e11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:45.886342 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0af9b-5460-4728-b82d-28f2e6bd2e11 service neutron] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:45.893996 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-331bda5d-69c8-481a-936f-e6207fc8223e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1902a6ad87414fb187bc9daafee87d64', 'request_id': 'req-331bda5d-69c8-481a-936f-e6207fc8223e'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:45.908895 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-331bda5d-69c8-481a-936f-e6207fc8223e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1902a6ad87414fb187bc9daafee87d64', 'request_id': 'req-331bda5d-69c8-481a-936f-e6207fc8223e'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:45.919757 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-331bda5d-69c8-481a-936f-e6207fc8223e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1902a6ad87414fb187bc9daafee87d64', 'request_id': 'req-331bda5d-69c8-481a-936f-e6207fc8223e'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:45.935418 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-331bda5d-69c8-481a-936f-e6207fc8223e admin admin] The token cache is being invalidate because project 1902a6ad87414fb187bc9daafee87d64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 04:59:45.937421 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-331bda5d-69c8-481a-936f-e6207fc8223e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:45.942370 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-331bda5d-69c8-481a-936f-e6207fc8223e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:45.947426 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 928/1855] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 04:59:45 2021] DELETE /identity/v3/projects/1902a6ad87414fb187bc9daafee87d64 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:59:45.950028 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331bda5d-69c8-481a-936f-e6207fc8223e admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:45.954181 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-331bda5d-69c8-481a-936f-e6207fc8223e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:46.036970 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7195926-dbd0-4b6f-911d-a4eeab84a6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:46.040977 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7195926-dbd0-4b6f-911d-a4eeab84a6d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:46.041478 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7195926-dbd0-4b6f-911d-a4eeab84a6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:46.041964 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7195926-dbd0-4b6f-911d-a4eeab84a6d0 admin admin] PATH_INFO: `/v3/projects/f65fb81402bc4237ae5f45bfe0915c73` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:46.043577 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7195926-dbd0-4b6f-911d-a4eeab84a6d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f65fb81402bc4237ae5f45bfe0915c73)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:46.046407 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7195926-dbd0-4b6f-911d-a4eeab84a6d0 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:46.122725 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-c7195926-dbd0-4b6f-911d-a4eeab84a6d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f65fb81402bc4237ae5f45bfe0915c73', 'request_id': 'req-c7195926-dbd0-4b6f-911d-a4eeab84a6d0'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:46.135083 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-c7195926-dbd0-4b6f-911d-a4eeab84a6d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f65fb81402bc4237ae5f45bfe0915c73', 'request_id': 'req-c7195926-dbd0-4b6f-911d-a4eeab84a6d0'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:46.144510 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-c7195926-dbd0-4b6f-911d-a4eeab84a6d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f65fb81402bc4237ae5f45bfe0915c73', 'request_id': 'req-c7195926-dbd0-4b6f-911d-a4eeab84a6d0'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:46.159527 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-c7195926-dbd0-4b6f-911d-a4eeab84a6d0 admin admin] The token cache is being invalidate because project f65fb81402bc4237ae5f45bfe0915c73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 04:59:46.159827 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-c7195926-dbd0-4b6f-911d-a4eeab84a6d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:46.160562 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-c7195926-dbd0-4b6f-911d-a4eeab84a6d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:46.163277 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 928/1856] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 04:59:45 2021] DELETE /identity/v3/projects/f65fb81402bc4237ae5f45bfe0915c73 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 04:59:46.166654 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331bda5d-69c8-481a-936f-e6207fc8223e admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:46.169774 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078f13c-f5c3-408e-a51c-2cca6e9fa92b None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:46.170070 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078f13c-f5c3-408e-a51c-2cca6e9fa92b None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:46.170347 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078f13c-f5c3-408e-a51c-2cca6e9fa92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:46.211344 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-7078f13c-f5c3-408e-a51c-2cca6e9fa92b None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:46.212946 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-7078f13c-f5c3-408e-a51c-2cca6e9fa92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:46.275759 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9918531-6e5f-45ed-93ad-8d116cd2fd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:46.277390 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9918531-6e5f-45ed-93ad-8d116cd2fd16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:46.277803 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9918531-6e5f-45ed-93ad-8d116cd2fd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:46.278183 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9918531-6e5f-45ed-93ad-8d116cd2fd16 admin admin] PATH_INFO: `/v3/users/796be842fd7c4d7097237300ef5efb49` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:46.279596 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9918531-6e5f-45ed-93ad-8d116cd2fd16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=796be842fd7c4d7097237300ef5efb49)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:46.282441 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9918531-6e5f-45ed-93ad-8d116cd2fd16 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:46.298376 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 929/1857] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:46.300412 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9855e-8e67-48ab-b141-b24c7f30ea9f None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:46.300784 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9855e-8e67-48ab-b141-b24c7f30ea9f None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:46.301059 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9855e-8e67-48ab-b141-b24c7f30ea9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:46.331792 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-1bd9855e-8e67-48ab-b141-b24c7f30ea9f None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:46.333098 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-1bd9855e-8e67-48ab-b141-b24c7f30ea9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:46.346049 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 930/1858] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:46.347043 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9855e-8e67-48ab-b141-b24c7f30ea9f None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:46.357941 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9855e-8e67-48ab-b141-b24c7f30ea9f None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:46.363510 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3889147e-b5d8-4953-b2b1-c544a883a9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:46.364340 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3889147e-b5d8-4953-b2b1-c544a883a9a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:46.364660 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3889147e-b5d8-4953-b2b1-c544a883a9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:46.364990 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3889147e-b5d8-4953-b2b1-c544a883a9a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:46.365756 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3889147e-b5d8-4953-b2b1-c544a883a9a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:59:46.366065 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3889147e-b5d8-4953-b2b1-c544a883a9a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:46.367863 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3889147e-b5d8-4953-b2b1-c544a883a9a7 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:46.368061 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-f9918531-6e5f-45ed-93ad-8d116cd2fd16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '796be842fd7c4d7097237300ef5efb49'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:46.368898 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-f9918531-6e5f-45ed-93ad-8d116cd2fd16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '796be842fd7c4d7097237300ef5efb49'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:46.380779 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-f9918531-6e5f-45ed-93ad-8d116cd2fd16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '796be842fd7c4d7097237300ef5efb49'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:46.380940 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 931/1859] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 04:59:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:59:46.386234 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3889147e-b5d8-4953-b2b1-c544a883a9a7 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:46.391051 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-3889147e-b5d8-4953-b2b1-c544a883a9a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:46.393092 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-f9918531-6e5f-45ed-93ad-8d116cd2fd16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '796be842fd7c4d7097237300ef5efb49'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:46.409212 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3889147e-b5d8-4953-b2b1-c544a883a9a7 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:46.415625 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc73fc6-b19b-45d6-8bde-2ba7999320c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:46.416356 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc73fc6-b19b-45d6-8bde-2ba7999320c2 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:46.416695 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc73fc6-b19b-45d6-8bde-2ba7999320c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:46.416975 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc73fc6-b19b-45d6-8bde-2ba7999320c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:46.417697 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc73fc6-b19b-45d6-8bde-2ba7999320c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:46.420577 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc73fc6-b19b-45d6-8bde-2ba7999320c2 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:46.425757 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-f9918531-6e5f-45ed-93ad-8d116cd2fd16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '796be842fd7c4d7097237300ef5efb49'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:46.435610 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 929/1860] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 04:59:45 2021] DELETE /identity/v3/users/796be842fd7c4d7097237300ef5efb49 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:59:46.460051 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 932/1861] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 04:59:46 2021] POST /identity/v3/projects => generated 355 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:59:46.463854 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9918531-6e5f-45ed-93ad-8d116cd2fd16 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:46.549559 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9918531-6e5f-45ed-93ad-8d116cd2fd16 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:46.626478 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28bdef0-6348-42f3-804b-0410112d9791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:46.627108 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28bdef0-6348-42f3-804b-0410112d9791 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:46.627328 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28bdef0-6348-42f3-804b-0410112d9791 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:46.627815 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28bdef0-6348-42f3-804b-0410112d9791 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:46.628519 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28bdef0-6348-42f3-804b-0410112d9791 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:46.630762 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28bdef0-6348-42f3-804b-0410112d9791 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:46.668430 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 930/1862] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 04:59:46 2021] POST /identity/v3/users => generated 278 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 04:59:46.672111 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc73fc6-b19b-45d6-8bde-2ba7999320c2 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:46.685507 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc73fc6-b19b-45d6-8bde-2ba7999320c2 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:46.692377 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db0e011-d75a-4e04-b2f7-05c0c7b36cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:46.693506 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0e011-d75a-4e04-b2f7-05c0c7b36cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:46.693971 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0e011-d75a-4e04-b2f7-05c0c7b36cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:46.694568 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0e011-d75a-4e04-b2f7-05c0c7b36cd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:46.695590 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db0e011-d75a-4e04-b2f7-05c0c7b36cd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:46.697710 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db0e011-d75a-4e04-b2f7-05c0c7b36cd8 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:46.722757 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28bdef0-6348-42f3-804b-0410112d9791 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:46.722894 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 933/1863] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 04:59:46 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 24 04:59:46.742090 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28bdef0-6348-42f3-804b-0410112d9791 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:46.752869 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4596fa9-3b80-4d2f-93a2-e9b9f2ce4263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:46.753713 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4596fa9-3b80-4d2f-93a2-e9b9f2ce4263 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:46.754075 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4596fa9-3b80-4d2f-93a2-e9b9f2ce4263 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:46.754424 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4596fa9-3b80-4d2f-93a2-e9b9f2ce4263 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:46.756650 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4596fa9-3b80-4d2f-93a2-e9b9f2ce4263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:46.758729 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4596fa9-3b80-4d2f-93a2-e9b9f2ce4263 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:46.772100 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 931/1864] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 04:59:46 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 24 04:59:46.776017 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db0e011-d75a-4e04-b2f7-05c0c7b36cd8 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:46.788321 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db0e011-d75a-4e04-b2f7-05c0c7b36cd8 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:46.795516 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d3a67b-65e1-41f2-883b-3b9a26d19c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:46.796435 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d3a67b-65e1-41f2-883b-3b9a26d19c6b admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:46.796756 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d3a67b-65e1-41f2-883b-3b9a26d19c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:46.797237 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d3a67b-65e1-41f2-883b-3b9a26d19c6b admin admin] PATH_INFO: `/v3/projects/8cea02e840af439e88cfe9464b0d69ac/users/ffe6e7618d044a419d66a4a6d3f46c44/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:46.825024 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d3a67b-65e1-41f2-883b-3b9a26d19c6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cea02e840af439e88cfe9464b0d69ac, user_id=ffe6e7618d044a419d66a4a6d3f46c44, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:46.830824 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d3a67b-65e1-41f2-883b-3b9a26d19c6b admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:46.850937 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 934/1865] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 04:59:46 2021] PUT /identity/v3/projects/8cea02e840af439e88cfe9464b0d69ac/users/ffe6e7618d044a419d66a4a6d3f46c44/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:59:46.861216 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0fa0cd-3f1c-4c26-88cc-848bb0adc0db None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:46.861783 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0fa0cd-3f1c-4c26-88cc-848bb0adc0db None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:46.862256 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0fa0cd-3f1c-4c26-88cc-848bb0adc0db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:46.879594 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d3a67b-65e1-41f2-883b-3b9a26d19c6b admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:46.880962 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-f8d3a67b-65e1-41f2-883b-3b9a26d19c6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:46.901296 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-ea0fa0cd-3f1c-4c26-88cc-848bb0adc0db None None] MFA Rules not processed for user `ffe6e7618d044a419d66a4a6d3f46c44`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:46.902778 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-ea0fa0cd-3f1c-4c26-88cc-848bb0adc0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:46.976744 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d3a67b-65e1-41f2-883b-3b9a26d19c6b admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:46.982699 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ebe95-2f40-471e-9fb1-e982a7b4bdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:46.983689 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ebe95-2f40-471e-9fb1-e982a7b4bdca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:46.984031 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ebe95-2f40-471e-9fb1-e982a7b4bdca admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:46.984918 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ebe95-2f40-471e-9fb1-e982a7b4bdca admin admin] PATH_INFO: `/v3/projects/397e8dfbbe584e879a829c8e8acb2b86` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:46.986932 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959ebe95-2f40-471e-9fb1-e982a7b4bdca admin admin] RBAC: Authorizing `identity:delete_project(project_id=397e8dfbbe584e879a829c8e8acb2b86)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:46.989553 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959ebe95-2f40-471e-9fb1-e982a7b4bdca admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:47.014932 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 932/1866] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:46 2021] POST /identity/v3/auth/tokens => generated 3222 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 04:59:47.019781 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0fa0cd-3f1c-4c26-88cc-848bb0adc0db None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:47.034983 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0fa0cd-3f1c-4c26-88cc-848bb0adc0db None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:47.041948 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9387fa-ed37-47ca-b800-b9bc14bf9a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:47.043032 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9387fa-ed37-47ca-b800-b9bc14bf9a35 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:47.043612 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9387fa-ed37-47ca-b800-b9bc14bf9a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:47.044074 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9387fa-ed37-47ca-b800-b9bc14bf9a35 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:47.045212 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9387fa-ed37-47ca-b800-b9bc14bf9a35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:47.047783 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9387fa-ed37-47ca-b800-b9bc14bf9a35 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:47.094745 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 933/1867] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 04:59:47 2021] POST /identity/v3/projects => generated 355 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:59:47.099592 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9387fa-ed37-47ca-b800-b9bc14bf9a35 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:47.183008 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-959ebe95-2f40-471e-9fb1-e982a7b4bdca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '397e8dfbbe584e879a829c8e8acb2b86', 'request_id': 'req-959ebe95-2f40-471e-9fb1-e982a7b4bdca'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:47.195356 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-959ebe95-2f40-471e-9fb1-e982a7b4bdca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '397e8dfbbe584e879a829c8e8acb2b86', 'request_id': 'req-959ebe95-2f40-471e-9fb1-e982a7b4bdca'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:47.211641 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-959ebe95-2f40-471e-9fb1-e982a7b4bdca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '397e8dfbbe584e879a829c8e8acb2b86', 'request_id': 'req-959ebe95-2f40-471e-9fb1-e982a7b4bdca'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:47.234149 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9387fa-ed37-47ca-b800-b9bc14bf9a35 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:47.237248 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-959ebe95-2f40-471e-9fb1-e982a7b4bdca admin admin] The token cache is being invalidate because project 397e8dfbbe584e879a829c8e8acb2b86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 04:59:47.237613 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-959ebe95-2f40-471e-9fb1-e982a7b4bdca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:47.238633 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-959ebe95-2f40-471e-9fb1-e982a7b4bdca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:47.241221 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 935/1868] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 04:59:46 2021] DELETE /identity/v3/projects/397e8dfbbe584e879a829c8e8acb2b86 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 04:59:47.250640 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e5bb8-5a68-48fb-b31d-72052c6f179b None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:47.250940 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e5bb8-5a68-48fb-b31d-72052c6f179b None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:47.251311 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e5bb8-5a68-48fb-b31d-72052c6f179b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:47.292780 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-e78e5bb8-5a68-48fb-b31d-72052c6f179b None None] MFA Rules not processed for user `fbefbd7e98c94b7598f4af35532d60cb`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:47.294235 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-e78e5bb8-5a68-48fb-b31d-72052c6f179b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:47.372740 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e17f722-d4a3-4b1e-bba3-c522d7fd24a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:47.373814 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17f722-d4a3-4b1e-bba3-c522d7fd24a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:47.374102 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17f722-d4a3-4b1e-bba3-c522d7fd24a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:47.374578 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17f722-d4a3-4b1e-bba3-c522d7fd24a0 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:47.375378 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e17f722-d4a3-4b1e-bba3-c522d7fd24a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:47.377505 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e17f722-d4a3-4b1e-bba3-c522d7fd24a0 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:47.437118 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 934/1869] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 04:59:47 2021] POST /identity/v3/users => generated 284 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 04:59:47.437118 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e984cb-c6ca-46d4-aa09-a0b2a33d5498 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:47.437118 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e984cb-c6ca-46d4-aa09-a0b2a33d5498 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:47.437118 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e984cb-c6ca-46d4-aa09-a0b2a33d5498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:47.438194 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 936/1870] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:47 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:47.439612 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e5bb8-5a68-48fb-b31d-72052c6f179b None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:47.441357 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-e78e5bb8-5a68-48fb-b31d-72052c6f179b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:47.471784 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e5bb8-5a68-48fb-b31d-72052c6f179b None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:47.482126 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1290eb7-89f4-4c12-96e1-b2fc83c227ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:47.482834 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1290eb7-89f4-4c12-96e1-b2fc83c227ac admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:47.483147 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1290eb7-89f4-4c12-96e1-b2fc83c227ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:47.483425 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1290eb7-89f4-4c12-96e1-b2fc83c227ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:47.484162 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-e8e984cb-c6ca-46d4-aa09-a0b2a33d5498 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:47.484307 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1290eb7-89f4-4c12-96e1-b2fc83c227ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:47.486043 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1290eb7-89f4-4c12-96e1-b2fc83c227ac admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:47.489073 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-e8e984cb-c6ca-46d4-aa09-a0b2a33d5498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:47.505739 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 937/1871] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 04:59:47 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 04:59:47.506815 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1290eb7-89f4-4c12-96e1-b2fc83c227ac admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:47.515962 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-b1290eb7-89f4-4c12-96e1-b2fc83c227ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:47.517060 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 935/1872] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:47.518103 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e984cb-c6ca-46d4-aa09-a0b2a33d5498 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:47.537560 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e984cb-c6ca-46d4-aa09-a0b2a33d5498 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:47.546643 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8bfae-5579-47b0-81c6-b52e59599e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:47.550654 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8bfae-5579-47b0-81c6-b52e59599e94 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:47.551520 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8bfae-5579-47b0-81c6-b52e59599e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:47.553366 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8bfae-5579-47b0-81c6-b52e59599e94 admin admin] PATH_INFO: `/v3/projects/78b83fe1d31b4c218c15989d48d506c8/users/0a8a19cdfbd24a89b030be5b85c68f53/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:47.583944 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd8bfae-5579-47b0-81c6-b52e59599e94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78b83fe1d31b4c218c15989d48d506c8, user_id=0a8a19cdfbd24a89b030be5b85c68f53, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:47.589906 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd8bfae-5579-47b0-81c6-b52e59599e94 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:47.614370 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 936/1873] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 04:59:47 2021] PUT /identity/v3/projects/78b83fe1d31b4c218c15989d48d506c8/users/0a8a19cdfbd24a89b030be5b85c68f53/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:59:47.615324 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1290eb7-89f4-4c12-96e1-b2fc83c227ac admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:47.618346 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8eba27-0f27-4047-bd67-3573bba415a8 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:47.619224 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8eba27-0f27-4047-bd67-3573bba415a8 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:47.619949 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8eba27-0f27-4047-bd67-3573bba415a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:47.652169 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-0e8eba27-0f27-4047-bd67-3573bba415a8 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:47.654652 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-0e8eba27-0f27-4047-bd67-3573bba415a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:47.695259 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638715b6-7f8a-4649-a28b-69f58940b29d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:47.696133 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638715b6-7f8a-4649-a28b-69f58940b29d service cinder] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:47.696413 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638715b6-7f8a-4649-a28b-69f58940b29d service cinder] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:47.697257 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638715b6-7f8a-4649-a28b-69f58940b29d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:47.772290 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 937/1874] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:47.773456 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8eba27-0f27-4047-bd67-3573bba415a8 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:47.788046 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8eba27-0f27-4047-bd67-3573bba415a8 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:47.809703 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638715b6-7f8a-4649-a28b-69f58940b29d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:47.809913 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6aaee-7571-4911-a22a-901731a2f51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:47.810496 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6aaee-7571-4911-a22a-901731a2f51f admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:47.810795 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6aaee-7571-4911-a22a-901731a2f51f admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:47.811065 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6aaee-7571-4911-a22a-901731a2f51f admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:47.811226 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638715b6-7f8a-4649-a28b-69f58940b29d service cinder] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:47.812451 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca6aaee-7571-4911-a22a-901731a2f51f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:47.814351 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca6aaee-7571-4911-a22a-901731a2f51f admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:47.828228 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 938/1875] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 04:59:47 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 04:59:47.829336 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6aaee-7571-4911-a22a-901731a2f51f admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:47.832341 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 938/1876] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:59:47 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:59:47.833918 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638715b6-7f8a-4649-a28b-69f58940b29d service cinder] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:47.858227 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638715b6-7f8a-4649-a28b-69f58940b29d service cinder] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:47.868711 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6aaee-7571-4911-a22a-901731a2f51f admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:47.882938 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a723129-dc7e-4d8d-ad4d-e36a72afb198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:47.883913 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a723129-dc7e-4d8d-ad4d-e36a72afb198 admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:47.884075 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a723129-dc7e-4d8d-ad4d-e36a72afb198 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:47.884308 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a723129-dc7e-4d8d-ad4d-e36a72afb198 admin admin] PATH_INFO: `/v3/projects/78b83fe1d31b4c218c15989d48d506c8/users/0a8a19cdfbd24a89b030be5b85c68f53/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:47.886612 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a723129-dc7e-4d8d-ad4d-e36a72afb198 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78b83fe1d31b4c218c15989d48d506c8, user_id=0a8a19cdfbd24a89b030be5b85c68f53, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:47.889429 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a723129-dc7e-4d8d-ad4d-e36a72afb198 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:47.900658 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a582a-d3bf-4f2a-aa8b-ecb68cfcc683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:47.901343 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a582a-d3bf-4f2a-aa8b-ecb68cfcc683 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:47.901678 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a582a-d3bf-4f2a-aa8b-ecb68cfcc683 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:47.901955 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a582a-d3bf-4f2a-aa8b-ecb68cfcc683 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:47.902706 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a582a-d3bf-4f2a-aa8b-ecb68cfcc683 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:59:47.906652 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a582a-d3bf-4f2a-aa8b-ecb68cfcc683 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:47.910559 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a582a-d3bf-4f2a-aa8b-ecb68cfcc683 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:47.928568 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 939/1877] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 04:59:47 2021] PUT /identity/v3/projects/78b83fe1d31b4c218c15989d48d506c8/users/0a8a19cdfbd24a89b030be5b85c68f53/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:59:47.935557 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a1a1b-9a79-4edd-8f4d-53e91c4f1dbe None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:47.935881 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a1a1b-9a79-4edd-8f4d-53e91c4f1dbe None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:47.936113 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a1a1b-9a79-4edd-8f4d-53e91c4f1dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:47.950629 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 939/1878] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 04:59:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:59:47.957003 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a582a-d3bf-4f2a-aa8b-ecb68cfcc683 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:47.974533 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a582a-d3bf-4f2a-aa8b-ecb68cfcc683 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:47.977751 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-da8a1a1b-9a79-4edd-8f4d-53e91c4f1dbe None None] MFA Rules not processed for user `0a8a19cdfbd24a89b030be5b85c68f53`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:47.979042 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-da8a1a1b-9a79-4edd-8f4d-53e91c4f1dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:48.069706 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 940/1879] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:47 2021] POST /identity/v3/auth/tokens => generated 3289 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:48.084600 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a1a1b-9a79-4edd-8f4d-53e91c4f1dbe None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:48.087455 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-da8a1a1b-9a79-4edd-8f4d-53e91c4f1dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:48.109631 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c62b49-397d-4748-9bb9-946b0f2a8bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:48.111004 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c62b49-397d-4748-9bb9-946b0f2a8bf4 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:48.111430 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c62b49-397d-4748-9bb9-946b0f2a8bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:48.111966 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c62b49-397d-4748-9bb9-946b0f2a8bf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:48.113053 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c62b49-397d-4748-9bb9-946b0f2a8bf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:48.115635 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c62b49-397d-4748-9bb9-946b0f2a8bf4 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:48.185557 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 940/1880] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 04:59:47 2021] POST /identity/v3/projects => generated 373 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:59:48.191575 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c62b49-397d-4748-9bb9-946b0f2a8bf4 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:48.207029 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a1a1b-9a79-4edd-8f4d-53e91c4f1dbe None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:48.322176 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64cfc19-38cf-4fde-9ecc-fa7baef0aae3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:48.322845 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64cfc19-38cf-4fde-9ecc-fa7baef0aae3 service cinder] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:48.323185 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64cfc19-38cf-4fde-9ecc-fa7baef0aae3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:48.323376 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64cfc19-38cf-4fde-9ecc-fa7baef0aae3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:48.331795 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c62b49-397d-4748-9bb9-946b0f2a8bf4 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:48.346050 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a840c-3404-42fb-aefb-0dfdd5734742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:48.346752 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a840c-3404-42fb-aefb-0dfdd5734742 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:48.349717 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a840c-3404-42fb-aefb-0dfdd5734742 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:48.350003 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a840c-3404-42fb-aefb-0dfdd5734742 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:48.350739 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a840c-3404-42fb-aefb-0dfdd5734742 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:48.353446 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a840c-3404-42fb-aefb-0dfdd5734742 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:48.400100 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 941/1881] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 04:59:48 2021] POST /identity/v3/users => generated 287 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:59:48.402450 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a840c-3404-42fb-aefb-0dfdd5734742 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:48.425652 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a840c-3404-42fb-aefb-0dfdd5734742 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:48.441702 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d29d2-eb75-48d8-ab5a-d21521894c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:48.442478 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d29d2-eb75-48d8-ab5a-d21521894c9b admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:48.442823 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d29d2-eb75-48d8-ab5a-d21521894c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:48.443162 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d29d2-eb75-48d8-ab5a-d21521894c9b admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:48.444015 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d29d2-eb75-48d8-ab5a-d21521894c9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:48.445732 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d29d2-eb75-48d8-ab5a-d21521894c9b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:48.448334 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64cfc19-38cf-4fde-9ecc-fa7baef0aae3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:48.449301 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64cfc19-38cf-4fde-9ecc-fa7baef0aae3 service cinder] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:48.460583 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 942/1882] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 04:59:48 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 24 04:59:48.462285 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 941/1883] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:59:48 2021] GET /identity/v3/auth/tokens => generated 3289 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 24 04:59:48.473175 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d29d2-eb75-48d8-ab5a-d21521894c9b admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:48.499820 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d29d2-eb75-48d8-ab5a-d21521894c9b admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:48.510718 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2530dc1-7d98-4253-97aa-7edaafe2c7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:48.511207 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2530dc1-7d98-4253-97aa-7edaafe2c7cf admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:48.511520 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2530dc1-7d98-4253-97aa-7edaafe2c7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:48.514713 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2530dc1-7d98-4253-97aa-7edaafe2c7cf admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:48.515652 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2530dc1-7d98-4253-97aa-7edaafe2c7cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:48.519018 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2530dc1-7d98-4253-97aa-7edaafe2c7cf admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:48.551258 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 943/1884] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 04:59:48 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 04:59:48.553408 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64cfc19-38cf-4fde-9ecc-fa7baef0aae3 service cinder] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:48.570317 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64cfc19-38cf-4fde-9ecc-fa7baef0aae3 service cinder] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:48.591033 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029dc27-1a16-48b2-9418-02ef1fd2793c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:48.592028 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029dc27-1a16-48b2-9418-02ef1fd2793c admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:48.592379 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029dc27-1a16-48b2-9418-02ef1fd2793c admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:48.592742 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029dc27-1a16-48b2-9418-02ef1fd2793c admin admin] PATH_INFO: `/v3/projects/7625862aac6143b1be7e02bea4a3b2de/users/c3306079a34842269a38b12f5da82bac/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:48.596132 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2530dc1-7d98-4253-97aa-7edaafe2c7cf admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:48.610968 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2530dc1-7d98-4253-97aa-7edaafe2c7cf admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:48.622558 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12634a38-81db-42e0-9700-44f299aefffd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:48.623319 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12634a38-81db-42e0-9700-44f299aefffd service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:48.623663 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12634a38-81db-42e0-9700-44f299aefffd service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:48.624000 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12634a38-81db-42e0-9700-44f299aefffd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:48.629054 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-12634a38-81db-42e0-9700-44f299aefffd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:48.643105 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6029dc27-1a16-48b2-9418-02ef1fd2793c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7625862aac6143b1be7e02bea4a3b2de, user_id=c3306079a34842269a38b12f5da82bac, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:48.647844 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6029dc27-1a16-48b2-9418-02ef1fd2793c admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:48.676730 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 942/1885] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 04:59:48 2021] PUT /identity/v3/projects/7625862aac6143b1be7e02bea4a3b2de/users/c3306079a34842269a38b12f5da82bac/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:59:48.686959 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477827a-3721-4004-a0ca-2dc368a47d9b None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:48.687236 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477827a-3721-4004-a0ca-2dc368a47d9b None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:48.687665 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477827a-3721-4004-a0ca-2dc368a47d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:48.716486 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-6477827a-3721-4004-a0ca-2dc368a47d9b None None] MFA Rules not processed for user `c3306079a34842269a38b12f5da82bac`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:48.717764 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-6477827a-3721-4004-a0ca-2dc368a47d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:48.726811 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12634a38-81db-42e0-9700-44f299aefffd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:48.729152 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12634a38-81db-42e0-9700-44f299aefffd service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:48.741132 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 944/1886] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:59:48 2021] GET /identity/v3/auth/tokens => generated 3222 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 24 04:59:48.749176 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b0dea-7460-465d-8aec-8496f28dca28 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:48.749585 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b0dea-7460-465d-8aec-8496f28dca28 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:48.750313 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b0dea-7460-465d-8aec-8496f28dca28 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:48.753783 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 945/1887] 10.222.0.43 () {54 vars in 921 bytes} [Fri Dec 24 04:59:48 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 24 04:59:48.764746 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6254fbf-0326-4f64-a43e-2e2f9b5d506a None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:48.765346 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6254fbf-0326-4f64-a43e-2e2f9b5d506a None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:48.765840 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6254fbf-0326-4f64-a43e-2e2f9b5d506a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:48.797978 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-d6254fbf-0326-4f64-a43e-2e2f9b5d506a None None] MFA Rules not processed for user `6f9ad1e8f8f74edcb44aabe17eb59648`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:48.802423 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-d6254fbf-0326-4f64-a43e-2e2f9b5d506a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:48.835787 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 943/1888] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:48 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 04:59:48.853600 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6477827a-3721-4004-a0ca-2dc368a47d9b None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:48.933094 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 946/1889] 10.222.0.43 () {58 vars in 1018 bytes} [Fri Dec 24 04:59:48 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 04:59:48.936160 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6477827a-3721-4004-a0ca-2dc368a47d9b None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:48.941332 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b84635f-54cb-4a2c-99de-4c02b9684a14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:48.942453 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b84635f-54cb-4a2c-99de-4c02b9684a14 service cinder] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:48.942738 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b84635f-54cb-4a2c-99de-4c02b9684a14 service cinder] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:48.943013 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b84635f-54cb-4a2c-99de-4c02b9684a14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:48.954384 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b84635f-54cb-4a2c-99de-4c02b9684a14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:48.957670 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b84635f-54cb-4a2c-99de-4c02b9684a14 service cinder] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:48.968743 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6254fbf-0326-4f64-a43e-2e2f9b5d506a None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:48.970372 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-d6254fbf-0326-4f64-a43e-2e2f9b5d506a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:48.972429 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 944/1890] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:59:48 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:59:48.991712 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6254fbf-0326-4f64-a43e-2e2f9b5d506a None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:48.993309 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b84635f-54cb-4a2c-99de-4c02b9684a14 service cinder] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:48.994066 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931934f6-4cf0-4d4c-a4a9-e5442d5957d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f9ad1e8f8f74edcb44aabe17eb59648', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:48.994737 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931934f6-4cf0-4d4c-a4a9-e5442d5957d8 service nova] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:48.995015 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931934f6-4cf0-4d4c-a4a9-e5442d5957d8 service nova] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:48.995286 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931934f6-4cf0-4d4c-a4a9-e5442d5957d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:49.012282 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931934f6-4cf0-4d4c-a4a9-e5442d5957d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:49.014582 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931934f6-4cf0-4d4c-a4a9-e5442d5957d8 service nova] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:49.026294 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 947/1891] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:59:48 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:59:49.094462 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b84635f-54cb-4a2c-99de-4c02b9684a14 service cinder] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:49.107464 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea7fd8a-baf0-4a51-8d69-2ac717702d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:49.108469 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7fd8a-baf0-4a51-8d69-2ac717702d16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:49.108883 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7fd8a-baf0-4a51-8d69-2ac717702d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:49.109155 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7fd8a-baf0-4a51-8d69-2ac717702d16 admin admin] PATH_INFO: `/v3/users/c3306079a34842269a38b12f5da82bac` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:49.110554 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea7fd8a-baf0-4a51-8d69-2ac717702d16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3306079a34842269a38b12f5da82bac)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:49.112466 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea7fd8a-baf0-4a51-8d69-2ac717702d16 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:49.171974 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-3ea7fd8a-baf0-4a51-8d69-2ac717702d16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3306079a34842269a38b12f5da82bac'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:49.173323 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-3ea7fd8a-baf0-4a51-8d69-2ac717702d16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3306079a34842269a38b12f5da82bac'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:49.182019 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-3ea7fd8a-baf0-4a51-8d69-2ac717702d16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3306079a34842269a38b12f5da82bac'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:49.191879 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-3ea7fd8a-baf0-4a51-8d69-2ac717702d16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3306079a34842269a38b12f5da82bac'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:49.192600 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-3ea7fd8a-baf0-4a51-8d69-2ac717702d16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3306079a34842269a38b12f5da82bac'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:49.212145 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 945/1892] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 04:59:48 2021] DELETE /identity/v3/users/c3306079a34842269a38b12f5da82bac => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 04:59:49.216388 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405c2a7-1251-48c2-8812-233de10ddacf None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:49.217025 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405c2a7-1251-48c2-8812-233de10ddacf None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:49.217025 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405c2a7-1251-48c2-8812-233de10ddacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:49.237553 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-9405c2a7-1251-48c2-8812-233de10ddacf None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:49.238771 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-9405c2a7-1251-48c2-8812-233de10ddacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:49.321690 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 948/1893] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:49.330714 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea7fd8a-baf0-4a51-8d69-2ac717702d16 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:49.332256 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-3ea7fd8a-baf0-4a51-8d69-2ac717702d16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:49.438103 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea7fd8a-baf0-4a51-8d69-2ac717702d16 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:49.449106 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e2c424-c2d2-4924-991f-77c00234e253 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:49.449817 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2c424-c2d2-4924-991f-77c00234e253 service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:49.451099 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2c424-c2d2-4924-991f-77c00234e253 service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:49.451554 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2c424-c2d2-4924-991f-77c00234e253 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:49.476732 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e2c424-c2d2-4924-991f-77c00234e253 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:49.480697 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e2c424-c2d2-4924-991f-77c00234e253 service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:49.508882 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 946/1894] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:59:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 04:59:49.534949 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde7ea58-12ae-495b-8ed5-44e56014642c None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:49.535392 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde7ea58-12ae-495b-8ed5-44e56014642c None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:49.535920 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde7ea58-12ae-495b-8ed5-44e56014642c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:49.558776 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-bde7ea58-12ae-495b-8ed5-44e56014642c None None] MFA Rules not processed for user `fbefbd7e98c94b7598f4af35532d60cb`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:49.560816 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-bde7ea58-12ae-495b-8ed5-44e56014642c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:49.667889 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 949/1895] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:49 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:49.916342 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e2c424-c2d2-4924-991f-77c00234e253 service neutron] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:49.918492 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-28e2c424-c2d2-4924-991f-77c00234e253 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:49.933666 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e2c424-c2d2-4924-991f-77c00234e253 service neutron] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:49.939644 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a6d8b-bc79-4b57-9c5c-bfc5158567f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:49.940637 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a6d8b-bc79-4b57-9c5c-bfc5158567f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:49.941057 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a6d8b-bc79-4b57-9c5c-bfc5158567f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:49.941350 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a6d8b-bc79-4b57-9c5c-bfc5158567f9 admin admin] PATH_INFO: `/v3/projects/7625862aac6143b1be7e02bea4a3b2de` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:49.942651 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a6d8b-bc79-4b57-9c5c-bfc5158567f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7625862aac6143b1be7e02bea4a3b2de)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:49.944827 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a6d8b-bc79-4b57-9c5c-bfc5158567f9 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:49.996043 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-2f6a6d8b-bc79-4b57-9c5c-bfc5158567f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7625862aac6143b1be7e02bea4a3b2de', 'request_id': 'req-2f6a6d8b-bc79-4b57-9c5c-bfc5158567f9'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:50.004649 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-2f6a6d8b-bc79-4b57-9c5c-bfc5158567f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7625862aac6143b1be7e02bea4a3b2de', 'request_id': 'req-2f6a6d8b-bc79-4b57-9c5c-bfc5158567f9'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:50.011432 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-2f6a6d8b-bc79-4b57-9c5c-bfc5158567f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7625862aac6143b1be7e02bea4a3b2de', 'request_id': 'req-2f6a6d8b-bc79-4b57-9c5c-bfc5158567f9'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:50.031835 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-2f6a6d8b-bc79-4b57-9c5c-bfc5158567f9 admin admin] The token cache is being invalidate because project 7625862aac6143b1be7e02bea4a3b2de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 04:59:50.032177 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-2f6a6d8b-bc79-4b57-9c5c-bfc5158567f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:50.033035 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-2f6a6d8b-bc79-4b57-9c5c-bfc5158567f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 04:59:50.036574 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 947/1896] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 04:59:49 2021] DELETE /identity/v3/projects/7625862aac6143b1be7e02bea4a3b2de => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:59:50.043514 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2beb0a3-f9a3-4043-a81e-c6be402f39ea None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:50.044001 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2beb0a3-f9a3-4043-a81e-c6be402f39ea None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:50.044073 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2beb0a3-f9a3-4043-a81e-c6be402f39ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:50.065183 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-b2beb0a3-f9a3-4043-a81e-c6be402f39ea None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:50.066688 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-b2beb0a3-f9a3-4043-a81e-c6be402f39ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:50.178485 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f98f35-4679-4a22-9baf-f49a1ed924a6 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:50.178767 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f98f35-4679-4a22-9baf-f49a1ed924a6 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:50.179207 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f98f35-4679-4a22-9baf-f49a1ed924a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:50.185348 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 950/1897] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:50.200166 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-60f98f35-4679-4a22-9baf-f49a1ed924a6 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:50.201397 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-60f98f35-4679-4a22-9baf-f49a1ed924a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:50.211950 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 948/1898] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:50.216503 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2beb0a3-f9a3-4043-a81e-c6be402f39ea None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:50.233143 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2beb0a3-f9a3-4043-a81e-c6be402f39ea None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:50.238915 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324a164-476a-4dc8-b324-5b64a1de7758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:50.239599 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324a164-476a-4dc8-b324-5b64a1de7758 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:50.239879 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324a164-476a-4dc8-b324-5b64a1de7758 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:50.240151 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324a164-476a-4dc8-b324-5b64a1de7758 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:50.240941 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324a164-476a-4dc8-b324-5b64a1de7758 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 04:59:50.241252 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324a164-476a-4dc8-b324-5b64a1de7758 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:50.242867 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324a164-476a-4dc8-b324-5b64a1de7758 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:50.255431 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 951/1899] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 04:59:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 04:59:50.259838 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f98f35-4679-4a22-9baf-f49a1ed924a6 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:50.274670 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f98f35-4679-4a22-9baf-f49a1ed924a6 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:50.282840 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f226d7-8d74-4534-b154-c93c9b689890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:50.284059 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f226d7-8d74-4534-b154-c93c9b689890 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:50.284281 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f226d7-8d74-4534-b154-c93c9b689890 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:50.284584 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f226d7-8d74-4534-b154-c93c9b689890 admin admin] PATH_INFO: `/v3/projects` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:50.285575 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f226d7-8d74-4534-b154-c93c9b689890 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:50.288176 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f226d7-8d74-4534-b154-c93c9b689890 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:50.333762 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 949/1900] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 04:59:50 2021] POST /identity/v3/projects => generated 367 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 04:59:50.341111 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324a164-476a-4dc8-b324-5b64a1de7758 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:50.366549 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324a164-476a-4dc8-b324-5b64a1de7758 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:50.438258 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef119ff-a30d-46ad-ba2d-ec094755bcd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:50.438964 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef119ff-a30d-46ad-ba2d-ec094755bcd2 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:50.439240 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef119ff-a30d-46ad-ba2d-ec094755bcd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:50.439508 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef119ff-a30d-46ad-ba2d-ec094755bcd2 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:50.440436 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef119ff-a30d-46ad-ba2d-ec094755bcd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:50.442798 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef119ff-a30d-46ad-ba2d-ec094755bcd2 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:50.495704 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 952/1901] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 04:59:50 2021] POST /identity/v3/users => generated 284 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 04:59:50.499625 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f226d7-8d74-4534-b154-c93c9b689890 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:50.512362 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f226d7-8d74-4534-b154-c93c9b689890 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:50.519029 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a55fa-dd30-49f2-85f6-b88a626ce156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:50.519702 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a55fa-dd30-49f2-85f6-b88a626ce156 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:50.519980 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a55fa-dd30-49f2-85f6-b88a626ce156 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:50.520250 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a55fa-dd30-49f2-85f6-b88a626ce156 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:50.521221 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043a55fa-dd30-49f2-85f6-b88a626ce156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:50.524688 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043a55fa-dd30-49f2-85f6-b88a626ce156 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:50.539411 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 950/1902] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 04:59:50 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 04:59:50.540640 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef119ff-a30d-46ad-ba2d-ec094755bcd2 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:50.551867 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef119ff-a30d-46ad-ba2d-ec094755bcd2 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:50.572631 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98705078-06f0-49c2-9799-9854b5771c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:50.573386 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98705078-06f0-49c2-9799-9854b5771c7c admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:50.573609 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98705078-06f0-49c2-9799-9854b5771c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:50.573886 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98705078-06f0-49c2-9799-9854b5771c7c admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:50.576082 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98705078-06f0-49c2-9799-9854b5771c7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:50.578575 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98705078-06f0-49c2-9799-9854b5771c7c admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:50.605946 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 953/1903] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 04:59:50 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 24 04:59:50.607168 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a55fa-dd30-49f2-85f6-b88a626ce156 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:50.618996 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a55fa-dd30-49f2-85f6-b88a626ce156 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:50.630003 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d68eb-a8e9-4b31-bb8e-6c0077aa0a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:50.631312 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d68eb-a8e9-4b31-bb8e-6c0077aa0a9a admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:50.631744 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d68eb-a8e9-4b31-bb8e-6c0077aa0a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:50.632155 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d68eb-a8e9-4b31-bb8e-6c0077aa0a9a admin admin] PATH_INFO: `/v3/projects/ba66883669904fcb843534f93dfdb65e/users/8595d548c7a94c029b8c3fb6a0201e87/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:50.658160 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369d68eb-a8e9-4b31-bb8e-6c0077aa0a9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba66883669904fcb843534f93dfdb65e, user_id=8595d548c7a94c029b8c3fb6a0201e87, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:50.661193 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369d68eb-a8e9-4b31-bb8e-6c0077aa0a9a admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:50.678728 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 951/1904] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 04:59:50 2021] PUT /identity/v3/projects/ba66883669904fcb843534f93dfdb65e/users/8595d548c7a94c029b8c3fb6a0201e87/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 04:59:50.690158 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91519d-2de6-453f-b9f9-fbfd5abe99b2 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:50.690484 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91519d-2de6-453f-b9f9-fbfd5abe99b2 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:50.690763 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91519d-2de6-453f-b9f9-fbfd5abe99b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:50.726471 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-6d91519d-2de6-453f-b9f9-fbfd5abe99b2 None None] MFA Rules not processed for user `8595d548c7a94c029b8c3fb6a0201e87`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 04:59:50.728242 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-6d91519d-2de6-453f-b9f9-fbfd5abe99b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:50.813590 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 954/1905] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 04:59:50 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 04:59:50.825455 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d68eb-a8e9-4b31-bb8e-6c0077aa0a9a admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 04:59:50.827097 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-369d68eb-a8e9-4b31-bb8e-6c0077aa0a9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 04:59:50.901678 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d68eb-a8e9-4b31-bb8e-6c0077aa0a9a admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 04:59:50.907057 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63728dc-b444-4a6d-af68-30316ec509a3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1782324ce854868bd11b32bd24b435c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 04:59:50.907490 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63728dc-b444-4a6d-af68-30316ec509a3 service glance] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 04:59:50.907797 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63728dc-b444-4a6d-af68-30316ec509a3 service glance] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 04:59:50.908092 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63728dc-b444-4a6d-af68-30316ec509a3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 04:59:50.919052 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63728dc-b444-4a6d-af68-30316ec509a3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 04:59:50.920763 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63728dc-b444-4a6d-af68-30316ec509a3 service glance] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 04:59:50.933064 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 952/1906] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 04:59:50 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:00:20.680346 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa35a3-15ad-4022-acfe-1e58c6124a2c None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:20.680997 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa35a3-15ad-4022-acfe-1e58c6124a2c None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:20.680997 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa35a3-15ad-4022-acfe-1e58c6124a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:20.702602 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-43fa35a3-15ad-4022-acfe-1e58c6124a2c None None] MFA Rules not processed for user `f29f576d3a98449b8077c0df53968f07`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:00:20.704446 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-43fa35a3-15ad-4022-acfe-1e58c6124a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:20.766064 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 955/1907] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:00:20 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:00:27.614403 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63728dc-b444-4a6d-af68-30316ec509a3 service glance] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:27.616035 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-e63728dc-b444-4a6d-af68-30316ec509a3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:27.692640 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63728dc-b444-4a6d-af68-30316ec509a3 service glance] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:27.698927 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44dfba1-f972-43dc-a6e0-d4c9294181ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:27.699884 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44dfba1-f972-43dc-a6e0-d4c9294181ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:27.700618 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44dfba1-f972-43dc-a6e0-d4c9294181ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:27.700618 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44dfba1-f972-43dc-a6e0-d4c9294181ce admin admin] PATH_INFO: `/v3/users/ffe6e7618d044a419d66a4a6d3f46c44` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:27.701937 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44dfba1-f972-43dc-a6e0-d4c9294181ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffe6e7618d044a419d66a4a6d3f46c44)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:27.704428 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44dfba1-f972-43dc-a6e0-d4c9294181ce admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:27.761478 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-c44dfba1-f972-43dc-a6e0-d4c9294181ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffe6e7618d044a419d66a4a6d3f46c44'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:27.762308 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-c44dfba1-f972-43dc-a6e0-d4c9294181ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffe6e7618d044a419d66a4a6d3f46c44'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:27.770383 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-c44dfba1-f972-43dc-a6e0-d4c9294181ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffe6e7618d044a419d66a4a6d3f46c44'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:27.779802 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-c44dfba1-f972-43dc-a6e0-d4c9294181ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffe6e7618d044a419d66a4a6d3f46c44'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:27.780496 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-c44dfba1-f972-43dc-a6e0-d4c9294181ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffe6e7618d044a419d66a4a6d3f46c44'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:27.799829 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 953/1908] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:00:27 2021] DELETE /identity/v3/users/ffe6e7618d044a419d66a4a6d3f46c44 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 05:00:27.804870 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c426028-202f-43e9-9c49-31ff8b6befb9 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:27.806617 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c426028-202f-43e9-9c49-31ff8b6befb9 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:27.806972 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c426028-202f-43e9-9c49-31ff8b6befb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:27.826128 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-3c426028-202f-43e9-9c49-31ff8b6befb9 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:00:27.827707 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-3c426028-202f-43e9-9c49-31ff8b6befb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:27.914689 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 956/1909] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:00:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:00:27.925345 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44dfba1-f972-43dc-a6e0-d4c9294181ce admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:27.927055 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-c44dfba1-f972-43dc-a6e0-d4c9294181ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:28.004764 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44dfba1-f972-43dc-a6e0-d4c9294181ce admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:28.009179 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823a9dd-287e-4883-96b8-0b3157ad8896 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:28.009926 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823a9dd-287e-4883-96b8-0b3157ad8896 service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:28.010115 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823a9dd-287e-4883-96b8-0b3157ad8896 service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:28.010516 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823a9dd-287e-4883-96b8-0b3157ad8896 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:28.021127 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4823a9dd-287e-4883-96b8-0b3157ad8896 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:28.022817 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4823a9dd-287e-4883-96b8-0b3157ad8896 service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:28.036370 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 954/1910] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:00:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:00:28.474440 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c426028-202f-43e9-9c49-31ff8b6befb9 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:28.475986 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-3c426028-202f-43e9-9c49-31ff8b6befb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:28.488191 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c426028-202f-43e9-9c49-31ff8b6befb9 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:28.493507 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba761a8-3dc9-4c73-87f7-a6f124d2aaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:28.494442 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba761a8-3dc9-4c73-87f7-a6f124d2aaee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:28.494788 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba761a8-3dc9-4c73-87f7-a6f124d2aaee admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:28.495127 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba761a8-3dc9-4c73-87f7-a6f124d2aaee admin admin] PATH_INFO: `/v3/projects/8cea02e840af439e88cfe9464b0d69ac` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:28.496425 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba761a8-3dc9-4c73-87f7-a6f124d2aaee admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cea02e840af439e88cfe9464b0d69ac)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:28.498440 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba761a8-3dc9-4c73-87f7-a6f124d2aaee admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:28.555702 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-cba761a8-3dc9-4c73-87f7-a6f124d2aaee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cea02e840af439e88cfe9464b0d69ac', 'request_id': 'req-cba761a8-3dc9-4c73-87f7-a6f124d2aaee'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:28.568599 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-cba761a8-3dc9-4c73-87f7-a6f124d2aaee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cea02e840af439e88cfe9464b0d69ac', 'request_id': 'req-cba761a8-3dc9-4c73-87f7-a6f124d2aaee'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:28.576848 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-cba761a8-3dc9-4c73-87f7-a6f124d2aaee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cea02e840af439e88cfe9464b0d69ac', 'request_id': 'req-cba761a8-3dc9-4c73-87f7-a6f124d2aaee'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:28.591703 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-cba761a8-3dc9-4c73-87f7-a6f124d2aaee admin admin] The token cache is being invalidate because project 8cea02e840af439e88cfe9464b0d69ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:00:28.591998 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-cba761a8-3dc9-4c73-87f7-a6f124d2aaee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:28.592687 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-cba761a8-3dc9-4c73-87f7-a6f124d2aaee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:28.594495 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 957/1911] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:00:28 2021] DELETE /identity/v3/projects/8cea02e840af439e88cfe9464b0d69ac => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:00:28.601194 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823a9dd-287e-4883-96b8-0b3157ad8896 service neutron] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:28.619413 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823a9dd-287e-4883-96b8-0b3157ad8896 service neutron] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:28.696784 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6da11f-59ef-4680-acf8-6c7cd0c00bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:28.697941 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6da11f-59ef-4680-acf8-6c7cd0c00bfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:28.698338 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6da11f-59ef-4680-acf8-6c7cd0c00bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:28.698713 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6da11f-59ef-4680-acf8-6c7cd0c00bfb admin admin] PATH_INFO: `/v3/users/0a8a19cdfbd24a89b030be5b85c68f53` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:28.700094 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6da11f-59ef-4680-acf8-6c7cd0c00bfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a8a19cdfbd24a89b030be5b85c68f53)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:28.702350 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6da11f-59ef-4680-acf8-6c7cd0c00bfb admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:28.761288 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-4a6da11f-59ef-4680-acf8-6c7cd0c00bfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a8a19cdfbd24a89b030be5b85c68f53'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:28.761960 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-4a6da11f-59ef-4680-acf8-6c7cd0c00bfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a8a19cdfbd24a89b030be5b85c68f53'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:28.771961 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-4a6da11f-59ef-4680-acf8-6c7cd0c00bfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a8a19cdfbd24a89b030be5b85c68f53'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:28.780761 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-4a6da11f-59ef-4680-acf8-6c7cd0c00bfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a8a19cdfbd24a89b030be5b85c68f53'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:28.781554 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-4a6da11f-59ef-4680-acf8-6c7cd0c00bfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a8a19cdfbd24a89b030be5b85c68f53'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:28.810910 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 955/1912] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:00:28 2021] DELETE /identity/v3/users/0a8a19cdfbd24a89b030be5b85c68f53 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:00:29.569559 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba761a8-3dc9-4c73-87f7-a6f124d2aaee admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:29.571771 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-cba761a8-3dc9-4c73-87f7-a6f124d2aaee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:29.589023 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba761a8-3dc9-4c73-87f7-a6f124d2aaee admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:29.791811 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f1231-c53c-4345-91ac-4debea8ce7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:29.792838 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f1231-c53c-4345-91ac-4debea8ce7cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:29.793273 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f1231-c53c-4345-91ac-4debea8ce7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:29.794149 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f1231-c53c-4345-91ac-4debea8ce7cc admin admin] PATH_INFO: `/v3/projects/78b83fe1d31b4c218c15989d48d506c8` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:29.797022 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88f1231-c53c-4345-91ac-4debea8ce7cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=78b83fe1d31b4c218c15989d48d506c8)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:29.802162 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88f1231-c53c-4345-91ac-4debea8ce7cc admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:29.849520 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-e88f1231-c53c-4345-91ac-4debea8ce7cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78b83fe1d31b4c218c15989d48d506c8', 'request_id': 'req-e88f1231-c53c-4345-91ac-4debea8ce7cc'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:29.857582 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-e88f1231-c53c-4345-91ac-4debea8ce7cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78b83fe1d31b4c218c15989d48d506c8', 'request_id': 'req-e88f1231-c53c-4345-91ac-4debea8ce7cc'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:29.862962 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-e88f1231-c53c-4345-91ac-4debea8ce7cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78b83fe1d31b4c218c15989d48d506c8', 'request_id': 'req-e88f1231-c53c-4345-91ac-4debea8ce7cc'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:29.873605 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-e88f1231-c53c-4345-91ac-4debea8ce7cc admin admin] The token cache is being invalidate because project 78b83fe1d31b4c218c15989d48d506c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:00:29.873889 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-e88f1231-c53c-4345-91ac-4debea8ce7cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:29.874611 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-e88f1231-c53c-4345-91ac-4debea8ce7cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:29.876137 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 958/1913] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:00:29 2021] DELETE /identity/v3/projects/78b83fe1d31b4c218c15989d48d506c8 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:00:29.882119 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff600dee-8952-490c-9609-289299863aad None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:29.882598 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff600dee-8952-490c-9609-289299863aad None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:29.882712 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff600dee-8952-490c-9609-289299863aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:29.901792 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-ff600dee-8952-490c-9609-289299863aad None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:00:29.903304 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-ff600dee-8952-490c-9609-289299863aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:29.967726 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 956/1914] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:00:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 05:00:29.978892 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e0473-ca23-4b85-b5cb-db95e995e216 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:29.979310 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e0473-ca23-4b85-b5cb-db95e995e216 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:29.979684 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e0473-ca23-4b85-b5cb-db95e995e216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:30.007900 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-b27e0473-ca23-4b85-b5cb-db95e995e216 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:00:30.009456 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-b27e0473-ca23-4b85-b5cb-db95e995e216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:30.018224 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 959/1915] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:00:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 05:00:30.022581 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff600dee-8952-490c-9609-289299863aad None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:30.033332 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff600dee-8952-490c-9609-289299863aad None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:30.037986 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f7ec9-23f2-41ba-862a-9b5111e65e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:30.038649 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f7ec9-23f2-41ba-862a-9b5111e65e9a admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:30.038929 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f7ec9-23f2-41ba-862a-9b5111e65e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:30.039198 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f7ec9-23f2-41ba-862a-9b5111e65e9a admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:30.039943 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7f7ec9-23f2-41ba-862a-9b5111e65e9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 05:00:30.040253 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7f7ec9-23f2-41ba-862a-9b5111e65e9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:30.042084 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7f7ec9-23f2-41ba-862a-9b5111e65e9a admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:30.053832 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 957/1916] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 05:00:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 05:00:30.058325 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e0473-ca23-4b85-b5cb-db95e995e216 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:30.069932 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e0473-ca23-4b85-b5cb-db95e995e216 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:30.075763 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470d658-60d6-4d1e-b7fe-bd2e2000d31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:30.076490 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470d658-60d6-4d1e-b7fe-bd2e2000d31e admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:30.076813 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470d658-60d6-4d1e-b7fe-bd2e2000d31e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:30.077084 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470d658-60d6-4d1e-b7fe-bd2e2000d31e admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:30.078032 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e470d658-60d6-4d1e-b7fe-bd2e2000d31e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:30.080227 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e470d658-60d6-4d1e-b7fe-bd2e2000d31e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:30.116446 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 960/1917] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:00:30 2021] POST /identity/v3/projects => generated 361 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:00:30.117847 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f7ec9-23f2-41ba-862a-9b5111e65e9a admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:30.139675 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f7ec9-23f2-41ba-862a-9b5111e65e9a admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:30.202974 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1827fbc2-1f07-4cc1-8d2b-4f691cf87c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:30.203652 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827fbc2-1f07-4cc1-8d2b-4f691cf87c74 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:30.204006 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827fbc2-1f07-4cc1-8d2b-4f691cf87c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:30.204774 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827fbc2-1f07-4cc1-8d2b-4f691cf87c74 admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:30.205344 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1827fbc2-1f07-4cc1-8d2b-4f691cf87c74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:30.207488 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1827fbc2-1f07-4cc1-8d2b-4f691cf87c74 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:30.232571 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 958/1918] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:00:30 2021] POST /identity/v3/users => generated 281 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:00:30.233974 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470d658-60d6-4d1e-b7fe-bd2e2000d31e admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:30.254157 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470d658-60d6-4d1e-b7fe-bd2e2000d31e admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:30.258737 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ba222-4ab6-4066-a424-29c8f55501ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:30.259445 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ba222-4ab6-4066-a424-29c8f55501ee admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:30.259917 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ba222-4ab6-4066-a424-29c8f55501ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:30.262587 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ba222-4ab6-4066-a424-29c8f55501ee admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:30.263368 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ba222-4ab6-4066-a424-29c8f55501ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:30.265645 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ba222-4ab6-4066-a424-29c8f55501ee admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:30.276904 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 961/1919] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:00:30 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:00:30.281070 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1827fbc2-1f07-4cc1-8d2b-4f691cf87c74 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:30.291949 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1827fbc2-1f07-4cc1-8d2b-4f691cf87c74 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:30.297140 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a75c3f1-03e3-4fd9-a681-db57a71a6828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:30.297943 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a75c3f1-03e3-4fd9-a681-db57a71a6828 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:30.298289 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a75c3f1-03e3-4fd9-a681-db57a71a6828 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:30.298628 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a75c3f1-03e3-4fd9-a681-db57a71a6828 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:30.299481 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a75c3f1-03e3-4fd9-a681-db57a71a6828 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:30.301228 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a75c3f1-03e3-4fd9-a681-db57a71a6828 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:30.314999 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 959/1920] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:00:30 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:00:30.315964 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ba222-4ab6-4066-a424-29c8f55501ee admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:30.325886 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ba222-4ab6-4066-a424-29c8f55501ee admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:30.331516 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56cd7d8-febc-4fcb-9b1c-7b4fe30a64c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:30.332538 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56cd7d8-febc-4fcb-9b1c-7b4fe30a64c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:30.332915 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56cd7d8-febc-4fcb-9b1c-7b4fe30a64c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:30.333248 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56cd7d8-febc-4fcb-9b1c-7b4fe30a64c9 admin admin] PATH_INFO: `/v3/projects/067ad4d8c47c45c8ba2cd170e83c321c/users/2ad70d0f6140416a9184f7df34998495/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:30.348651 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56cd7d8-febc-4fcb-9b1c-7b4fe30a64c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=067ad4d8c47c45c8ba2cd170e83c321c, user_id=2ad70d0f6140416a9184f7df34998495, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:30.351265 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56cd7d8-febc-4fcb-9b1c-7b4fe30a64c9 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:30.365899 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 962/1921] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:00:30 2021] PUT /identity/v3/projects/067ad4d8c47c45c8ba2cd170e83c321c/users/2ad70d0f6140416a9184f7df34998495/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:00:30.377147 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eef974-7c57-4fbf-92ad-995bf6d72e8b None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:30.377435 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eef974-7c57-4fbf-92ad-995bf6d72e8b None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:30.377705 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eef974-7c57-4fbf-92ad-995bf6d72e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:30.405054 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-d5eef974-7c57-4fbf-92ad-995bf6d72e8b None None] MFA Rules not processed for user `2ad70d0f6140416a9184f7df34998495`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:00:30.406548 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-d5eef974-7c57-4fbf-92ad-995bf6d72e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:30.473043 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 960/1922] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:00:30 2021] POST /identity/v3/auth/tokens => generated 3228 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:00:30.477798 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56cd7d8-febc-4fcb-9b1c-7b4fe30a64c9 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:30.542547 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56cd7d8-febc-4fcb-9b1c-7b4fe30a64c9 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:30.547800 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169a4da3-7aa6-480a-9664-f59cdf4dd606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:30.548458 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a4da3-7aa6-480a-9664-f59cdf4dd606 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:30.548766 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a4da3-7aa6-480a-9664-f59cdf4dd606 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:30.549037 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a4da3-7aa6-480a-9664-f59cdf4dd606 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:30.549740 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169a4da3-7aa6-480a-9664-f59cdf4dd606 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:30.551640 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169a4da3-7aa6-480a-9664-f59cdf4dd606 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:30.581499 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 963/1923] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:00:30 2021] POST /identity/v3/projects => generated 363 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:00:30.585837 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eef974-7c57-4fbf-92ad-995bf6d72e8b None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:30.600361 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eef974-7c57-4fbf-92ad-995bf6d72e8b None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:30.662277 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8cff3f-528a-40dc-b86e-266203dfaf55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:30.663039 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8cff3f-528a-40dc-b86e-266203dfaf55 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:30.663349 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8cff3f-528a-40dc-b86e-266203dfaf55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:30.663614 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8cff3f-528a-40dc-b86e-266203dfaf55 admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:30.664556 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8cff3f-528a-40dc-b86e-266203dfaf55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:30.666524 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8cff3f-528a-40dc-b86e-266203dfaf55 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:30.693039 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 961/1924] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:00:30 2021] POST /identity/v3/users => generated 288 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:00:30.697429 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169a4da3-7aa6-480a-9664-f59cdf4dd606 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:30.713948 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169a4da3-7aa6-480a-9664-f59cdf4dd606 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:30.722029 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c99ac36-d733-4241-a773-dd01fc289cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:30.722919 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99ac36-d733-4241-a773-dd01fc289cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:30.723263 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99ac36-d733-4241-a773-dd01fc289cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:30.723481 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99ac36-d733-4241-a773-dd01fc289cd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:30.724264 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c99ac36-d733-4241-a773-dd01fc289cd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:30.726240 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c99ac36-d733-4241-a773-dd01fc289cd7 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:30.740774 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 964/1925] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:00:30 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 24 05:00:30.745482 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8cff3f-528a-40dc-b86e-266203dfaf55 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:30.755685 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8cff3f-528a-40dc-b86e-266203dfaf55 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:30.760788 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f064b5-de87-44af-8e05-6299a66f56bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:30.761701 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f064b5-de87-44af-8e05-6299a66f56bf admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:30.761990 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f064b5-de87-44af-8e05-6299a66f56bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:30.762286 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f064b5-de87-44af-8e05-6299a66f56bf admin admin] PATH_INFO: `/v3/projects/8bb79799c4bf4d1c9ce969806e73435a/users/ce37cbbbd2444e42b9fa17a9ad469b10/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:30.778420 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f064b5-de87-44af-8e05-6299a66f56bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bb79799c4bf4d1c9ce969806e73435a, user_id=ce37cbbbd2444e42b9fa17a9ad469b10, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:30.781724 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f064b5-de87-44af-8e05-6299a66f56bf admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:30.802862 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 962/1926] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:00:30 2021] PUT /identity/v3/projects/8bb79799c4bf4d1c9ce969806e73435a/users/ce37cbbbd2444e42b9fa17a9ad469b10/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:00:30.806812 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c99ac36-d733-4241-a773-dd01fc289cd7 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:30.816852 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c99ac36-d733-4241-a773-dd01fc289cd7 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:30.876141 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3bb16c-b410-409d-a4fe-465d7dc4eae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:30.876939 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3bb16c-b410-409d-a4fe-465d7dc4eae4 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:30.877285 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3bb16c-b410-409d-a4fe-465d7dc4eae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:30.877620 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3bb16c-b410-409d-a4fe-465d7dc4eae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:30.878424 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3bb16c-b410-409d-a4fe-465d7dc4eae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:30.880179 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3bb16c-b410-409d-a4fe-465d7dc4eae4 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:30.890262 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 965/1927] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:00:30 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:00:30.894490 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f064b5-de87-44af-8e05-6299a66f56bf admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:30.906078 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f064b5-de87-44af-8e05-6299a66f56bf admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:30.912482 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5b5f9-a4f7-4c20-8ac5-d2340ece3c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:30.913438 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5b5f9-a4f7-4c20-8ac5-d2340ece3c9c admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:30.913709 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5b5f9-a4f7-4c20-8ac5-d2340ece3c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:30.913980 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5b5f9-a4f7-4c20-8ac5-d2340ece3c9c admin admin] PATH_INFO: `/v3/projects/8bb79799c4bf4d1c9ce969806e73435a/users/ce37cbbbd2444e42b9fa17a9ad469b10/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:30.915981 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5b5f9-a4f7-4c20-8ac5-d2340ece3c9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bb79799c4bf4d1c9ce969806e73435a, user_id=ce37cbbbd2444e42b9fa17a9ad469b10, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:30.918729 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5b5f9-a4f7-4c20-8ac5-d2340ece3c9c admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:30.936642 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 963/1928] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:00:30 2021] PUT /identity/v3/projects/8bb79799c4bf4d1c9ce969806e73435a/users/ce37cbbbd2444e42b9fa17a9ad469b10/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 05:00:30.940381 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b6189-4423-4d02-98be-2391bbe84b3e None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:30.940958 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b6189-4423-4d02-98be-2391bbe84b3e None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:30.941351 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b6189-4423-4d02-98be-2391bbe84b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:30.979686 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-3e3b6189-4423-4d02-98be-2391bbe84b3e None None] MFA Rules not processed for user `ce37cbbbd2444e42b9fa17a9ad469b10`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:00:30.981897 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-3e3b6189-4423-4d02-98be-2391bbe84b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:31.052904 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5b5f9-a4f7-4c20-8ac5-d2340ece3c9c admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:31.055121 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-4ca5b5f9-a4f7-4c20-8ac5-d2340ece3c9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:31.098315 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 966/1929] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:00:30 2021] POST /identity/v3/auth/tokens => generated 3297 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:00:31.109744 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b6189-4423-4d02-98be-2391bbe84b3e None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:31.111269 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-3e3b6189-4423-4d02-98be-2391bbe84b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:31.130195 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5b5f9-a4f7-4c20-8ac5-d2340ece3c9c admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:31.134928 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f85f3f0-cf5a-4260-8520-395135cbde93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:31.135791 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85f3f0-cf5a-4260-8520-395135cbde93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:31.136076 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85f3f0-cf5a-4260-8520-395135cbde93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:31.136342 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85f3f0-cf5a-4260-8520-395135cbde93 admin admin] PATH_INFO: `/v3/users/eb4951ba4d134031ac394ec823979ccc` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:31.137660 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f85f3f0-cf5a-4260-8520-395135cbde93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb4951ba4d134031ac394ec823979ccc)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:31.139882 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f85f3f0-cf5a-4260-8520-395135cbde93 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:31.182236 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b6189-4423-4d02-98be-2391bbe84b3e None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:31.185955 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b122b87-00a3-4f73-8ef0-6b47f2ef31c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:31.186702 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b122b87-00a3-4f73-8ef0-6b47f2ef31c0 service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:31.187009 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b122b87-00a3-4f73-8ef0-6b47f2ef31c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:31.187380 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b122b87-00a3-4f73-8ef0-6b47f2ef31c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:31.197250 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-0f85f3f0-cf5a-4260-8520-395135cbde93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb4951ba4d134031ac394ec823979ccc'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:31.197984 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-0f85f3f0-cf5a-4260-8520-395135cbde93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb4951ba4d134031ac394ec823979ccc'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:31.198708 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b122b87-00a3-4f73-8ef0-6b47f2ef31c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:31.200376 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b122b87-00a3-4f73-8ef0-6b47f2ef31c0 service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:31.205332 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-0f85f3f0-cf5a-4260-8520-395135cbde93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb4951ba4d134031ac394ec823979ccc'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:31.210823 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 967/1930] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:00:31 2021] GET /identity/v3/auth/tokens => generated 3297 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 24 05:00:31.214029 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-0f85f3f0-cf5a-4260-8520-395135cbde93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb4951ba4d134031ac394ec823979ccc'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:31.214854 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-0f85f3f0-cf5a-4260-8520-395135cbde93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb4951ba4d134031ac394ec823979ccc'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:31.233066 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 964/1931] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:00:31 2021] DELETE /identity/v3/users/eb4951ba4d134031ac394ec823979ccc => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 05:00:31.237803 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63172856-8450-400e-a3f4-6e08592f3a44 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:31.238088 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63172856-8450-400e-a3f4-6e08592f3a44 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:31.238362 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63172856-8450-400e-a3f4-6e08592f3a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:31.257324 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-63172856-8450-400e-a3f4-6e08592f3a44 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:00:31.259298 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-63172856-8450-400e-a3f4-6e08592f3a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:31.282769 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f85f3f0-cf5a-4260-8520-395135cbde93 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:31.284343 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-0f85f3f0-cf5a-4260-8520-395135cbde93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:31.319672 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 968/1932] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:00:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:00:31.329745 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63172856-8450-400e-a3f4-6e08592f3a44 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:31.333229 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-63172856-8450-400e-a3f4-6e08592f3a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:31.368026 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f85f3f0-cf5a-4260-8520-395135cbde93 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:31.374032 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a921dd9a-745e-4fe8-9100-16be4ed11d19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:31.375535 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921dd9a-745e-4fe8-9100-16be4ed11d19 service cinder] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:31.375927 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921dd9a-745e-4fe8-9100-16be4ed11d19 service cinder] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:31.378199 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921dd9a-745e-4fe8-9100-16be4ed11d19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:31.380761 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-a921dd9a-745e-4fe8-9100-16be4ed11d19 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:31.411407 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63172856-8450-400e-a3f4-6e08592f3a44 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:31.416800 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fca5a9-a5a1-45bf-bc51-f9764d0dd679 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:31.417615 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fca5a9-a5a1-45bf-bc51-f9764d0dd679 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:31.417941 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fca5a9-a5a1-45bf-bc51-f9764d0dd679 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:31.418217 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fca5a9-a5a1-45bf-bc51-f9764d0dd679 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:31.430562 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fca5a9-a5a1-45bf-bc51-f9764d0dd679 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:31.432439 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fca5a9-a5a1-45bf-bc51-f9764d0dd679 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:31.444803 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 969/1933] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:00:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:00:31.457853 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a921dd9a-745e-4fe8-9100-16be4ed11d19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:31.459459 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a921dd9a-745e-4fe8-9100-16be4ed11d19 service cinder] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:31.470745 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 965/1934] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:00:31 2021] GET /identity/v3/auth/tokens => generated 3228 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:00:31.822712 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fca5a9-a5a1-45bf-bc51-f9764d0dd679 service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:31.824519 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-81fca5a9-a5a1-45bf-bc51-f9764d0dd679 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:31.846130 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fca5a9-a5a1-45bf-bc51-f9764d0dd679 service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:31.852776 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e803d-125b-4e33-9158-38d23242c220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:31.853749 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e803d-125b-4e33-9158-38d23242c220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:31.854102 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e803d-125b-4e33-9158-38d23242c220 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:31.854815 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e803d-125b-4e33-9158-38d23242c220 admin admin] PATH_INFO: `/v3/projects/fa032ffc1c2b4d1eb7b79823490028d2` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:31.857191 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e803d-125b-4e33-9158-38d23242c220 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa032ffc1c2b4d1eb7b79823490028d2)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:31.859689 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e803d-125b-4e33-9158-38d23242c220 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:31.906500 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-955e803d-125b-4e33-9158-38d23242c220 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa032ffc1c2b4d1eb7b79823490028d2', 'request_id': 'req-955e803d-125b-4e33-9158-38d23242c220'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:31.917379 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-955e803d-125b-4e33-9158-38d23242c220 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa032ffc1c2b4d1eb7b79823490028d2', 'request_id': 'req-955e803d-125b-4e33-9158-38d23242c220'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:31.923383 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-955e803d-125b-4e33-9158-38d23242c220 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa032ffc1c2b4d1eb7b79823490028d2', 'request_id': 'req-955e803d-125b-4e33-9158-38d23242c220'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:31.934246 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-955e803d-125b-4e33-9158-38d23242c220 admin admin] The token cache is being invalidate because project fa032ffc1c2b4d1eb7b79823490028d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:00:31.934540 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-955e803d-125b-4e33-9158-38d23242c220 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:31.935180 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-955e803d-125b-4e33-9158-38d23242c220 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:31.936827 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 970/1935] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:00:31 2021] DELETE /identity/v3/projects/fa032ffc1c2b4d1eb7b79823490028d2 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:00:31.940917 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a921dd9a-745e-4fe8-9100-16be4ed11d19 service cinder] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:31.951660 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a921dd9a-745e-4fe8-9100-16be4ed11d19 service cinder] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:32.009971 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59274210-9d22-4506-b841-62e0c673e22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:32.010864 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59274210-9d22-4506-b841-62e0c673e22e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:32.011143 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59274210-9d22-4506-b841-62e0c673e22e admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:32.011414 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59274210-9d22-4506-b841-62e0c673e22e admin admin] PATH_INFO: `/v3/users/c6ee8eb06fa849babd56b954dd459f72` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:32.012675 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59274210-9d22-4506-b841-62e0c673e22e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6ee8eb06fa849babd56b954dd459f72)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:32.014906 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59274210-9d22-4506-b841-62e0c673e22e admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:32.064096 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-59274210-9d22-4506-b841-62e0c673e22e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6ee8eb06fa849babd56b954dd459f72'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:32.064794 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-59274210-9d22-4506-b841-62e0c673e22e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6ee8eb06fa849babd56b954dd459f72'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:32.072583 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-59274210-9d22-4506-b841-62e0c673e22e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6ee8eb06fa849babd56b954dd459f72'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:32.086002 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-59274210-9d22-4506-b841-62e0c673e22e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6ee8eb06fa849babd56b954dd459f72'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:32.086903 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-59274210-9d22-4506-b841-62e0c673e22e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6ee8eb06fa849babd56b954dd459f72'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:32.116757 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 966/1936] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:00:31 2021] DELETE /identity/v3/users/c6ee8eb06fa849babd56b954dd459f72 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:00:32.523054 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e803d-125b-4e33-9158-38d23242c220 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:32.524621 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-955e803d-125b-4e33-9158-38d23242c220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:32.537790 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e803d-125b-4e33-9158-38d23242c220 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:32.602778 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3761b4b-ea19-4328-a968-3be29008d792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:32.603890 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3761b4b-ea19-4328-a968-3be29008d792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:32.604422 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3761b4b-ea19-4328-a968-3be29008d792 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:32.604952 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3761b4b-ea19-4328-a968-3be29008d792 admin admin] PATH_INFO: `/v3/projects/bc922bd3163241709335f896e0fbb543` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:32.607050 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3761b4b-ea19-4328-a968-3be29008d792 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc922bd3163241709335f896e0fbb543)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:32.609525 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3761b4b-ea19-4328-a968-3be29008d792 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:32.677722 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-a3761b4b-ea19-4328-a968-3be29008d792 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc922bd3163241709335f896e0fbb543', 'request_id': 'req-a3761b4b-ea19-4328-a968-3be29008d792'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:32.685516 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-a3761b4b-ea19-4328-a968-3be29008d792 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc922bd3163241709335f896e0fbb543', 'request_id': 'req-a3761b4b-ea19-4328-a968-3be29008d792'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:32.691447 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-a3761b4b-ea19-4328-a968-3be29008d792 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc922bd3163241709335f896e0fbb543', 'request_id': 'req-a3761b4b-ea19-4328-a968-3be29008d792'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:32.702387 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-a3761b4b-ea19-4328-a968-3be29008d792 admin admin] The token cache is being invalidate because project bc922bd3163241709335f896e0fbb543 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:00:32.702675 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-a3761b4b-ea19-4328-a968-3be29008d792 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:32.703314 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-a3761b4b-ea19-4328-a968-3be29008d792 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:32.704968 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 971/1937] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:00:32 2021] DELETE /identity/v3/projects/bc922bd3163241709335f896e0fbb543 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:00:32.710930 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302c7d1-3b04-4ca5-bf11-49c88dc5f1e2 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:32.711220 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302c7d1-3b04-4ca5-bf11-49c88dc5f1e2 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:32.711501 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302c7d1-3b04-4ca5-bf11-49c88dc5f1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:32.728816 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-5302c7d1-3b04-4ca5-bf11-49c88dc5f1e2 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:00:32.730139 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-5302c7d1-3b04-4ca5-bf11-49c88dc5f1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:32.790061 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 967/1938] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:00:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:00:32.798700 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d08a7-e015-40eb-9f79-1073f5ca0d07 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:32.798998 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d08a7-e015-40eb-9f79-1073f5ca0d07 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:32.799314 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d08a7-e015-40eb-9f79-1073f5ca0d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:32.817719 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-6e5d08a7-e015-40eb-9f79-1073f5ca0d07 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:00:32.818931 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-6e5d08a7-e015-40eb-9f79-1073f5ca0d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:32.826807 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 972/1939] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:00:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:00:32.831222 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302c7d1-3b04-4ca5-bf11-49c88dc5f1e2 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:32.841304 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302c7d1-3b04-4ca5-bf11-49c88dc5f1e2 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:32.847255 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4557a9d4-7245-4171-8ab9-03740da24539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:32.847932 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4557a9d4-7245-4171-8ab9-03740da24539 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:32.848183 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4557a9d4-7245-4171-8ab9-03740da24539 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:32.848553 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4557a9d4-7245-4171-8ab9-03740da24539 admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:32.849597 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4557a9d4-7245-4171-8ab9-03740da24539 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 05:00:32.849788 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4557a9d4-7245-4171-8ab9-03740da24539 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:32.851578 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4557a9d4-7245-4171-8ab9-03740da24539 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:32.864645 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 968/1940] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 05:00:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 05:00:32.869109 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d08a7-e015-40eb-9f79-1073f5ca0d07 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:32.879199 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d08a7-e015-40eb-9f79-1073f5ca0d07 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:32.883943 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c5e6c-c734-469a-8fd2-c9c60b2ad7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:32.894284 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c5e6c-c734-469a-8fd2-c9c60b2ad7b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:32.894566 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c5e6c-c734-469a-8fd2-c9c60b2ad7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:32.894844 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c5e6c-c734-469a-8fd2-c9c60b2ad7b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:32.895569 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882c5e6c-c734-469a-8fd2-c9c60b2ad7b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:32.897579 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882c5e6c-c734-469a-8fd2-c9c60b2ad7b4 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:32.937534 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 973/1941] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:00:32 2021] POST /identity/v3/projects => generated 373 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 05:00:32.941823 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4557a9d4-7245-4171-8ab9-03740da24539 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:32.953717 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4557a9d4-7245-4171-8ab9-03740da24539 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:33.024835 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78daeaa4-79bc-4494-90e3-a076e5736581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:33.025671 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78daeaa4-79bc-4494-90e3-a076e5736581 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:33.025956 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78daeaa4-79bc-4494-90e3-a076e5736581 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:33.026265 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78daeaa4-79bc-4494-90e3-a076e5736581 admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:33.027172 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78daeaa4-79bc-4494-90e3-a076e5736581 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:33.029563 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78daeaa4-79bc-4494-90e3-a076e5736581 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:33.051068 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 969/1942] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:00:32 2021] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:00:33.055325 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c5e6c-c734-469a-8fd2-c9c60b2ad7b4 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:33.066121 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c5e6c-c734-469a-8fd2-c9c60b2ad7b4 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:33.071135 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8989d0-b75d-4cb7-8ad3-09abc446f9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:33.071810 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8989d0-b75d-4cb7-8ad3-09abc446f9f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:33.072095 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8989d0-b75d-4cb7-8ad3-09abc446f9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:33.072394 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8989d0-b75d-4cb7-8ad3-09abc446f9f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:33.073314 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8989d0-b75d-4cb7-8ad3-09abc446f9f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:33.074931 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8989d0-b75d-4cb7-8ad3-09abc446f9f3 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:33.086130 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 974/1943] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:00:33 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:00:33.089968 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78daeaa4-79bc-4494-90e3-a076e5736581 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:33.100635 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78daeaa4-79bc-4494-90e3-a076e5736581 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:33.105584 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a149d-96ae-4cf3-a24f-daa66d44ba54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:33.106249 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a149d-96ae-4cf3-a24f-daa66d44ba54 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:33.106534 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a149d-96ae-4cf3-a24f-daa66d44ba54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:33.106813 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a149d-96ae-4cf3-a24f-daa66d44ba54 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:33.107600 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a149d-96ae-4cf3-a24f-daa66d44ba54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:33.109337 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a149d-96ae-4cf3-a24f-daa66d44ba54 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:33.119667 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 970/1944] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:00:33 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:00:33.124046 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8989d0-b75d-4cb7-8ad3-09abc446f9f3 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:33.136338 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8989d0-b75d-4cb7-8ad3-09abc446f9f3 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:33.143614 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d62ce-3041-441e-8063-d45e14f435b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:33.144511 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d62ce-3041-441e-8063-d45e14f435b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:33.144819 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d62ce-3041-441e-8063-d45e14f435b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:33.145092 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d62ce-3041-441e-8063-d45e14f435b4 admin admin] PATH_INFO: `/v3/projects/14841836c56f4877a96f89e317f3dd81/users/a1eaee85124b45c79b2d08777388f73c/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:33.159545 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706d62ce-3041-441e-8063-d45e14f435b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14841836c56f4877a96f89e317f3dd81, user_id=a1eaee85124b45c79b2d08777388f73c, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:33.162222 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706d62ce-3041-441e-8063-d45e14f435b4 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:33.177288 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 975/1945] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:00:33 2021] PUT /identity/v3/projects/14841836c56f4877a96f89e317f3dd81/users/a1eaee85124b45c79b2d08777388f73c/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:00:33.187940 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac25efe-b674-4a44-a05d-0178030eac8c None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:33.188316 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac25efe-b674-4a44-a05d-0178030eac8c None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:33.188597 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac25efe-b674-4a44-a05d-0178030eac8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:33.217222 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-6ac25efe-b674-4a44-a05d-0178030eac8c None None] MFA Rules not processed for user `a1eaee85124b45c79b2d08777388f73c`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:00:33.219114 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-6ac25efe-b674-4a44-a05d-0178030eac8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:33.337945 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 971/1946] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:00:33 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 05:00:33.342873 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d62ce-3041-441e-8063-d45e14f435b4 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:33.439802 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d62ce-3041-441e-8063-d45e14f435b4 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:33.444969 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26662204-c7a1-4911-bc6b-329088a707e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:33.445820 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26662204-c7a1-4911-bc6b-329088a707e8 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:33.446109 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26662204-c7a1-4911-bc6b-329088a707e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:33.446475 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26662204-c7a1-4911-bc6b-329088a707e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:33.447519 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26662204-c7a1-4911-bc6b-329088a707e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:33.449656 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26662204-c7a1-4911-bc6b-329088a707e8 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:33.478771 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 976/1947] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:00:33 2021] POST /identity/v3/projects => generated 371 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:00:33.482817 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac25efe-b674-4a44-a05d-0178030eac8c None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:33.494047 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac25efe-b674-4a44-a05d-0178030eac8c None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:33.562609 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af656e4e-7e0b-45a8-bb0c-6dfa2b7c5c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:33.563291 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af656e4e-7e0b-45a8-bb0c-6dfa2b7c5c24 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:33.563606 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af656e4e-7e0b-45a8-bb0c-6dfa2b7c5c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:33.563887 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af656e4e-7e0b-45a8-bb0c-6dfa2b7c5c24 admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:33.564640 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af656e4e-7e0b-45a8-bb0c-6dfa2b7c5c24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:33.566607 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af656e4e-7e0b-45a8-bb0c-6dfa2b7c5c24 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:33.587345 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 972/1948] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:00:33 2021] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:00:33.591305 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26662204-c7a1-4911-bc6b-329088a707e8 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:33.601777 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26662204-c7a1-4911-bc6b-329088a707e8 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:33.606366 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac24a19-547b-4a7d-8c82-d37d0b1b68ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:33.607021 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac24a19-547b-4a7d-8c82-d37d0b1b68ee admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:33.607300 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac24a19-547b-4a7d-8c82-d37d0b1b68ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:33.607571 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac24a19-547b-4a7d-8c82-d37d0b1b68ee admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:33.608603 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac24a19-547b-4a7d-8c82-d37d0b1b68ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:33.611421 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac24a19-547b-4a7d-8c82-d37d0b1b68ee admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:33.623211 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 977/1949] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:00:33 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 24 05:00:33.627770 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af656e4e-7e0b-45a8-bb0c-6dfa2b7c5c24 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:33.638257 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af656e4e-7e0b-45a8-bb0c-6dfa2b7c5c24 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:33.643559 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef803f6-04a9-48e9-9134-4f2754f1381b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:33.644452 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef803f6-04a9-48e9-9134-4f2754f1381b admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:33.644764 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef803f6-04a9-48e9-9134-4f2754f1381b admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:33.645035 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef803f6-04a9-48e9-9134-4f2754f1381b admin admin] PATH_INFO: `/v3/projects/08995413c7934c8ba2d98914246a1bf9/users/cd441507f2b942feb67c3a2824f6328d/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:33.660657 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef803f6-04a9-48e9-9134-4f2754f1381b admin admin] RBAC: Authorizing `identity:create_grant(project_id=08995413c7934c8ba2d98914246a1bf9, user_id=cd441507f2b942feb67c3a2824f6328d, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:33.664199 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef803f6-04a9-48e9-9134-4f2754f1381b admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:33.674257 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1f34a-7464-43a3-a228-1a0644183c29 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:33.674661 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1f34a-7464-43a3-a228-1a0644183c29 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:33.675032 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1f34a-7464-43a3-a228-1a0644183c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:33.688567 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 973/1950] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:00:33 2021] PUT /identity/v3/projects/08995413c7934c8ba2d98914246a1bf9/users/cd441507f2b942feb67c3a2824f6328d/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 05:00:33.691187 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef803f6-04a9-48e9-9134-4f2754f1381b admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:33.697688 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-e9e1f34a-7464-43a3-a228-1a0644183c29 None None] MFA Rules not processed for user `fbefbd7e98c94b7598f4af35532d60cb`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:00:33.698956 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-e9e1f34a-7464-43a3-a228-1a0644183c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:33.759391 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef803f6-04a9-48e9-9134-4f2754f1381b admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:33.762726 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 978/1951] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:00:33 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:00:33.769796 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25003cf5-3540-44df-9fbd-82ab189cf11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:33.770737 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25003cf5-3540-44df-9fbd-82ab189cf11c admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:33.771287 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25003cf5-3540-44df-9fbd-82ab189cf11c admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:33.772158 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25003cf5-3540-44df-9fbd-82ab189cf11c admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:33.772348 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25003cf5-3540-44df-9fbd-82ab189cf11c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:33.774026 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25003cf5-3540-44df-9fbd-82ab189cf11c admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:33.791717 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 974/1952] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:00:33 2021] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 24 05:00:33.793014 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1f34a-7464-43a3-a228-1a0644183c29 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:33.804467 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1f34a-7464-43a3-a228-1a0644183c29 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:33.809954 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8606dc8-2811-4357-91de-5f72a7864788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:33.810964 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8606dc8-2811-4357-91de-5f72a7864788 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:33.811247 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8606dc8-2811-4357-91de-5f72a7864788 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:33.811610 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8606dc8-2811-4357-91de-5f72a7864788 admin admin] PATH_INFO: `/v3/projects/08995413c7934c8ba2d98914246a1bf9/users/cd441507f2b942feb67c3a2824f6328d/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:33.814254 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8606dc8-2811-4357-91de-5f72a7864788 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08995413c7934c8ba2d98914246a1bf9, user_id=cd441507f2b942feb67c3a2824f6328d, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:33.816940 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8606dc8-2811-4357-91de-5f72a7864788 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:33.830444 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 979/1953] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:00:33 2021] PUT /identity/v3/projects/08995413c7934c8ba2d98914246a1bf9/users/cd441507f2b942feb67c3a2824f6328d/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:00:33.840994 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478b64c-aa70-46bf-8e8f-1a3bd4a256f1 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:33.841287 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478b64c-aa70-46bf-8e8f-1a3bd4a256f1 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:33.841565 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478b64c-aa70-46bf-8e8f-1a3bd4a256f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:33.871185 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-5478b64c-aa70-46bf-8e8f-1a3bd4a256f1 None None] MFA Rules not processed for user `cd441507f2b942feb67c3a2824f6328d`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:00:33.872581 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-5478b64c-aa70-46bf-8e8f-1a3bd4a256f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:33.947480 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 975/1954] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:00:33 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:00:33.958939 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8606dc8-2811-4357-91de-5f72a7864788 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:33.961007 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-f8606dc8-2811-4357-91de-5f72a7864788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:34.025518 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8606dc8-2811-4357-91de-5f72a7864788 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:34.033985 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c471e3-8b67-4743-ae82-fb9d2d33e52d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:34.034651 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c471e3-8b67-4743-ae82-fb9d2d33e52d service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:34.034928 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c471e3-8b67-4743-ae82-fb9d2d33e52d service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:34.035225 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c471e3-8b67-4743-ae82-fb9d2d33e52d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:34.047679 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c471e3-8b67-4743-ae82-fb9d2d33e52d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:34.049230 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c471e3-8b67-4743-ae82-fb9d2d33e52d service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:34.060985 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 980/1955] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:00:33 2021] GET /identity/v3/auth/tokens => generated 3305 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:00:34.417231 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478b64c-aa70-46bf-8e8f-1a3bd4a256f1 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:34.496752 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478b64c-aa70-46bf-8e8f-1a3bd4a256f1 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:34.502405 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd2e723-043a-4316-b7d0-afa277f2c799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:34.503489 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2e723-043a-4316-b7d0-afa277f2c799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:34.503770 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2e723-043a-4316-b7d0-afa277f2c799 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:34.504042 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2e723-043a-4316-b7d0-afa277f2c799 admin admin] PATH_INFO: `/v3/users/a1eaee85124b45c79b2d08777388f73c` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:34.505311 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd2e723-043a-4316-b7d0-afa277f2c799 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1eaee85124b45c79b2d08777388f73c)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:34.507237 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd2e723-043a-4316-b7d0-afa277f2c799 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:34.560587 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-bdd2e723-043a-4316-b7d0-afa277f2c799 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1eaee85124b45c79b2d08777388f73c'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:34.561252 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-bdd2e723-043a-4316-b7d0-afa277f2c799 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1eaee85124b45c79b2d08777388f73c'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:34.570420 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-bdd2e723-043a-4316-b7d0-afa277f2c799 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1eaee85124b45c79b2d08777388f73c'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:34.579986 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-bdd2e723-043a-4316-b7d0-afa277f2c799 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1eaee85124b45c79b2d08777388f73c'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:34.580848 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-bdd2e723-043a-4316-b7d0-afa277f2c799 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1eaee85124b45c79b2d08777388f73c'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:34.604368 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 976/1956] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:00:34 2021] DELETE /identity/v3/users/a1eaee85124b45c79b2d08777388f73c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:00:34.610849 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c753e0-7bb3-4bf9-a75c-0d3e1d459393 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:34.611336 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c753e0-7bb3-4bf9-a75c-0d3e1d459393 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:34.611922 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c753e0-7bb3-4bf9-a75c-0d3e1d459393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:34.634692 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-28c753e0-7bb3-4bf9-a75c-0d3e1d459393 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:00:34.636081 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-28c753e0-7bb3-4bf9-a75c-0d3e1d459393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:34.698675 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 981/1957] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:00:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 05:00:34.709091 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd2e723-043a-4316-b7d0-afa277f2c799 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:34.710806 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-bdd2e723-043a-4316-b7d0-afa277f2c799 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:34.773925 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd2e723-043a-4316-b7d0-afa277f2c799 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:34.777587 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9272f4-dabf-4b4c-8606-8275d1aa3b1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:34.778235 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9272f4-dabf-4b4c-8606-8275d1aa3b1b service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:34.778513 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9272f4-dabf-4b4c-8606-8275d1aa3b1b service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:34.778784 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9272f4-dabf-4b4c-8606-8275d1aa3b1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:34.787753 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9272f4-dabf-4b4c-8606-8275d1aa3b1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:34.789221 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9272f4-dabf-4b4c-8606-8275d1aa3b1b service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:34.798478 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 977/1958] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:00:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:00:35.111726 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c753e0-7bb3-4bf9-a75c-0d3e1d459393 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:35.113765 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-28c753e0-7bb3-4bf9-a75c-0d3e1d459393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:35.135311 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c753e0-7bb3-4bf9-a75c-0d3e1d459393 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:35.143896 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba288b-e619-4bc3-94d6-1a220ab1e2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:35.144835 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba288b-e619-4bc3-94d6-1a220ab1e2e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:35.145110 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba288b-e619-4bc3-94d6-1a220ab1e2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:35.145484 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba288b-e619-4bc3-94d6-1a220ab1e2e0 admin admin] PATH_INFO: `/v3/projects/14841836c56f4877a96f89e317f3dd81` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:35.146844 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbba288b-e619-4bc3-94d6-1a220ab1e2e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14841836c56f4877a96f89e317f3dd81)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:35.148858 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbba288b-e619-4bc3-94d6-1a220ab1e2e0 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:35.198446 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-dbba288b-e619-4bc3-94d6-1a220ab1e2e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14841836c56f4877a96f89e317f3dd81', 'request_id': 'req-dbba288b-e619-4bc3-94d6-1a220ab1e2e0'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:35.208252 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-dbba288b-e619-4bc3-94d6-1a220ab1e2e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14841836c56f4877a96f89e317f3dd81', 'request_id': 'req-dbba288b-e619-4bc3-94d6-1a220ab1e2e0'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:35.214205 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-dbba288b-e619-4bc3-94d6-1a220ab1e2e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14841836c56f4877a96f89e317f3dd81', 'request_id': 'req-dbba288b-e619-4bc3-94d6-1a220ab1e2e0'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:35.225647 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-dbba288b-e619-4bc3-94d6-1a220ab1e2e0 admin admin] The token cache is being invalidate because project 14841836c56f4877a96f89e317f3dd81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:00:35.225941 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-dbba288b-e619-4bc3-94d6-1a220ab1e2e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:35.226571 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-dbba288b-e619-4bc3-94d6-1a220ab1e2e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:35.228158 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 982/1959] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:00:35 2021] DELETE /identity/v3/projects/14841836c56f4877a96f89e317f3dd81 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:00:35.232372 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9272f4-dabf-4b4c-8606-8275d1aa3b1b service neutron] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:35.247890 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9272f4-dabf-4b4c-8606-8275d1aa3b1b service neutron] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:35.304800 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc6cda-3a28-441d-bf97-5506d8551b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:35.305674 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc6cda-3a28-441d-bf97-5506d8551b97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:35.306380 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc6cda-3a28-441d-bf97-5506d8551b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:35.306657 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc6cda-3a28-441d-bf97-5506d8551b97 admin admin] PATH_INFO: `/v3/users/cd441507f2b942feb67c3a2824f6328d` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:35.315173 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fc6cda-3a28-441d-bf97-5506d8551b97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd441507f2b942feb67c3a2824f6328d)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:35.317249 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fc6cda-3a28-441d-bf97-5506d8551b97 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:35.377120 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-34fc6cda-3a28-441d-bf97-5506d8551b97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd441507f2b942feb67c3a2824f6328d'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:35.377785 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-34fc6cda-3a28-441d-bf97-5506d8551b97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd441507f2b942feb67c3a2824f6328d'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:35.386638 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-34fc6cda-3a28-441d-bf97-5506d8551b97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd441507f2b942feb67c3a2824f6328d'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:35.401238 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-34fc6cda-3a28-441d-bf97-5506d8551b97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd441507f2b942feb67c3a2824f6328d'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:35.402192 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-34fc6cda-3a28-441d-bf97-5506d8551b97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd441507f2b942feb67c3a2824f6328d'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:35.430881 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 978/1960] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:00:35 2021] DELETE /identity/v3/users/cd441507f2b942feb67c3a2824f6328d => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:00:35.769265 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba288b-e619-4bc3-94d6-1a220ab1e2e0 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:35.771091 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-dbba288b-e619-4bc3-94d6-1a220ab1e2e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:35.795054 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba288b-e619-4bc3-94d6-1a220ab1e2e0 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:35.853287 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb75dab-22f4-4bd0-8102-e385c6d80856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:35.854274 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb75dab-22f4-4bd0-8102-e385c6d80856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:35.854559 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb75dab-22f4-4bd0-8102-e385c6d80856 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:35.854895 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb75dab-22f4-4bd0-8102-e385c6d80856 admin admin] PATH_INFO: `/v3/projects/08995413c7934c8ba2d98914246a1bf9` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:35.856305 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb75dab-22f4-4bd0-8102-e385c6d80856 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08995413c7934c8ba2d98914246a1bf9)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:35.858418 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb75dab-22f4-4bd0-8102-e385c6d80856 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:35.903485 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-5cb75dab-22f4-4bd0-8102-e385c6d80856 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08995413c7934c8ba2d98914246a1bf9', 'request_id': 'req-5cb75dab-22f4-4bd0-8102-e385c6d80856'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:35.910273 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-5cb75dab-22f4-4bd0-8102-e385c6d80856 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08995413c7934c8ba2d98914246a1bf9', 'request_id': 'req-5cb75dab-22f4-4bd0-8102-e385c6d80856'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:35.915651 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-5cb75dab-22f4-4bd0-8102-e385c6d80856 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08995413c7934c8ba2d98914246a1bf9', 'request_id': 'req-5cb75dab-22f4-4bd0-8102-e385c6d80856'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:35.926959 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-5cb75dab-22f4-4bd0-8102-e385c6d80856 admin admin] The token cache is being invalidate because project 08995413c7934c8ba2d98914246a1bf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:00:35.927244 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-5cb75dab-22f4-4bd0-8102-e385c6d80856 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:35.927874 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-5cb75dab-22f4-4bd0-8102-e385c6d80856 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:35.929740 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 983/1961] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:00:35 2021] DELETE /identity/v3/projects/08995413c7934c8ba2d98914246a1bf9 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:00:35.935584 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff634c60-0d56-401e-ac97-63650ddcfed6 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:35.935878 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff634c60-0d56-401e-ac97-63650ddcfed6 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:35.936157 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff634c60-0d56-401e-ac97-63650ddcfed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:35.954460 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-ff634c60-0d56-401e-ac97-63650ddcfed6 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:00:35.955666 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-ff634c60-0d56-401e-ac97-63650ddcfed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:36.014420 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 979/1962] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:00:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:00:36.022330 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6135c-7e35-48bd-9cc6-a09b8fa33d07 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:36.022613 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6135c-7e35-48bd-9cc6-a09b8fa33d07 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:36.022885 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6135c-7e35-48bd-9cc6-a09b8fa33d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:36.040778 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-2da6135c-7e35-48bd-9cc6-a09b8fa33d07 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:00:36.041956 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-2da6135c-7e35-48bd-9cc6-a09b8fa33d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:36.050029 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 984/1963] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:00:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:00:36.054303 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff634c60-0d56-401e-ac97-63650ddcfed6 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:36.065002 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff634c60-0d56-401e-ac97-63650ddcfed6 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:36.070696 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f313bc-efa3-4de8-a657-bd432e29da30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:36.071379 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f313bc-efa3-4de8-a657-bd432e29da30 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:36.071657 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f313bc-efa3-4de8-a657-bd432e29da30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:36.071907 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f313bc-efa3-4de8-a657-bd432e29da30 admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:36.072678 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f313bc-efa3-4de8-a657-bd432e29da30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 05:00:36.072985 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f313bc-efa3-4de8-a657-bd432e29da30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:36.074602 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f313bc-efa3-4de8-a657-bd432e29da30 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:36.086741 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 980/1964] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 05:00:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 05:00:36.091007 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da6135c-7e35-48bd-9cc6-a09b8fa33d07 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:36.100232 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da6135c-7e35-48bd-9cc6-a09b8fa33d07 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:36.105326 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b28fe-72ea-482d-ab06-01d49ca4bcc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:36.105993 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b28fe-72ea-482d-ab06-01d49ca4bcc5 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:36.106269 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b28fe-72ea-482d-ab06-01d49ca4bcc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:36.106562 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b28fe-72ea-482d-ab06-01d49ca4bcc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:36.107296 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7b28fe-72ea-482d-ab06-01d49ca4bcc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:36.109275 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7b28fe-72ea-482d-ab06-01d49ca4bcc5 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:36.140871 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 985/1965] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:00:36 2021] POST /identity/v3/projects => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 05:00:36.142121 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f313bc-efa3-4de8-a657-bd432e29da30 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:36.153089 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f313bc-efa3-4de8-a657-bd432e29da30 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:36.215634 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d33dee0-b240-4ae6-bfba-77004d7d2652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:36.216192 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33dee0-b240-4ae6-bfba-77004d7d2652 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:36.216473 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33dee0-b240-4ae6-bfba-77004d7d2652 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:36.216781 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33dee0-b240-4ae6-bfba-77004d7d2652 admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:36.217500 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d33dee0-b240-4ae6-bfba-77004d7d2652 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:36.219962 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d33dee0-b240-4ae6-bfba-77004d7d2652 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:36.242046 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 981/1966] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:00:36 2021] POST /identity/v3/users => generated 284 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:00:36.246605 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b28fe-72ea-482d-ab06-01d49ca4bcc5 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:36.258345 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b28fe-72ea-482d-ab06-01d49ca4bcc5 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:36.263783 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f894e02-07ea-4388-9c9c-edd5ceb96a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:36.264425 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f894e02-07ea-4388-9c9c-edd5ceb96a0d admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:36.264811 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f894e02-07ea-4388-9c9c-edd5ceb96a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:36.265164 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f894e02-07ea-4388-9c9c-edd5ceb96a0d admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:36.265941 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f894e02-07ea-4388-9c9c-edd5ceb96a0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:36.267563 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f894e02-07ea-4388-9c9c-edd5ceb96a0d admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:36.278520 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 986/1967] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:00:36 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:00:36.282739 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d33dee0-b240-4ae6-bfba-77004d7d2652 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:36.292793 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d33dee0-b240-4ae6-bfba-77004d7d2652 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:36.298047 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61120b16-83ce-4656-9e5d-c02e600ca5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:36.298786 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61120b16-83ce-4656-9e5d-c02e600ca5f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:36.299161 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61120b16-83ce-4656-9e5d-c02e600ca5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:36.299499 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61120b16-83ce-4656-9e5d-c02e600ca5f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:36.300335 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61120b16-83ce-4656-9e5d-c02e600ca5f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:36.302053 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61120b16-83ce-4656-9e5d-c02e600ca5f6 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:36.313136 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 982/1968] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:00:36 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:00:36.316968 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f894e02-07ea-4388-9c9c-edd5ceb96a0d admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:36.327061 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f894e02-07ea-4388-9c9c-edd5ceb96a0d admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:36.332108 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf59b383-4e1d-4a9e-ae9a-250ae6c319b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:36.333110 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59b383-4e1d-4a9e-ae9a-250ae6c319b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:36.333456 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59b383-4e1d-4a9e-ae9a-250ae6c319b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:36.333816 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59b383-4e1d-4a9e-ae9a-250ae6c319b5 admin admin] PATH_INFO: `/v3/projects/7d2eec5f9bc8467da13c92d8b94c95da/users/c73a6eb2c5d049e89d8e71149445f4a0/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:36.349723 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf59b383-4e1d-4a9e-ae9a-250ae6c319b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d2eec5f9bc8467da13c92d8b94c95da, user_id=c73a6eb2c5d049e89d8e71149445f4a0, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:36.352630 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf59b383-4e1d-4a9e-ae9a-250ae6c319b5 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:36.367150 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 987/1969] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:00:36 2021] PUT /identity/v3/projects/7d2eec5f9bc8467da13c92d8b94c95da/users/c73a6eb2c5d049e89d8e71149445f4a0/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:00:36.378504 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a2a84-3291-4299-8761-e3ec50a9d44b None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:36.378820 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a2a84-3291-4299-8761-e3ec50a9d44b None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:36.379138 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a2a84-3291-4299-8761-e3ec50a9d44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:36.407261 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-272a2a84-3291-4299-8761-e3ec50a9d44b None None] MFA Rules not processed for user `c73a6eb2c5d049e89d8e71149445f4a0`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:00:36.408477 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-272a2a84-3291-4299-8761-e3ec50a9d44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:36.475542 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 983/1970] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:00:36 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:00:36.479987 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf59b383-4e1d-4a9e-ae9a-250ae6c319b5 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:36.541781 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf59b383-4e1d-4a9e-ae9a-250ae6c319b5 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:36.547028 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1917f7cb-fbc3-4912-a315-3df14853a084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:36.547743 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917f7cb-fbc3-4912-a315-3df14853a084 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:36.548065 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917f7cb-fbc3-4912-a315-3df14853a084 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:36.548355 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917f7cb-fbc3-4912-a315-3df14853a084 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:36.549144 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1917f7cb-fbc3-4912-a315-3df14853a084 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:36.551179 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1917f7cb-fbc3-4912-a315-3df14853a084 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:36.578645 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 988/1971] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:00:36 2021] POST /identity/v3/projects => generated 365 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:00:36.582740 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a2a84-3291-4299-8761-e3ec50a9d44b None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:36.594395 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a2a84-3291-4299-8761-e3ec50a9d44b None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:36.653562 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c030d2-f403-47e8-8ae1-e65e9f25156a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:36.654246 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c030d2-f403-47e8-8ae1-e65e9f25156a admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:36.654523 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c030d2-f403-47e8-8ae1-e65e9f25156a admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:36.654799 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c030d2-f403-47e8-8ae1-e65e9f25156a admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:36.655626 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c030d2-f403-47e8-8ae1-e65e9f25156a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:36.657746 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c030d2-f403-47e8-8ae1-e65e9f25156a admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:36.681992 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 984/1972] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:00:36 2021] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:00:36.683496 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1917f7cb-fbc3-4912-a315-3df14853a084 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:36.694127 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1917f7cb-fbc3-4912-a315-3df14853a084 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:36.702097 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546255c-9c3e-4476-a79a-d764f52934c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:36.703183 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546255c-9c3e-4476-a79a-d764f52934c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:36.703709 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546255c-9c3e-4476-a79a-d764f52934c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:36.703951 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546255c-9c3e-4476-a79a-d764f52934c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:36.704963 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c546255c-9c3e-4476-a79a-d764f52934c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:36.706772 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c546255c-9c3e-4476-a79a-d764f52934c5 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:36.719912 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 989/1973] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:00:36 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:00:36.724326 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c030d2-f403-47e8-8ae1-e65e9f25156a admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:36.734863 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c030d2-f403-47e8-8ae1-e65e9f25156a admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:36.740095 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0981b9b4-69d0-4d50-9d88-3cf745f58a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:36.741048 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0981b9b4-69d0-4d50-9d88-3cf745f58a64 admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:36.741333 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0981b9b4-69d0-4d50-9d88-3cf745f58a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:36.741606 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0981b9b4-69d0-4d50-9d88-3cf745f58a64 admin admin] PATH_INFO: `/v3/projects/84b4911a56a34406b7d23c62a9503d1f/users/2610c47faec24a6598e00010bd5ea9e9/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:36.759254 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0981b9b4-69d0-4d50-9d88-3cf745f58a64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84b4911a56a34406b7d23c62a9503d1f, user_id=2610c47faec24a6598e00010bd5ea9e9, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:36.761982 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0981b9b4-69d0-4d50-9d88-3cf745f58a64 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:36.777332 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 985/1974] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:00:36 2021] PUT /identity/v3/projects/84b4911a56a34406b7d23c62a9503d1f/users/2610c47faec24a6598e00010bd5ea9e9/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:00:36.781249 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546255c-9c3e-4476-a79a-d764f52934c5 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:36.790947 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546255c-9c3e-4476-a79a-d764f52934c5 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:36.849506 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5951e7-0198-4da1-b607-2ffaf14f4840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:36.850313 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5951e7-0198-4da1-b607-2ffaf14f4840 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:36.850629 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5951e7-0198-4da1-b607-2ffaf14f4840 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:36.851107 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5951e7-0198-4da1-b607-2ffaf14f4840 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:36.852010 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5951e7-0198-4da1-b607-2ffaf14f4840 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:36.854015 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5951e7-0198-4da1-b607-2ffaf14f4840 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:36.864983 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 990/1975] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:00:36 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:00:36.869163 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0981b9b4-69d0-4d50-9d88-3cf745f58a64 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:36.879543 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0981b9b4-69d0-4d50-9d88-3cf745f58a64 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:36.884153 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a89e15a-9dfe-4f7b-8e04-6a62ddb7e71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:36.885057 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89e15a-9dfe-4f7b-8e04-6a62ddb7e71a admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:36.885339 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89e15a-9dfe-4f7b-8e04-6a62ddb7e71a admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:36.885613 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89e15a-9dfe-4f7b-8e04-6a62ddb7e71a admin admin] PATH_INFO: `/v3/projects/84b4911a56a34406b7d23c62a9503d1f/users/2610c47faec24a6598e00010bd5ea9e9/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:36.887600 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a89e15a-9dfe-4f7b-8e04-6a62ddb7e71a admin admin] RBAC: Authorizing `identity:create_grant(project_id=84b4911a56a34406b7d23c62a9503d1f, user_id=2610c47faec24a6598e00010bd5ea9e9, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:36.890766 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a89e15a-9dfe-4f7b-8e04-6a62ddb7e71a admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:36.901284 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 986/1976] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:00:36 2021] PUT /identity/v3/projects/84b4911a56a34406b7d23c62a9503d1f/users/2610c47faec24a6598e00010bd5ea9e9/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:00:36.911470 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff1454-7a12-4250-9604-9a2838db5436 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:36.911783 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff1454-7a12-4250-9604-9a2838db5436 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:36.912068 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff1454-7a12-4250-9604-9a2838db5436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:36.946874 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-9fff1454-7a12-4250-9604-9a2838db5436 None None] MFA Rules not processed for user `2610c47faec24a6598e00010bd5ea9e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:00:36.948756 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-9fff1454-7a12-4250-9604-9a2838db5436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:37.020275 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 991/1977] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:00:36 2021] POST /identity/v3/auth/tokens => generated 3299 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 05:00:37.031239 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a89e15a-9dfe-4f7b-8e04-6a62ddb7e71a admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:37.033133 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-9a89e15a-9dfe-4f7b-8e04-6a62ddb7e71a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:37.089526 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a89e15a-9dfe-4f7b-8e04-6a62ddb7e71a admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:37.093752 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1072be15-b76e-4305-af78-ace3a69b35a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:37.094397 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072be15-b76e-4305-af78-ace3a69b35a1 service cinder] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:37.094686 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072be15-b76e-4305-af78-ace3a69b35a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:37.094958 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072be15-b76e-4305-af78-ace3a69b35a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:37.104078 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1072be15-b76e-4305-af78-ace3a69b35a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:37.105563 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1072be15-b76e-4305-af78-ace3a69b35a1 service cinder] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:37.115092 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 987/1978] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:00:37 2021] GET /identity/v3/auth/tokens => generated 3299 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 24 05:00:37.165514 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff1454-7a12-4250-9604-9a2838db5436 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:37.166970 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-9fff1454-7a12-4250-9604-9a2838db5436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:37.179461 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff1454-7a12-4250-9604-9a2838db5436 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:37.186039 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1920f03d-358f-459b-8104-9c204f55424c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:37.187091 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920f03d-358f-459b-8104-9c204f55424c service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:37.187378 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920f03d-358f-459b-8104-9c204f55424c service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:37.187631 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920f03d-358f-459b-8104-9c204f55424c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:37.258139 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1920f03d-358f-459b-8104-9c204f55424c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:37.260117 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1920f03d-358f-459b-8104-9c204f55424c service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:37.271959 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 992/1979] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:00:37 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:00:40.866550 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1072be15-b76e-4305-af78-ace3a69b35a1 service cinder] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:40.935854 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1072be15-b76e-4305-af78-ace3a69b35a1 service cinder] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:40.941188 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2c4d9-a2d9-457a-861a-63342be24835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:40.942071 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2c4d9-a2d9-457a-861a-63342be24835 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:40.942327 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2c4d9-a2d9-457a-861a-63342be24835 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:40.943048 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2c4d9-a2d9-457a-861a-63342be24835 admin admin] PATH_INFO: `/v3/users/c73a6eb2c5d049e89d8e71149445f4a0` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:40.943954 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc2c4d9-a2d9-457a-861a-63342be24835 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c73a6eb2c5d049e89d8e71149445f4a0)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:40.945922 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc2c4d9-a2d9-457a-861a-63342be24835 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:41.029181 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-9bc2c4d9-a2d9-457a-861a-63342be24835 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c73a6eb2c5d049e89d8e71149445f4a0'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:41.030564 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-9bc2c4d9-a2d9-457a-861a-63342be24835 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c73a6eb2c5d049e89d8e71149445f4a0'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:41.040885 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-9bc2c4d9-a2d9-457a-861a-63342be24835 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c73a6eb2c5d049e89d8e71149445f4a0'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:41.056418 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-9bc2c4d9-a2d9-457a-861a-63342be24835 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c73a6eb2c5d049e89d8e71149445f4a0'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:41.058370 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-9bc2c4d9-a2d9-457a-861a-63342be24835 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c73a6eb2c5d049e89d8e71149445f4a0'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:41.091537 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 988/1980] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:00:40 2021] DELETE /identity/v3/users/c73a6eb2c5d049e89d8e71149445f4a0 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 05:00:41.096794 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b37c5-f50a-4275-b52f-1f20acd70107 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:41.099579 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b37c5-f50a-4275-b52f-1f20acd70107 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:41.100154 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b37c5-f50a-4275-b52f-1f20acd70107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:41.125289 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-250b37c5-f50a-4275-b52f-1f20acd70107 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:00:41.126519 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-250b37c5-f50a-4275-b52f-1f20acd70107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:41.203536 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 993/1981] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:00:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:00:41.214180 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2c4d9-a2d9-457a-861a-63342be24835 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:41.215634 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-9bc2c4d9-a2d9-457a-861a-63342be24835 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:41.277836 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2c4d9-a2d9-457a-861a-63342be24835 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:41.281569 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a3848-3592-43be-8481-c84fd2042d4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:41.282208 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a3848-3592-43be-8481-c84fd2042d4a service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:41.282473 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a3848-3592-43be-8481-c84fd2042d4a service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:41.282747 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a3848-3592-43be-8481-c84fd2042d4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:41.292222 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a3848-3592-43be-8481-c84fd2042d4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:41.293724 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a3848-3592-43be-8481-c84fd2042d4a service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:41.303747 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 989/1982] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:00:41 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:00:41.672025 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b37c5-f50a-4275-b52f-1f20acd70107 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:41.673808 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-250b37c5-f50a-4275-b52f-1f20acd70107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:41.688294 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b37c5-f50a-4275-b52f-1f20acd70107 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:41.693974 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d856d13-c134-4fe1-bbe5-08cc78fc3162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:41.695078 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d856d13-c134-4fe1-bbe5-08cc78fc3162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:41.696261 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d856d13-c134-4fe1-bbe5-08cc78fc3162 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:41.696788 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d856d13-c134-4fe1-bbe5-08cc78fc3162 admin admin] PATH_INFO: `/v3/projects/7d2eec5f9bc8467da13c92d8b94c95da` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:41.698382 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d856d13-c134-4fe1-bbe5-08cc78fc3162 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d2eec5f9bc8467da13c92d8b94c95da)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:41.701045 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d856d13-c134-4fe1-bbe5-08cc78fc3162 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:41.755674 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-4d856d13-c134-4fe1-bbe5-08cc78fc3162 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d2eec5f9bc8467da13c92d8b94c95da', 'request_id': 'req-4d856d13-c134-4fe1-bbe5-08cc78fc3162'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:41.765547 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-4d856d13-c134-4fe1-bbe5-08cc78fc3162 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d2eec5f9bc8467da13c92d8b94c95da', 'request_id': 'req-4d856d13-c134-4fe1-bbe5-08cc78fc3162'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:41.770990 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-4d856d13-c134-4fe1-bbe5-08cc78fc3162 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d2eec5f9bc8467da13c92d8b94c95da', 'request_id': 'req-4d856d13-c134-4fe1-bbe5-08cc78fc3162'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:41.782716 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-4d856d13-c134-4fe1-bbe5-08cc78fc3162 admin admin] The token cache is being invalidate because project 7d2eec5f9bc8467da13c92d8b94c95da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:00:41.783050 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-4d856d13-c134-4fe1-bbe5-08cc78fc3162 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:41.783708 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-4d856d13-c134-4fe1-bbe5-08cc78fc3162 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:41.785287 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 994/1983] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:00:41 2021] DELETE /identity/v3/projects/7d2eec5f9bc8467da13c92d8b94c95da => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:00:41.789370 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a3848-3592-43be-8481-c84fd2042d4a service neutron] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:41.802060 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a3848-3592-43be-8481-c84fd2042d4a service neutron] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:41.875250 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad6df4f-0eba-4c53-bf07-db882ead3b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:41.876136 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad6df4f-0eba-4c53-bf07-db882ead3b2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:41.876428 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad6df4f-0eba-4c53-bf07-db882ead3b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:41.876749 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad6df4f-0eba-4c53-bf07-db882ead3b2a admin admin] PATH_INFO: `/v3/users/2610c47faec24a6598e00010bd5ea9e9` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:41.878124 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad6df4f-0eba-4c53-bf07-db882ead3b2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2610c47faec24a6598e00010bd5ea9e9)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:41.880307 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad6df4f-0eba-4c53-bf07-db882ead3b2a admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:41.932128 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-1ad6df4f-0eba-4c53-bf07-db882ead3b2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2610c47faec24a6598e00010bd5ea9e9'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:41.933099 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-1ad6df4f-0eba-4c53-bf07-db882ead3b2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2610c47faec24a6598e00010bd5ea9e9'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:41.940254 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-1ad6df4f-0eba-4c53-bf07-db882ead3b2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2610c47faec24a6598e00010bd5ea9e9'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:41.951741 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-1ad6df4f-0eba-4c53-bf07-db882ead3b2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2610c47faec24a6598e00010bd5ea9e9'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:41.952392 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-1ad6df4f-0eba-4c53-bf07-db882ead3b2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2610c47faec24a6598e00010bd5ea9e9'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:41.976093 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 990/1984] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:00:41 2021] DELETE /identity/v3/users/2610c47faec24a6598e00010bd5ea9e9 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 05:00:42.257153 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d856d13-c134-4fe1-bbe5-08cc78fc3162 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:42.258601 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-4d856d13-c134-4fe1-bbe5-08cc78fc3162 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:42.274488 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d856d13-c134-4fe1-bbe5-08cc78fc3162 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:42.340983 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e98db-701a-4cf6-81b5-3dfbe9819c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:42.341883 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e98db-701a-4cf6-81b5-3dfbe9819c9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:42.342163 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e98db-701a-4cf6-81b5-3dfbe9819c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:42.342467 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e98db-701a-4cf6-81b5-3dfbe9819c9d admin admin] PATH_INFO: `/v3/projects/84b4911a56a34406b7d23c62a9503d1f` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:42.343902 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844e98db-701a-4cf6-81b5-3dfbe9819c9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=84b4911a56a34406b7d23c62a9503d1f)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:42.345889 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844e98db-701a-4cf6-81b5-3dfbe9819c9d admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:42.391686 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-844e98db-701a-4cf6-81b5-3dfbe9819c9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84b4911a56a34406b7d23c62a9503d1f', 'request_id': 'req-844e98db-701a-4cf6-81b5-3dfbe9819c9d'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:42.399675 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-844e98db-701a-4cf6-81b5-3dfbe9819c9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84b4911a56a34406b7d23c62a9503d1f', 'request_id': 'req-844e98db-701a-4cf6-81b5-3dfbe9819c9d'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:42.405746 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-844e98db-701a-4cf6-81b5-3dfbe9819c9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84b4911a56a34406b7d23c62a9503d1f', 'request_id': 'req-844e98db-701a-4cf6-81b5-3dfbe9819c9d'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:42.417638 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-844e98db-701a-4cf6-81b5-3dfbe9819c9d admin admin] The token cache is being invalidate because project 84b4911a56a34406b7d23c62a9503d1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:00:42.417924 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-844e98db-701a-4cf6-81b5-3dfbe9819c9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:42.418618 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-844e98db-701a-4cf6-81b5-3dfbe9819c9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:42.420206 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 995/1985] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:00:42 2021] DELETE /identity/v3/projects/84b4911a56a34406b7d23c62a9503d1f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:00:42.426645 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1086d1-fafa-4c5b-8ec9-297a4198f610 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:42.426957 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1086d1-fafa-4c5b-8ec9-297a4198f610 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:42.427231 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1086d1-fafa-4c5b-8ec9-297a4198f610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:42.445134 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-1b1086d1-fafa-4c5b-8ec9-297a4198f610 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:00:42.446337 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-1b1086d1-fafa-4c5b-8ec9-297a4198f610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:42.506047 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 991/1986] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:00:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:00:42.513769 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6b75f-9a94-4c49-be85-b3b01bf8ad66 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:42.514057 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6b75f-9a94-4c49-be85-b3b01bf8ad66 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:42.514335 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6b75f-9a94-4c49-be85-b3b01bf8ad66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:42.533360 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-5ba6b75f-9a94-4c49-be85-b3b01bf8ad66 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:00:42.534560 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-5ba6b75f-9a94-4c49-be85-b3b01bf8ad66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:42.542688 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 996/1987] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:00:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:00:42.547032 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1086d1-fafa-4c5b-8ec9-297a4198f610 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:42.556718 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1086d1-fafa-4c5b-8ec9-297a4198f610 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:42.561467 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c29792-cd45-4e0e-81fb-d1231cbce2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:42.562147 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c29792-cd45-4e0e-81fb-d1231cbce2a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:42.562428 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c29792-cd45-4e0e-81fb-d1231cbce2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:42.562706 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c29792-cd45-4e0e-81fb-d1231cbce2a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:42.563459 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c29792-cd45-4e0e-81fb-d1231cbce2a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 05:00:42.563766 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c29792-cd45-4e0e-81fb-d1231cbce2a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:42.565419 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c29792-cd45-4e0e-81fb-d1231cbce2a9 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:42.577505 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 992/1988] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 05:00:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 05:00:42.581835 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba6b75f-9a94-4c49-be85-b3b01bf8ad66 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:42.591580 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba6b75f-9a94-4c49-be85-b3b01bf8ad66 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:42.598181 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eb6365-b39e-4bd5-9875-9ca16e0191f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:42.598835 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb6365-b39e-4bd5-9875-9ca16e0191f0 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:42.599099 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb6365-b39e-4bd5-9875-9ca16e0191f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:42.599370 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb6365-b39e-4bd5-9875-9ca16e0191f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:42.600084 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eb6365-b39e-4bd5-9875-9ca16e0191f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:42.602011 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eb6365-b39e-4bd5-9875-9ca16e0191f0 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:42.629447 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 997/1989] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:00:42 2021] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 05:00:42.633832 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c29792-cd45-4e0e-81fb-d1231cbce2a9 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:42.644463 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c29792-cd45-4e0e-81fb-d1231cbce2a9 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:42.702568 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece693d-695a-4b36-bbca-778ad9133c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:42.703266 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece693d-695a-4b36-bbca-778ad9133c5d admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:42.703553 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece693d-695a-4b36-bbca-778ad9133c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:42.703827 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece693d-695a-4b36-bbca-778ad9133c5d admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:42.704537 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ece693d-695a-4b36-bbca-778ad9133c5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:42.706537 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ece693d-695a-4b36-bbca-778ad9133c5d admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:42.728465 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 993/1990] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:00:42 2021] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:00:42.732719 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eb6365-b39e-4bd5-9875-9ca16e0191f0 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:42.743092 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eb6365-b39e-4bd5-9875-9ca16e0191f0 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:42.748241 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7271d0-c78d-4e38-ac2e-8f6468c094b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:42.749142 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7271d0-c78d-4e38-ac2e-8f6468c094b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:42.749395 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7271d0-c78d-4e38-ac2e-8f6468c094b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:42.749666 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7271d0-c78d-4e38-ac2e-8f6468c094b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:42.750412 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7271d0-c78d-4e38-ac2e-8f6468c094b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:42.752057 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7271d0-c78d-4e38-ac2e-8f6468c094b2 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:42.762212 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 998/1991] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:00:42 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:00:42.766341 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece693d-695a-4b36-bbca-778ad9133c5d admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:42.776618 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece693d-695a-4b36-bbca-778ad9133c5d admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:42.783159 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a3723f-7b11-49a8-8bb0-36ab3f223f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:42.784127 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3723f-7b11-49a8-8bb0-36ab3f223f46 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:42.784571 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3723f-7b11-49a8-8bb0-36ab3f223f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:42.784967 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3723f-7b11-49a8-8bb0-36ab3f223f46 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:42.786079 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a3723f-7b11-49a8-8bb0-36ab3f223f46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:42.788701 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a3723f-7b11-49a8-8bb0-36ab3f223f46 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:42.804066 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 994/1992] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:00:42 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 24 05:00:42.810399 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7271d0-c78d-4e38-ac2e-8f6468c094b2 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:42.821278 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7271d0-c78d-4e38-ac2e-8f6468c094b2 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:42.827283 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dbf958-593d-47b2-99c4-c56d3491488b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:42.828169 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dbf958-593d-47b2-99c4-c56d3491488b admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:42.828445 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dbf958-593d-47b2-99c4-c56d3491488b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:42.828754 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dbf958-593d-47b2-99c4-c56d3491488b admin admin] PATH_INFO: `/v3/projects/ad65d8b82a234c3b9f8770c4f978252e/users/f7c5a82e05534929b55c32b9c15e7322/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:42.844753 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dbf958-593d-47b2-99c4-c56d3491488b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad65d8b82a234c3b9f8770c4f978252e, user_id=f7c5a82e05534929b55c32b9c15e7322, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:42.847330 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dbf958-593d-47b2-99c4-c56d3491488b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:42.861862 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 999/1993] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:00:42 2021] PUT /identity/v3/projects/ad65d8b82a234c3b9f8770c4f978252e/users/f7c5a82e05534929b55c32b9c15e7322/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:00:42.873096 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1c552-814e-48ad-b4ce-1f378dc67b6c None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:42.873388 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1c552-814e-48ad-b4ce-1f378dc67b6c None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:42.873665 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1c552-814e-48ad-b4ce-1f378dc67b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:42.901096 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-ecc1c552-814e-48ad-b4ce-1f378dc67b6c None None] MFA Rules not processed for user `f7c5a82e05534929b55c32b9c15e7322`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:00:42.902300 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-ecc1c552-814e-48ad-b4ce-1f378dc67b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:42.966561 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 995/1994] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:00:42 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:00:42.971414 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dbf958-593d-47b2-99c4-c56d3491488b admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:43.050566 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dbf958-593d-47b2-99c4-c56d3491488b admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:43.055161 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc6911e-9b4b-4952-a557-eca892ff3616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:43.055817 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6911e-9b4b-4952-a557-eca892ff3616 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:43.056096 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6911e-9b4b-4952-a557-eca892ff3616 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:43.056368 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6911e-9b4b-4952-a557-eca892ff3616 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:43.057105 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc6911e-9b4b-4952-a557-eca892ff3616 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:43.059024 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc6911e-9b4b-4952-a557-eca892ff3616 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:43.086175 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1000/1995] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:00:42 2021] POST /identity/v3/projects => generated 381 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:00:43.089995 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1c552-814e-48ad-b4ce-1f378dc67b6c None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:43.100626 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1c552-814e-48ad-b4ce-1f378dc67b6c None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:43.157148 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503188a6-e34d-4ed2-b746-1943d1f36f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:43.157827 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503188a6-e34d-4ed2-b746-1943d1f36f2c admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:43.158106 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503188a6-e34d-4ed2-b746-1943d1f36f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:43.158378 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503188a6-e34d-4ed2-b746-1943d1f36f2c admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:43.159086 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503188a6-e34d-4ed2-b746-1943d1f36f2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:43.161063 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503188a6-e34d-4ed2-b746-1943d1f36f2c admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:43.183402 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 996/1996] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:00:43 2021] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:00:43.188000 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc6911e-9b4b-4952-a557-eca892ff3616 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:43.198092 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc6911e-9b4b-4952-a557-eca892ff3616 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:43.203322 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f95713a-2273-42d1-8c19-921715409f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:43.203985 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95713a-2273-42d1-8c19-921715409f34 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:43.204266 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95713a-2273-42d1-8c19-921715409f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:43.204555 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95713a-2273-42d1-8c19-921715409f34 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:43.205321 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f95713a-2273-42d1-8c19-921715409f34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:43.206922 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f95713a-2273-42d1-8c19-921715409f34 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:43.219560 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1001/1997] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:00:43 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:00:43.222908 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503188a6-e34d-4ed2-b746-1943d1f36f2c admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:43.232821 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503188a6-e34d-4ed2-b746-1943d1f36f2c admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:43.237906 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3123d62-45fa-4aa4-8cd1-f6d0b74e149f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:43.238795 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3123d62-45fa-4aa4-8cd1-f6d0b74e149f admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:43.239063 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3123d62-45fa-4aa4-8cd1-f6d0b74e149f admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:43.239335 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3123d62-45fa-4aa4-8cd1-f6d0b74e149f admin admin] PATH_INFO: `/v3/projects/6ea90368b99d403da7e517abd9cac9aa/users/d6dea4a1b967453c870dbf9ad124fb9e/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:43.254231 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3123d62-45fa-4aa4-8cd1-f6d0b74e149f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ea90368b99d403da7e517abd9cac9aa, user_id=d6dea4a1b967453c870dbf9ad124fb9e, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:43.256919 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3123d62-45fa-4aa4-8cd1-f6d0b74e149f admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:43.271901 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 997/1998] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:00:43 2021] PUT /identity/v3/projects/6ea90368b99d403da7e517abd9cac9aa/users/d6dea4a1b967453c870dbf9ad124fb9e/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 05:00:43.276040 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f95713a-2273-42d1-8c19-921715409f34 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:43.286874 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f95713a-2273-42d1-8c19-921715409f34 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:43.347573 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d71324-d8fd-4136-8249-dc6c9c9bae47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:43.348248 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d71324-d8fd-4136-8249-dc6c9c9bae47 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:43.348553 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d71324-d8fd-4136-8249-dc6c9c9bae47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:43.348826 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d71324-d8fd-4136-8249-dc6c9c9bae47 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:43.349570 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d71324-d8fd-4136-8249-dc6c9c9bae47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:43.351226 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d71324-d8fd-4136-8249-dc6c9c9bae47 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:43.361028 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1002/1999] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:00:43 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:00:43.365217 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3123d62-45fa-4aa4-8cd1-f6d0b74e149f admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:43.375680 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3123d62-45fa-4aa4-8cd1-f6d0b74e149f admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:43.380580 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad894ae-775d-4d9f-ae6d-55de18053fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:43.381464 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad894ae-775d-4d9f-ae6d-55de18053fe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:43.381744 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad894ae-775d-4d9f-ae6d-55de18053fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:43.382018 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad894ae-775d-4d9f-ae6d-55de18053fe7 admin admin] PATH_INFO: `/v3/projects/6ea90368b99d403da7e517abd9cac9aa/users/d6dea4a1b967453c870dbf9ad124fb9e/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:43.384027 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad894ae-775d-4d9f-ae6d-55de18053fe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ea90368b99d403da7e517abd9cac9aa, user_id=d6dea4a1b967453c870dbf9ad124fb9e, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:43.386713 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad894ae-775d-4d9f-ae6d-55de18053fe7 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:43.397876 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 998/2000] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:00:43 2021] PUT /identity/v3/projects/6ea90368b99d403da7e517abd9cac9aa/users/d6dea4a1b967453c870dbf9ad124fb9e/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:00:43.409199 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d12d95d-12dc-47df-99d1-1b111d374f5a None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:43.409491 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d12d95d-12dc-47df-99d1-1b111d374f5a None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:43.409771 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d12d95d-12dc-47df-99d1-1b111d374f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:43.437537 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-7d12d95d-12dc-47df-99d1-1b111d374f5a None None] MFA Rules not processed for user `d6dea4a1b967453c870dbf9ad124fb9e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:00:43.438766 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-7d12d95d-12dc-47df-99d1-1b111d374f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:43.516137 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1003/2001] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:00:43 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:00:43.527556 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad894ae-775d-4d9f-ae6d-55de18053fe7 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:43.529393 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-0ad894ae-775d-4d9f-ae6d-55de18053fe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:43.585175 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad894ae-775d-4d9f-ae6d-55de18053fe7 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:43.589003 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd6676-5444-4f66-89a3-3f58c33ca707 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:43.589640 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd6676-5444-4f66-89a3-3f58c33ca707 service cinder] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:43.589925 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd6676-5444-4f66-89a3-3f58c33ca707 service cinder] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:43.590203 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd6676-5444-4f66-89a3-3f58c33ca707 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:43.600757 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd6676-5444-4f66-89a3-3f58c33ca707 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:43.602429 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd6676-5444-4f66-89a3-3f58c33ca707 service cinder] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:43.612952 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 999/2002] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:00:43 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:00:43.922975 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d12d95d-12dc-47df-99d1-1b111d374f5a None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:43.932581 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d12d95d-12dc-47df-99d1-1b111d374f5a None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:43.938202 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a187626c-ff58-456a-8d8a-124d3b32c35b tempest-VolumeQuotaClassesTest-2058358576 tempest-VolumeQuotaClassesTest-2058358576-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6dea4a1b967453c870dbf9ad124fb9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ea90368b99d403da7e517abd9cac9aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:43.938855 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187626c-ff58-456a-8d8a-124d3b32c35b tempest-VolumeQuotaClassesTest-2058358576 tempest-VolumeQuotaClassesTest-2058358576-project-admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:43.939147 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187626c-ff58-456a-8d8a-124d3b32c35b tempest-VolumeQuotaClassesTest-2058358576 tempest-VolumeQuotaClassesTest-2058358576-project-admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:43.939421 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187626c-ff58-456a-8d8a-124d3b32c35b tempest-VolumeQuotaClassesTest-2058358576 tempest-VolumeQuotaClassesTest-2058358576-project-admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:43.940170 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a187626c-ff58-456a-8d8a-124d3b32c35b tempest-VolumeQuotaClassesTest-2058358576 tempest-VolumeQuotaClassesTest-2058358576-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 05:00:43.940492 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a187626c-ff58-456a-8d8a-124d3b32c35b tempest-VolumeQuotaClassesTest-2058358576 tempest-VolumeQuotaClassesTest-2058358576-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:43.942115 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a187626c-ff58-456a-8d8a-124d3b32c35b tempest-VolumeQuotaClassesTest-2058358576 tempest-VolumeQuotaClassesTest-2058358576-project-admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:43.954292 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1004/2003] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 05:00:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 05:00:43.958620 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd6676-5444-4f66-89a3-3f58c33ca707 service cinder] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:43.968353 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd6676-5444-4f66-89a3-3f58c33ca707 service cinder] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:43.974221 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557cab40-16ac-48be-ac82-530e46a322f6 tempest-VolumeQuotaClassesTest-2058358576 tempest-VolumeQuotaClassesTest-2058358576-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6dea4a1b967453c870dbf9ad124fb9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ea90368b99d403da7e517abd9cac9aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:43.974867 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cab40-16ac-48be-ac82-530e46a322f6 tempest-VolumeQuotaClassesTest-2058358576 tempest-VolumeQuotaClassesTest-2058358576-project-admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:43.975155 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cab40-16ac-48be-ac82-530e46a322f6 tempest-VolumeQuotaClassesTest-2058358576 tempest-VolumeQuotaClassesTest-2058358576-project-admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:43.975424 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cab40-16ac-48be-ac82-530e46a322f6 tempest-VolumeQuotaClassesTest-2058358576 tempest-VolumeQuotaClassesTest-2058358576-project-admin] PATH_INFO: `/v3/projects` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:43.976159 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557cab40-16ac-48be-ac82-530e46a322f6 tempest-VolumeQuotaClassesTest-2058358576 tempest-VolumeQuotaClassesTest-2058358576-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:43.978091 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557cab40-16ac-48be-ac82-530e46a322f6 tempest-VolumeQuotaClassesTest-2058358576 tempest-VolumeQuotaClassesTest-2058358576-project-admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:44.008043 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1000/2004] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:00:43 2021] POST /identity/v3/projects => generated 354 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:00:44.010508 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a187626c-ff58-456a-8d8a-124d3b32c35b tempest-VolumeQuotaClassesTest-2058358576 tempest-VolumeQuotaClassesTest-2058358576-project-admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:44.020849 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a187626c-ff58-456a-8d8a-124d3b32c35b tempest-VolumeQuotaClassesTest-2058358576 tempest-VolumeQuotaClassesTest-2058358576-project-admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:44.086887 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7526d1-0136-4b65-9c4e-2b937fa634d5 tempest-VolumeQuotaClassesTest-2058358576 tempest-VolumeQuotaClassesTest-2058358576-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6dea4a1b967453c870dbf9ad124fb9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ea90368b99d403da7e517abd9cac9aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:44.087563 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7526d1-0136-4b65-9c4e-2b937fa634d5 tempest-VolumeQuotaClassesTest-2058358576 tempest-VolumeQuotaClassesTest-2058358576-project-admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:44.087850 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7526d1-0136-4b65-9c4e-2b937fa634d5 tempest-VolumeQuotaClassesTest-2058358576 tempest-VolumeQuotaClassesTest-2058358576-project-admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:44.088129 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7526d1-0136-4b65-9c4e-2b937fa634d5 tempest-VolumeQuotaClassesTest-2058358576 tempest-VolumeQuotaClassesTest-2058358576-project-admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:44.088907 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7526d1-0136-4b65-9c4e-2b937fa634d5 tempest-VolumeQuotaClassesTest-2058358576 tempest-VolumeQuotaClassesTest-2058358576-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 05:00:44.089218 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7526d1-0136-4b65-9c4e-2b937fa634d5 tempest-VolumeQuotaClassesTest-2058358576 tempest-VolumeQuotaClassesTest-2058358576-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:44.090933 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7526d1-0136-4b65-9c4e-2b937fa634d5 tempest-VolumeQuotaClassesTest-2058358576 tempest-VolumeQuotaClassesTest-2058358576-project-admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:44.103171 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1005/2005] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 05:00:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 05:00:44.140433 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557cab40-16ac-48be-ac82-530e46a322f6 tempest-VolumeQuotaClassesTest-2058358576 tempest-VolumeQuotaClassesTest-2058358576-project-admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:44.154235 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557cab40-16ac-48be-ac82-530e46a322f6 tempest-VolumeQuotaClassesTest-2058358576 tempest-VolumeQuotaClassesTest-2058358576-project-admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:44.159330 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58543d0-e43b-46c9-ae41-f1c9dae07515 tempest-VolumeQuotaClassesTest-2058358576 tempest-VolumeQuotaClassesTest-2058358576-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6dea4a1b967453c870dbf9ad124fb9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ea90368b99d403da7e517abd9cac9aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:44.160209 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58543d0-e43b-46c9-ae41-f1c9dae07515 tempest-VolumeQuotaClassesTest-2058358576 tempest-VolumeQuotaClassesTest-2058358576-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:44.160505 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58543d0-e43b-46c9-ae41-f1c9dae07515 tempest-VolumeQuotaClassesTest-2058358576 tempest-VolumeQuotaClassesTest-2058358576-project-admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:44.160841 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58543d0-e43b-46c9-ae41-f1c9dae07515 tempest-VolumeQuotaClassesTest-2058358576 tempest-VolumeQuotaClassesTest-2058358576-project-admin] PATH_INFO: `/v3/projects/d471b62fd0cd43cf837d3634c43fe875` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:44.162110 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58543d0-e43b-46c9-ae41-f1c9dae07515 tempest-VolumeQuotaClassesTest-2058358576 tempest-VolumeQuotaClassesTest-2058358576-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d471b62fd0cd43cf837d3634c43fe875)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:44.164056 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58543d0-e43b-46c9-ae41-f1c9dae07515 tempest-VolumeQuotaClassesTest-2058358576 tempest-VolumeQuotaClassesTest-2058358576-project-admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:44.211839 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-d58543d0-e43b-46c9-ae41-f1c9dae07515 tempest-VolumeQuotaClassesTest-2058358576 tempest-VolumeQuotaClassesTest-2058358576-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd471b62fd0cd43cf837d3634c43fe875', 'request_id': 'req-d58543d0-e43b-46c9-ae41-f1c9dae07515'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:44.219609 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-d58543d0-e43b-46c9-ae41-f1c9dae07515 tempest-VolumeQuotaClassesTest-2058358576 tempest-VolumeQuotaClassesTest-2058358576-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd471b62fd0cd43cf837d3634c43fe875', 'request_id': 'req-d58543d0-e43b-46c9-ae41-f1c9dae07515'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:44.225515 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-d58543d0-e43b-46c9-ae41-f1c9dae07515 tempest-VolumeQuotaClassesTest-2058358576 tempest-VolumeQuotaClassesTest-2058358576-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd471b62fd0cd43cf837d3634c43fe875', 'request_id': 'req-d58543d0-e43b-46c9-ae41-f1c9dae07515'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:44.237645 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-d58543d0-e43b-46c9-ae41-f1c9dae07515 tempest-VolumeQuotaClassesTest-2058358576 tempest-VolumeQuotaClassesTest-2058358576-project-admin] The token cache is being invalidate because project d471b62fd0cd43cf837d3634c43fe875 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:00:44.237935 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-d58543d0-e43b-46c9-ae41-f1c9dae07515 tempest-VolumeQuotaClassesTest-2058358576 tempest-VolumeQuotaClassesTest-2058358576-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:44.238590 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-d58543d0-e43b-46c9-ae41-f1c9dae07515 tempest-VolumeQuotaClassesTest-2058358576 tempest-VolumeQuotaClassesTest-2058358576-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:44.240189 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1001/2006] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:00:44 2021] DELETE /identity/v3/projects/d471b62fd0cd43cf837d3634c43fe875 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:00:44.439619 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7526d1-0136-4b65-9c4e-2b937fa634d5 tempest-VolumeQuotaClassesTest-2058358576 tempest-VolumeQuotaClassesTest-2058358576-project-admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:44.441512 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-8b7526d1-0136-4b65-9c4e-2b937fa634d5 tempest-VolumeQuotaClassesTest-2058358576 tempest-VolumeQuotaClassesTest-2058358576-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:44.508570 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7526d1-0136-4b65-9c4e-2b937fa634d5 tempest-VolumeQuotaClassesTest-2058358576 tempest-VolumeQuotaClassesTest-2058358576-project-admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:44.567207 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377e923-81f4-4b7f-936d-fb34251ef405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:44.568090 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377e923-81f4-4b7f-936d-fb34251ef405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:44.568368 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377e923-81f4-4b7f-936d-fb34251ef405 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:44.568768 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377e923-81f4-4b7f-936d-fb34251ef405 admin admin] PATH_INFO: `/v3/users/f7c5a82e05534929b55c32b9c15e7322` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:44.570125 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a377e923-81f4-4b7f-936d-fb34251ef405 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7c5a82e05534929b55c32b9c15e7322)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:44.572052 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a377e923-81f4-4b7f-936d-fb34251ef405 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:44.620321 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-a377e923-81f4-4b7f-936d-fb34251ef405 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7c5a82e05534929b55c32b9c15e7322'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:44.620985 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-a377e923-81f4-4b7f-936d-fb34251ef405 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7c5a82e05534929b55c32b9c15e7322'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:44.629149 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-a377e923-81f4-4b7f-936d-fb34251ef405 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7c5a82e05534929b55c32b9c15e7322'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:44.636098 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-a377e923-81f4-4b7f-936d-fb34251ef405 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7c5a82e05534929b55c32b9c15e7322'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:44.648188 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-a377e923-81f4-4b7f-936d-fb34251ef405 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7c5a82e05534929b55c32b9c15e7322'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:44.654495 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1006/2007] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:00:44 2021] DELETE /identity/v3/users/f7c5a82e05534929b55c32b9c15e7322 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:00:44.659363 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ff346-3669-4cd5-8f14-b1b55ee2e6e9 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:44.659651 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ff346-3669-4cd5-8f14-b1b55ee2e6e9 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:44.659923 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ff346-3669-4cd5-8f14-b1b55ee2e6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:44.678127 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-5c8ff346-3669-4cd5-8f14-b1b55ee2e6e9 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:00:44.679411 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-5c8ff346-3669-4cd5-8f14-b1b55ee2e6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:44.736076 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1002/2008] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:00:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 05:00:44.746148 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377e923-81f4-4b7f-936d-fb34251ef405 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:44.747825 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-a377e923-81f4-4b7f-936d-fb34251ef405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:44.821482 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377e923-81f4-4b7f-936d-fb34251ef405 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:44.826405 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590fe15c-d6f7-4692-b2c1-ade59034ac70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:44.827291 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590fe15c-d6f7-4692-b2c1-ade59034ac70 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:44.827656 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590fe15c-d6f7-4692-b2c1-ade59034ac70 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:44.827954 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590fe15c-d6f7-4692-b2c1-ade59034ac70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:44.838931 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590fe15c-d6f7-4692-b2c1-ade59034ac70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:44.840390 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590fe15c-d6f7-4692-b2c1-ade59034ac70 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:44.850788 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1007/2009] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:00:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:00:45.118649 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8ff346-3669-4cd5-8f14-b1b55ee2e6e9 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:45.120222 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-5c8ff346-3669-4cd5-8f14-b1b55ee2e6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:45.134567 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8ff346-3669-4cd5-8f14-b1b55ee2e6e9 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:45.150244 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968cd517-1bf3-4d26-b564-d82396a35610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:45.151653 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968cd517-1bf3-4d26-b564-d82396a35610 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:45.152121 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968cd517-1bf3-4d26-b564-d82396a35610 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:45.152642 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968cd517-1bf3-4d26-b564-d82396a35610 admin admin] PATH_INFO: `/v3/projects/ad65d8b82a234c3b9f8770c4f978252e` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:45.154808 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968cd517-1bf3-4d26-b564-d82396a35610 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad65d8b82a234c3b9f8770c4f978252e)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:45.157270 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968cd517-1bf3-4d26-b564-d82396a35610 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:45.206012 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-968cd517-1bf3-4d26-b564-d82396a35610 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad65d8b82a234c3b9f8770c4f978252e', 'request_id': 'req-968cd517-1bf3-4d26-b564-d82396a35610'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:45.214889 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-968cd517-1bf3-4d26-b564-d82396a35610 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad65d8b82a234c3b9f8770c4f978252e', 'request_id': 'req-968cd517-1bf3-4d26-b564-d82396a35610'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:45.220812 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-968cd517-1bf3-4d26-b564-d82396a35610 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad65d8b82a234c3b9f8770c4f978252e', 'request_id': 'req-968cd517-1bf3-4d26-b564-d82396a35610'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:45.231534 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-968cd517-1bf3-4d26-b564-d82396a35610 admin admin] The token cache is being invalidate because project ad65d8b82a234c3b9f8770c4f978252e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:00:45.231820 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-968cd517-1bf3-4d26-b564-d82396a35610 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:45.232452 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-968cd517-1bf3-4d26-b564-d82396a35610 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:45.234136 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1003/2010] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:00:45 2021] DELETE /identity/v3/projects/ad65d8b82a234c3b9f8770c4f978252e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:00:45.238111 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590fe15c-d6f7-4692-b2c1-ade59034ac70 service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:45.247338 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590fe15c-d6f7-4692-b2c1-ade59034ac70 service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:45.304908 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a61ba05-991b-45b2-af33-d8c1dabd8334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:45.305776 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61ba05-991b-45b2-af33-d8c1dabd8334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:45.306169 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61ba05-991b-45b2-af33-d8c1dabd8334 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:45.306453 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61ba05-991b-45b2-af33-d8c1dabd8334 admin admin] PATH_INFO: `/v3/users/d6dea4a1b967453c870dbf9ad124fb9e` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:45.307729 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a61ba05-991b-45b2-af33-d8c1dabd8334 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6dea4a1b967453c870dbf9ad124fb9e)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:45.309697 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a61ba05-991b-45b2-af33-d8c1dabd8334 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:45.363670 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-0a61ba05-991b-45b2-af33-d8c1dabd8334 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6dea4a1b967453c870dbf9ad124fb9e'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:45.364441 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-0a61ba05-991b-45b2-af33-d8c1dabd8334 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6dea4a1b967453c870dbf9ad124fb9e'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:45.372461 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-0a61ba05-991b-45b2-af33-d8c1dabd8334 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6dea4a1b967453c870dbf9ad124fb9e'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:45.379763 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-0a61ba05-991b-45b2-af33-d8c1dabd8334 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6dea4a1b967453c870dbf9ad124fb9e'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:45.393441 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-0a61ba05-991b-45b2-af33-d8c1dabd8334 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6dea4a1b967453c870dbf9ad124fb9e'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:45.400153 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1008/2011] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:00:45 2021] DELETE /identity/v3/users/d6dea4a1b967453c870dbf9ad124fb9e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:00:45.671603 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968cd517-1bf3-4d26-b564-d82396a35610 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:45.673083 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-968cd517-1bf3-4d26-b564-d82396a35610 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:45.687110 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968cd517-1bf3-4d26-b564-d82396a35610 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:45.747829 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72537eb8-0f47-4bc1-bd66-41e9cf862fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:45.748632 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72537eb8-0f47-4bc1-bd66-41e9cf862fdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:45.749084 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72537eb8-0f47-4bc1-bd66-41e9cf862fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:45.749489 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72537eb8-0f47-4bc1-bd66-41e9cf862fdf admin admin] PATH_INFO: `/v3/projects/6ea90368b99d403da7e517abd9cac9aa` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:45.750978 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72537eb8-0f47-4bc1-bd66-41e9cf862fdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ea90368b99d403da7e517abd9cac9aa)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:45.752927 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72537eb8-0f47-4bc1-bd66-41e9cf862fdf admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:45.798848 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-72537eb8-0f47-4bc1-bd66-41e9cf862fdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ea90368b99d403da7e517abd9cac9aa', 'request_id': 'req-72537eb8-0f47-4bc1-bd66-41e9cf862fdf'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:45.807096 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-72537eb8-0f47-4bc1-bd66-41e9cf862fdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ea90368b99d403da7e517abd9cac9aa', 'request_id': 'req-72537eb8-0f47-4bc1-bd66-41e9cf862fdf'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:45.813052 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-72537eb8-0f47-4bc1-bd66-41e9cf862fdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ea90368b99d403da7e517abd9cac9aa', 'request_id': 'req-72537eb8-0f47-4bc1-bd66-41e9cf862fdf'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:45.824034 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-72537eb8-0f47-4bc1-bd66-41e9cf862fdf admin admin] The token cache is being invalidate because project 6ea90368b99d403da7e517abd9cac9aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:00:45.824317 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-72537eb8-0f47-4bc1-bd66-41e9cf862fdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:45.824982 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-72537eb8-0f47-4bc1-bd66-41e9cf862fdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:45.826592 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1004/2012] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:00:45 2021] DELETE /identity/v3/projects/6ea90368b99d403da7e517abd9cac9aa => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 05:00:45.832425 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaada2b-0306-4d66-9e32-862e4e919392 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:45.832986 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaada2b-0306-4d66-9e32-862e4e919392 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:45.833272 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaada2b-0306-4d66-9e32-862e4e919392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:45.852599 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-beaada2b-0306-4d66-9e32-862e4e919392 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:00:45.854108 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-beaada2b-0306-4d66-9e32-862e4e919392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:45.913056 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1009/2013] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:00:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 05:00:45.922381 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f83853-891e-4f85-b5a0-fc9ff0c3d6e5 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:45.922668 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f83853-891e-4f85-b5a0-fc9ff0c3d6e5 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:45.922942 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f83853-891e-4f85-b5a0-fc9ff0c3d6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:45.942373 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-a0f83853-891e-4f85-b5a0-fc9ff0c3d6e5 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:00:45.943544 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-a0f83853-891e-4f85-b5a0-fc9ff0c3d6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:45.953737 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1005/2014] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:00:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:00:45.960174 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaada2b-0306-4d66-9e32-862e4e919392 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:45.975722 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaada2b-0306-4d66-9e32-862e4e919392 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:45.983916 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81971a2c-4178-4912-bc22-19b3addfd03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:45.984570 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81971a2c-4178-4912-bc22-19b3addfd03e admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:45.984880 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81971a2c-4178-4912-bc22-19b3addfd03e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:45.985154 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81971a2c-4178-4912-bc22-19b3addfd03e admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:45.985890 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81971a2c-4178-4912-bc22-19b3addfd03e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 05:00:45.986175 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81971a2c-4178-4912-bc22-19b3addfd03e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:45.987765 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81971a2c-4178-4912-bc22-19b3addfd03e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:46.000114 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1010/2015] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 05:00:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 05:00:46.004672 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f83853-891e-4f85-b5a0-fc9ff0c3d6e5 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:46.013887 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f83853-891e-4f85-b5a0-fc9ff0c3d6e5 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:46.019823 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd703cee-9615-4c64-8d6d-f97cada05806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:46.020489 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd703cee-9615-4c64-8d6d-f97cada05806 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:46.020814 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd703cee-9615-4c64-8d6d-f97cada05806 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:46.021085 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd703cee-9615-4c64-8d6d-f97cada05806 admin admin] PATH_INFO: `/v3/projects` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:46.021793 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd703cee-9615-4c64-8d6d-f97cada05806 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:46.023753 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd703cee-9615-4c64-8d6d-f97cada05806 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:46.055010 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1006/2016] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:00:46 2021] POST /identity/v3/projects => generated 389 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:00:46.056259 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81971a2c-4178-4912-bc22-19b3addfd03e admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:46.067066 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81971a2c-4178-4912-bc22-19b3addfd03e admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:46.125193 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c589f3-2dee-4de7-9acc-dac6112065ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:46.125874 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c589f3-2dee-4de7-9acc-dac6112065ac admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:46.126156 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c589f3-2dee-4de7-9acc-dac6112065ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:46.126423 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c589f3-2dee-4de7-9acc-dac6112065ac admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:46.127144 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c589f3-2dee-4de7-9acc-dac6112065ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:46.129771 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c589f3-2dee-4de7-9acc-dac6112065ac admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:46.159559 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1011/2017] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:00:46 2021] POST /identity/v3/users => generated 295 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:00:46.161144 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd703cee-9615-4c64-8d6d-f97cada05806 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:46.174369 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd703cee-9615-4c64-8d6d-f97cada05806 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:46.180970 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822676d5-5dc2-44d2-a298-fbcb313a1cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:46.181633 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822676d5-5dc2-44d2-a298-fbcb313a1cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:46.181910 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822676d5-5dc2-44d2-a298-fbcb313a1cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:46.182340 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822676d5-5dc2-44d2-a298-fbcb313a1cf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:46.183091 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822676d5-5dc2-44d2-a298-fbcb313a1cf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:46.184758 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822676d5-5dc2-44d2-a298-fbcb313a1cf0 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:46.197909 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1007/2018] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:00:46 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 24 05:00:46.203749 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c589f3-2dee-4de7-9acc-dac6112065ac admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:46.214672 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c589f3-2dee-4de7-9acc-dac6112065ac admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:46.220072 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a469e55-c81e-42a3-9df1-df468aeb6765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:46.220768 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a469e55-c81e-42a3-9df1-df468aeb6765 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:46.221015 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a469e55-c81e-42a3-9df1-df468aeb6765 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:46.221331 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a469e55-c81e-42a3-9df1-df468aeb6765 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:46.222028 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a469e55-c81e-42a3-9df1-df468aeb6765 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:46.223761 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a469e55-c81e-42a3-9df1-df468aeb6765 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:46.234804 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1012/2019] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:00:46 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:00:46.240072 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822676d5-5dc2-44d2-a298-fbcb313a1cf0 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:46.256550 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822676d5-5dc2-44d2-a298-fbcb313a1cf0 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:46.265007 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a6a992-0aae-40d2-960b-3a847c131f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:46.265902 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6a992-0aae-40d2-960b-3a847c131f51 admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:46.266192 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6a992-0aae-40d2-960b-3a847c131f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:46.266486 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6a992-0aae-40d2-960b-3a847c131f51 admin admin] PATH_INFO: `/v3/projects/bafc35c85a7a49a68ec6d701e29f2db6/users/ad1e1a4532004fc199262fedb871ed3a/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:46.281411 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a6a992-0aae-40d2-960b-3a847c131f51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bafc35c85a7a49a68ec6d701e29f2db6, user_id=ad1e1a4532004fc199262fedb871ed3a, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:46.284094 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a6a992-0aae-40d2-960b-3a847c131f51 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:46.298214 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1008/2020] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:00:46 2021] PUT /identity/v3/projects/bafc35c85a7a49a68ec6d701e29f2db6/users/ad1e1a4532004fc199262fedb871ed3a/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:00:46.308470 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f702c-7dda-4543-9c7e-19ee94b18cc8 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:46.308816 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f702c-7dda-4543-9c7e-19ee94b18cc8 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:46.309094 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f702c-7dda-4543-9c7e-19ee94b18cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:46.337955 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-625f702c-7dda-4543-9c7e-19ee94b18cc8 None None] MFA Rules not processed for user `ad1e1a4532004fc199262fedb871ed3a`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:00:46.339149 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-625f702c-7dda-4543-9c7e-19ee94b18cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:46.415058 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1013/2021] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:00:46 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:00:46.416308 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a6a992-0aae-40d2-960b-3a847c131f51 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:46.492146 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a6a992-0aae-40d2-960b-3a847c131f51 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:46.497012 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c306d2-e934-4cb7-8994-565b9d5b053b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:46.497676 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c306d2-e934-4cb7-8994-565b9d5b053b admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:46.497954 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c306d2-e934-4cb7-8994-565b9d5b053b admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:46.498222 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c306d2-e934-4cb7-8994-565b9d5b053b admin admin] PATH_INFO: `/v3/projects` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:46.499008 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c306d2-e934-4cb7-8994-565b9d5b053b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:46.501139 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c306d2-e934-4cb7-8994-565b9d5b053b admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:46.533098 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1009/2022] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:00:46 2021] POST /identity/v3/projects => generated 387 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:00:46.537403 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625f702c-7dda-4543-9c7e-19ee94b18cc8 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:46.549178 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625f702c-7dda-4543-9c7e-19ee94b18cc8 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:46.612862 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915cb32-2a44-4dca-b0f4-e4691b021a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:46.613940 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915cb32-2a44-4dca-b0f4-e4691b021a6f admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:46.614230 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915cb32-2a44-4dca-b0f4-e4691b021a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:46.614481 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915cb32-2a44-4dca-b0f4-e4691b021a6f admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:46.615423 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e915cb32-2a44-4dca-b0f4-e4691b021a6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:46.617888 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e915cb32-2a44-4dca-b0f4-e4691b021a6f admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:46.641844 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1014/2023] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:00:46 2021] POST /identity/v3/users => generated 300 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:00:46.646467 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c306d2-e934-4cb7-8994-565b9d5b053b admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:46.660429 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c306d2-e934-4cb7-8994-565b9d5b053b admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:46.667396 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a3ca8-c160-43f5-a280-96d0913e1070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:46.668079 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a3ca8-c160-43f5-a280-96d0913e1070 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:46.668362 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a3ca8-c160-43f5-a280-96d0913e1070 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:46.668701 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a3ca8-c160-43f5-a280-96d0913e1070 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:46.669474 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845a3ca8-c160-43f5-a280-96d0913e1070 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:46.671990 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845a3ca8-c160-43f5-a280-96d0913e1070 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:46.684717 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1010/2024] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:00:46 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:00:46.689137 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915cb32-2a44-4dca-b0f4-e4691b021a6f admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:46.700742 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915cb32-2a44-4dca-b0f4-e4691b021a6f admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:46.707610 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec80fe-e4e3-4599-af5a-011251fec022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:46.708508 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec80fe-e4e3-4599-af5a-011251fec022 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:46.708846 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec80fe-e4e3-4599-af5a-011251fec022 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:46.709116 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec80fe-e4e3-4599-af5a-011251fec022 admin admin] PATH_INFO: `/v3/projects/4fbe98a4f34d458294c3c18dcc42013e/users/799ad9d910c54f3cbc1834f7e9e17f7a/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:46.728057 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aec80fe-e4e3-4599-af5a-011251fec022 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fbe98a4f34d458294c3c18dcc42013e, user_id=799ad9d910c54f3cbc1834f7e9e17f7a, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:46.731198 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aec80fe-e4e3-4599-af5a-011251fec022 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:46.748511 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1015/2025] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:00:46 2021] PUT /identity/v3/projects/4fbe98a4f34d458294c3c18dcc42013e/users/799ad9d910c54f3cbc1834f7e9e17f7a/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:00:46.754419 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a3ca8-c160-43f5-a280-96d0913e1070 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:46.772460 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a3ca8-c160-43f5-a280-96d0913e1070 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:46.831689 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ebae29-03d3-4c34-8eff-f731080ba95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:46.832722 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ebae29-03d3-4c34-8eff-f731080ba95f admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:46.833042 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ebae29-03d3-4c34-8eff-f731080ba95f admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:46.833338 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ebae29-03d3-4c34-8eff-f731080ba95f admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:46.834149 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ebae29-03d3-4c34-8eff-f731080ba95f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:46.836084 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ebae29-03d3-4c34-8eff-f731080ba95f admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:46.846905 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1011/2026] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:00:46 2021] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 24 05:00:46.851460 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec80fe-e4e3-4599-af5a-011251fec022 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:46.864756 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec80fe-e4e3-4599-af5a-011251fec022 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:46.870677 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138aa392-6de2-4df3-a698-6eb64cf29449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:46.871626 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138aa392-6de2-4df3-a698-6eb64cf29449 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:46.871825 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138aa392-6de2-4df3-a698-6eb64cf29449 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:46.872105 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138aa392-6de2-4df3-a698-6eb64cf29449 admin admin] PATH_INFO: `/v3/projects/4fbe98a4f34d458294c3c18dcc42013e/users/799ad9d910c54f3cbc1834f7e9e17f7a/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:46.874741 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138aa392-6de2-4df3-a698-6eb64cf29449 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fbe98a4f34d458294c3c18dcc42013e, user_id=799ad9d910c54f3cbc1834f7e9e17f7a, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:46.878043 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138aa392-6de2-4df3-a698-6eb64cf29449 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:46.893052 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1016/2027] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:00:46 2021] PUT /identity/v3/projects/4fbe98a4f34d458294c3c18dcc42013e/users/799ad9d910c54f3cbc1834f7e9e17f7a/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:00:46.903920 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26ce57-f3e4-4939-b423-998de1e55a36 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:46.904184 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26ce57-f3e4-4939-b423-998de1e55a36 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:46.904484 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26ce57-f3e4-4939-b423-998de1e55a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:46.936918 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-4b26ce57-f3e4-4939-b423-998de1e55a36 None None] MFA Rules not processed for user `799ad9d910c54f3cbc1834f7e9e17f7a`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:00:46.938222 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-4b26ce57-f3e4-4939-b423-998de1e55a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:47.024269 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1012/2028] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:00:46 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:00:47.034877 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138aa392-6de2-4df3-a698-6eb64cf29449 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:47.037053 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-138aa392-6de2-4df3-a698-6eb64cf29449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:47.100196 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138aa392-6de2-4df3-a698-6eb64cf29449 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:47.104568 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53469eba-284c-4ac0-b667-a75fdde1773d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:47.105316 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53469eba-284c-4ac0-b667-a75fdde1773d service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:47.105568 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53469eba-284c-4ac0-b667-a75fdde1773d service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:47.105840 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53469eba-284c-4ac0-b667-a75fdde1773d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:47.116209 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53469eba-284c-4ac0-b667-a75fdde1773d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:47.117672 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53469eba-284c-4ac0-b667-a75fdde1773d service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:47.128049 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1017/2029] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:00:47 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:00:47.272537 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b26ce57-f3e4-4939-b423-998de1e55a36 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:47.344411 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b26ce57-f3e4-4939-b423-998de1e55a36 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:47.349260 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c2cc4-721c-4e79-8ab0-838ea17a0bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:47.350130 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c2cc4-721c-4e79-8ab0-838ea17a0bf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:47.350408 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c2cc4-721c-4e79-8ab0-838ea17a0bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:47.350680 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c2cc4-721c-4e79-8ab0-838ea17a0bf7 admin admin] PATH_INFO: `/v3/users/ad1e1a4532004fc199262fedb871ed3a` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:47.357696 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2c2cc4-721c-4e79-8ab0-838ea17a0bf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad1e1a4532004fc199262fedb871ed3a)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:47.359784 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2c2cc4-721c-4e79-8ab0-838ea17a0bf7 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:47.408933 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-cd2c2cc4-721c-4e79-8ab0-838ea17a0bf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad1e1a4532004fc199262fedb871ed3a'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:47.409646 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-cd2c2cc4-721c-4e79-8ab0-838ea17a0bf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad1e1a4532004fc199262fedb871ed3a'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:47.416822 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-cd2c2cc4-721c-4e79-8ab0-838ea17a0bf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad1e1a4532004fc199262fedb871ed3a'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:47.426540 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-cd2c2cc4-721c-4e79-8ab0-838ea17a0bf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad1e1a4532004fc199262fedb871ed3a'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:47.427219 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-cd2c2cc4-721c-4e79-8ab0-838ea17a0bf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad1e1a4532004fc199262fedb871ed3a'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:47.444688 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1013/2030] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:00:47 2021] DELETE /identity/v3/users/ad1e1a4532004fc199262fedb871ed3a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:00:47.449320 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0044fac-226c-4960-9461-d9348d8a8f16 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:47.449605 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0044fac-226c-4960-9461-d9348d8a8f16 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:47.449900 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0044fac-226c-4960-9461-d9348d8a8f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:47.469199 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-e0044fac-226c-4960-9461-d9348d8a8f16 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:00:47.470453 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-e0044fac-226c-4960-9461-d9348d8a8f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:47.536454 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1018/2031] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:00:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:00:47.548720 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c2cc4-721c-4e79-8ab0-838ea17a0bf7 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:47.548720 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-cd2c2cc4-721c-4e79-8ab0-838ea17a0bf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:47.606628 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c2cc4-721c-4e79-8ab0-838ea17a0bf7 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:47.610386 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c78151-7b07-421a-b373-a22eb251a2df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:47.611071 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c78151-7b07-421a-b373-a22eb251a2df service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:47.611358 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c78151-7b07-421a-b373-a22eb251a2df service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:47.611630 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c78151-7b07-421a-b373-a22eb251a2df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:47.620965 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c78151-7b07-421a-b373-a22eb251a2df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:47.622453 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c78151-7b07-421a-b373-a22eb251a2df service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:47.632103 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1014/2032] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:00:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:00:47.964242 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0044fac-226c-4960-9461-d9348d8a8f16 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:47.965769 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-e0044fac-226c-4960-9461-d9348d8a8f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:47.981176 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0044fac-226c-4960-9461-d9348d8a8f16 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:47.988464 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72e377-6469-4cc3-8bf1-813ef19faacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:47.989319 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72e377-6469-4cc3-8bf1-813ef19faacc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:47.989584 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72e377-6469-4cc3-8bf1-813ef19faacc admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:47.989948 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72e377-6469-4cc3-8bf1-813ef19faacc admin admin] PATH_INFO: `/v3/projects/bafc35c85a7a49a68ec6d701e29f2db6` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:47.991155 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c72e377-6469-4cc3-8bf1-813ef19faacc admin admin] RBAC: Authorizing `identity:delete_project(project_id=bafc35c85a7a49a68ec6d701e29f2db6)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:47.993140 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c72e377-6469-4cc3-8bf1-813ef19faacc admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:48.042594 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-3c72e377-6469-4cc3-8bf1-813ef19faacc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bafc35c85a7a49a68ec6d701e29f2db6', 'request_id': 'req-3c72e377-6469-4cc3-8bf1-813ef19faacc'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:48.052429 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-3c72e377-6469-4cc3-8bf1-813ef19faacc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bafc35c85a7a49a68ec6d701e29f2db6', 'request_id': 'req-3c72e377-6469-4cc3-8bf1-813ef19faacc'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:48.059595 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-3c72e377-6469-4cc3-8bf1-813ef19faacc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bafc35c85a7a49a68ec6d701e29f2db6', 'request_id': 'req-3c72e377-6469-4cc3-8bf1-813ef19faacc'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:48.071954 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-3c72e377-6469-4cc3-8bf1-813ef19faacc admin admin] The token cache is being invalidate because project bafc35c85a7a49a68ec6d701e29f2db6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:00:48.072244 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-3c72e377-6469-4cc3-8bf1-813ef19faacc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:48.072927 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-3c72e377-6469-4cc3-8bf1-813ef19faacc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:48.074489 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1019/2033] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:00:47 2021] DELETE /identity/v3/projects/bafc35c85a7a49a68ec6d701e29f2db6 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:00:48.079189 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c78151-7b07-421a-b373-a22eb251a2df service neutron] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:48.089470 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c78151-7b07-421a-b373-a22eb251a2df service neutron] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:48.146933 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e406a3-191b-40e2-8d31-3bda2f958fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:48.147723 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e406a3-191b-40e2-8d31-3bda2f958fa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:48.148001 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e406a3-191b-40e2-8d31-3bda2f958fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:48.148279 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e406a3-191b-40e2-8d31-3bda2f958fa4 admin admin] PATH_INFO: `/v3/users/799ad9d910c54f3cbc1834f7e9e17f7a` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:48.149533 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e406a3-191b-40e2-8d31-3bda2f958fa4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=799ad9d910c54f3cbc1834f7e9e17f7a)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:48.151467 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e406a3-191b-40e2-8d31-3bda2f958fa4 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:48.199269 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-14e406a3-191b-40e2-8d31-3bda2f958fa4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '799ad9d910c54f3cbc1834f7e9e17f7a'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:48.199917 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-14e406a3-191b-40e2-8d31-3bda2f958fa4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '799ad9d910c54f3cbc1834f7e9e17f7a'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:48.207305 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-14e406a3-191b-40e2-8d31-3bda2f958fa4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '799ad9d910c54f3cbc1834f7e9e17f7a'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:48.216634 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-14e406a3-191b-40e2-8d31-3bda2f958fa4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '799ad9d910c54f3cbc1834f7e9e17f7a'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:48.217476 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-14e406a3-191b-40e2-8d31-3bda2f958fa4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '799ad9d910c54f3cbc1834f7e9e17f7a'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:48.240667 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1015/2034] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:00:48 2021] DELETE /identity/v3/users/799ad9d910c54f3cbc1834f7e9e17f7a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:00:48.799129 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72e377-6469-4cc3-8bf1-813ef19faacc admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:48.800592 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-3c72e377-6469-4cc3-8bf1-813ef19faacc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:48.814896 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72e377-6469-4cc3-8bf1-813ef19faacc admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:48.896999 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10291d-3218-4d6c-8dee-91d78d10cde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:48.898594 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10291d-3218-4d6c-8dee-91d78d10cde2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:48.898874 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10291d-3218-4d6c-8dee-91d78d10cde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:48.899264 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10291d-3218-4d6c-8dee-91d78d10cde2 admin admin] PATH_INFO: `/v3/projects/4fbe98a4f34d458294c3c18dcc42013e` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:48.903551 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d10291d-3218-4d6c-8dee-91d78d10cde2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fbe98a4f34d458294c3c18dcc42013e)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:48.906271 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d10291d-3218-4d6c-8dee-91d78d10cde2 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:48.969315 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-5d10291d-3218-4d6c-8dee-91d78d10cde2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fbe98a4f34d458294c3c18dcc42013e', 'request_id': 'req-5d10291d-3218-4d6c-8dee-91d78d10cde2'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:48.978676 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-5d10291d-3218-4d6c-8dee-91d78d10cde2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fbe98a4f34d458294c3c18dcc42013e', 'request_id': 'req-5d10291d-3218-4d6c-8dee-91d78d10cde2'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:48.984885 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-5d10291d-3218-4d6c-8dee-91d78d10cde2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fbe98a4f34d458294c3c18dcc42013e', 'request_id': 'req-5d10291d-3218-4d6c-8dee-91d78d10cde2'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:48.997114 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-5d10291d-3218-4d6c-8dee-91d78d10cde2 admin admin] The token cache is being invalidate because project 4fbe98a4f34d458294c3c18dcc42013e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:00:48.997412 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-5d10291d-3218-4d6c-8dee-91d78d10cde2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:48.998070 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-5d10291d-3218-4d6c-8dee-91d78d10cde2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:49.000569 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1020/2035] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:00:48 2021] DELETE /identity/v3/projects/4fbe98a4f34d458294c3c18dcc42013e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:00:49.005783 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f03a39-98ac-415f-8a99-5adca2a12ad9 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:49.006296 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f03a39-98ac-415f-8a99-5adca2a12ad9 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:49.006296 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f03a39-98ac-415f-8a99-5adca2a12ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:49.026167 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-e2f03a39-98ac-415f-8a99-5adca2a12ad9 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:00:49.027387 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-e2f03a39-98ac-415f-8a99-5adca2a12ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:49.099756 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1016/2036] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:00:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:00:49.109117 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a7de2-a4ad-43cb-b60b-af9b9c61cd94 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:49.109353 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a7de2-a4ad-43cb-b60b-af9b9c61cd94 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:49.109586 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a7de2-a4ad-43cb-b60b-af9b9c61cd94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:49.128556 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-4d5a7de2-a4ad-43cb-b60b-af9b9c61cd94 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:00:49.129813 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-4d5a7de2-a4ad-43cb-b60b-af9b9c61cd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:49.138702 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1021/2037] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:00:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 05:00:49.143285 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f03a39-98ac-415f-8a99-5adca2a12ad9 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:49.153277 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f03a39-98ac-415f-8a99-5adca2a12ad9 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:49.158138 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0294bbea-558a-4a57-a894-43b19a92fb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:49.158800 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294bbea-558a-4a57-a894-43b19a92fb53 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:49.159081 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294bbea-558a-4a57-a894-43b19a92fb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:49.159354 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294bbea-558a-4a57-a894-43b19a92fb53 admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:49.160114 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0294bbea-558a-4a57-a894-43b19a92fb53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 05:00:49.160418 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0294bbea-558a-4a57-a894-43b19a92fb53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:49.162068 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0294bbea-558a-4a57-a894-43b19a92fb53 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:49.175454 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1017/2038] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 05:00:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 05:00:49.179452 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a7de2-a4ad-43cb-b60b-af9b9c61cd94 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:49.190282 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a7de2-a4ad-43cb-b60b-af9b9c61cd94 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:49.195263 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c948eec4-08c6-41a0-97d4-ed829eb3535f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:49.196000 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948eec4-08c6-41a0-97d4-ed829eb3535f admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:49.196352 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948eec4-08c6-41a0-97d4-ed829eb3535f admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:49.196722 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948eec4-08c6-41a0-97d4-ed829eb3535f admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:49.197507 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c948eec4-08c6-41a0-97d4-ed829eb3535f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:49.199486 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c948eec4-08c6-41a0-97d4-ed829eb3535f admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:49.227997 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1022/2039] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:00:49 2021] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 05:00:49.250790 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0294bbea-558a-4a57-a894-43b19a92fb53 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:49.261824 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0294bbea-558a-4a57-a894-43b19a92fb53 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:49.344095 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2226b5-64e2-41f4-8d21-3f6dda138dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:49.344819 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2226b5-64e2-41f4-8d21-3f6dda138dbc admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:49.345103 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2226b5-64e2-41f4-8d21-3f6dda138dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:49.345377 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2226b5-64e2-41f4-8d21-3f6dda138dbc admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:49.346094 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2226b5-64e2-41f4-8d21-3f6dda138dbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:49.348030 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2226b5-64e2-41f4-8d21-3f6dda138dbc admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:49.392365 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1018/2040] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:00:49 2021] POST /identity/v3/users => generated 283 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:00:49.394262 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c948eec4-08c6-41a0-97d4-ed829eb3535f admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:49.410841 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c948eec4-08c6-41a0-97d4-ed829eb3535f admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:49.416122 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926096a-e864-4dd6-aef7-38d4115ef682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:49.417204 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926096a-e864-4dd6-aef7-38d4115ef682 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:49.417582 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926096a-e864-4dd6-aef7-38d4115ef682 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:49.417953 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926096a-e864-4dd6-aef7-38d4115ef682 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:49.418806 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d926096a-e864-4dd6-aef7-38d4115ef682 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:49.420557 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d926096a-e864-4dd6-aef7-38d4115ef682 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:49.435408 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1023/2041] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:00:49 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:00:49.439153 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2226b5-64e2-41f4-8d21-3f6dda138dbc admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:49.449622 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2226b5-64e2-41f4-8d21-3f6dda138dbc admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:49.454979 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9bfc32-2851-4900-ae97-e9272a4d5abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:49.455641 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9bfc32-2851-4900-ae97-e9272a4d5abb admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:49.455922 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9bfc32-2851-4900-ae97-e9272a4d5abb admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:49.456194 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9bfc32-2851-4900-ae97-e9272a4d5abb admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:49.456993 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9bfc32-2851-4900-ae97-e9272a4d5abb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:49.458644 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9bfc32-2851-4900-ae97-e9272a4d5abb admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:49.469959 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1019/2042] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:00:49 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 24 05:00:49.474138 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926096a-e864-4dd6-aef7-38d4115ef682 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:49.485311 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926096a-e864-4dd6-aef7-38d4115ef682 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:49.491161 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea7024f-81a4-4fd9-845b-fe4ff9e24aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:49.492132 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea7024f-81a4-4fd9-845b-fe4ff9e24aac admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:49.492487 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea7024f-81a4-4fd9-845b-fe4ff9e24aac admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:49.492858 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea7024f-81a4-4fd9-845b-fe4ff9e24aac admin admin] PATH_INFO: `/v3/projects/3ff32c7bdcb04a629a7d97a982644d6a/users/0540fe4014d54f638e8ae9bc4d2f9460/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:49.509317 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea7024f-81a4-4fd9-845b-fe4ff9e24aac admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ff32c7bdcb04a629a7d97a982644d6a, user_id=0540fe4014d54f638e8ae9bc4d2f9460, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:49.512140 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea7024f-81a4-4fd9-845b-fe4ff9e24aac admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:49.526445 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1024/2043] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:00:49 2021] PUT /identity/v3/projects/3ff32c7bdcb04a629a7d97a982644d6a/users/0540fe4014d54f638e8ae9bc4d2f9460/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 05:00:49.537086 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24cf80b-2e99-4808-8f41-867b1fca9703 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:49.537375 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24cf80b-2e99-4808-8f41-867b1fca9703 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:49.537656 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24cf80b-2e99-4808-8f41-867b1fca9703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:49.564584 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-a24cf80b-2e99-4808-8f41-867b1fca9703 None None] MFA Rules not processed for user `0540fe4014d54f638e8ae9bc4d2f9460`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:00:49.565835 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-a24cf80b-2e99-4808-8f41-867b1fca9703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:49.636127 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1020/2044] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:00:49 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:00:49.640480 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea7024f-81a4-4fd9-845b-fe4ff9e24aac admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:49.714997 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea7024f-81a4-4fd9-845b-fe4ff9e24aac admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:49.719975 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0fb7ec-aaee-4469-8c0d-112f4e13d824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:49.720741 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0fb7ec-aaee-4469-8c0d-112f4e13d824 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:49.721026 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0fb7ec-aaee-4469-8c0d-112f4e13d824 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:49.721311 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0fb7ec-aaee-4469-8c0d-112f4e13d824 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:49.722035 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0fb7ec-aaee-4469-8c0d-112f4e13d824 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:49.723963 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0fb7ec-aaee-4469-8c0d-112f4e13d824 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:49.748739 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1025/2045] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:00:49 2021] POST /identity/v3/projects => generated 367 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 05:00:49.752882 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24cf80b-2e99-4808-8f41-867b1fca9703 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:49.763918 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24cf80b-2e99-4808-8f41-867b1fca9703 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:49.828386 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2cc890-80a8-475e-a327-c8493e514144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:49.829480 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2cc890-80a8-475e-a327-c8493e514144 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:49.829773 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2cc890-80a8-475e-a327-c8493e514144 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:49.830052 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2cc890-80a8-475e-a327-c8493e514144 admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:49.831087 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2cc890-80a8-475e-a327-c8493e514144 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:49.833666 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2cc890-80a8-475e-a327-c8493e514144 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:49.860210 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1021/2046] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:00:49 2021] POST /identity/v3/users => generated 290 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 05:00:49.864723 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0fb7ec-aaee-4469-8c0d-112f4e13d824 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:49.879246 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0fb7ec-aaee-4469-8c0d-112f4e13d824 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:49.887621 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a07d4a-eb95-4da6-8589-ef4517c3cf5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:49.888678 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a07d4a-eb95-4da6-8589-ef4517c3cf5d admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:49.889132 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a07d4a-eb95-4da6-8589-ef4517c3cf5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:49.889563 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a07d4a-eb95-4da6-8589-ef4517c3cf5d admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:49.890322 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a07d4a-eb95-4da6-8589-ef4517c3cf5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:49.891925 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a07d4a-eb95-4da6-8589-ef4517c3cf5d admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:49.903603 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1026/2047] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:00:49 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:00:49.908694 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2cc890-80a8-475e-a327-c8493e514144 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:49.922364 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2cc890-80a8-475e-a327-c8493e514144 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:49.927973 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f8533-59c5-4f50-aea8-8bf033564e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:49.928973 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f8533-59c5-4f50-aea8-8bf033564e31 admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:49.929273 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f8533-59c5-4f50-aea8-8bf033564e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:49.929543 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f8533-59c5-4f50-aea8-8bf033564e31 admin admin] PATH_INFO: `/v3/projects/563ade72768c4762a48c7004a0285942/users/da99a45f1a8045c19f1fd7640ac7c39e/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:49.944890 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9f8533-59c5-4f50-aea8-8bf033564e31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=563ade72768c4762a48c7004a0285942, user_id=da99a45f1a8045c19f1fd7640ac7c39e, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:49.947459 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9f8533-59c5-4f50-aea8-8bf033564e31 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:49.962429 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1022/2048] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:00:49 2021] PUT /identity/v3/projects/563ade72768c4762a48c7004a0285942/users/da99a45f1a8045c19f1fd7640ac7c39e/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:00:49.966668 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a07d4a-eb95-4da6-8589-ef4517c3cf5d admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:49.980271 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a07d4a-eb95-4da6-8589-ef4517c3cf5d admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:50.040464 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da35fb0-7676-4961-bf22-81e229629ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:50.041179 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da35fb0-7676-4961-bf22-81e229629ab0 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:50.041599 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da35fb0-7676-4961-bf22-81e229629ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:50.041876 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da35fb0-7676-4961-bf22-81e229629ab0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:50.042627 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da35fb0-7676-4961-bf22-81e229629ab0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:50.044270 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da35fb0-7676-4961-bf22-81e229629ab0 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:50.055029 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1027/2049] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:00:49 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 24 05:00:50.059242 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f8533-59c5-4f50-aea8-8bf033564e31 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:50.069706 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f8533-59c5-4f50-aea8-8bf033564e31 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:50.076014 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f684e-19b2-4439-8094-c98d9ccba3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:50.077005 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f684e-19b2-4439-8094-c98d9ccba3c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:50.077297 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f684e-19b2-4439-8094-c98d9ccba3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:50.077679 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f684e-19b2-4439-8094-c98d9ccba3c3 admin admin] PATH_INFO: `/v3/projects/563ade72768c4762a48c7004a0285942/users/da99a45f1a8045c19f1fd7640ac7c39e/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:50.079923 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f684e-19b2-4439-8094-c98d9ccba3c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=563ade72768c4762a48c7004a0285942, user_id=da99a45f1a8045c19f1fd7640ac7c39e, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:50.082840 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f684e-19b2-4439-8094-c98d9ccba3c3 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:50.094388 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1023/2050] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:00:50 2021] PUT /identity/v3/projects/563ade72768c4762a48c7004a0285942/users/da99a45f1a8045c19f1fd7640ac7c39e/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 05:00:50.105455 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a968ed5-35c7-4078-b5c0-997be85b7f4f None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:50.105816 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a968ed5-35c7-4078-b5c0-997be85b7f4f None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:50.106159 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a968ed5-35c7-4078-b5c0-997be85b7f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:50.136059 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-6a968ed5-35c7-4078-b5c0-997be85b7f4f None None] MFA Rules not processed for user `da99a45f1a8045c19f1fd7640ac7c39e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:00:50.137367 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-6a968ed5-35c7-4078-b5c0-997be85b7f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:50.209274 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1028/2051] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:00:50 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:00:50.220474 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f684e-19b2-4439-8094-c98d9ccba3c3 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:50.222321 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-879f684e-19b2-4439-8094-c98d9ccba3c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:50.283329 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f684e-19b2-4439-8094-c98d9ccba3c3 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:50.287138 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28facee5-f6d6-44aa-a142-404f2a57ceb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:50.287792 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28facee5-f6d6-44aa-a142-404f2a57ceb1 service cinder] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:50.288077 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28facee5-f6d6-44aa-a142-404f2a57ceb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:50.288354 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28facee5-f6d6-44aa-a142-404f2a57ceb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:50.298868 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28facee5-f6d6-44aa-a142-404f2a57ceb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:50.299664 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28facee5-f6d6-44aa-a142-404f2a57ceb1 service cinder] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:50.310785 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1024/2052] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:00:50 2021] GET /identity/v3/auth/tokens => generated 3301 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:00:50.437534 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a968ed5-35c7-4078-b5c0-997be85b7f4f None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:50.447232 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a968ed5-35c7-4078-b5c0-997be85b7f4f None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:50.451139 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a0f075-7293-48e1-bc9f-85719c9770f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:50.451874 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0f075-7293-48e1-bc9f-85719c9770f3 service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:50.452147 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0f075-7293-48e1-bc9f-85719c9770f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:50.452686 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0f075-7293-48e1-bc9f-85719c9770f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:50.511555 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a0f075-7293-48e1-bc9f-85719c9770f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:50.513045 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a0f075-7293-48e1-bc9f-85719c9770f3 service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:50.522708 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1029/2053] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:00:50 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:00:54.406618 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28facee5-f6d6-44aa-a142-404f2a57ceb1 service cinder] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:54.408143 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-28facee5-f6d6-44aa-a142-404f2a57ceb1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:54.478752 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28facee5-f6d6-44aa-a142-404f2a57ceb1 service cinder] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:54.483603 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4cc77e-0e59-45ae-8448-2ffb3bb277b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:54.484263 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4cc77e-0e59-45ae-8448-2ffb3bb277b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:54.484554 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4cc77e-0e59-45ae-8448-2ffb3bb277b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:54.484843 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4cc77e-0e59-45ae-8448-2ffb3bb277b7 admin admin] PATH_INFO: `/v3/users/61664b664e1d45e686290d000f94f5ab` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:54.486081 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4cc77e-0e59-45ae-8448-2ffb3bb277b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61664b664e1d45e686290d000f94f5ab)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:54.488010 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4cc77e-0e59-45ae-8448-2ffb3bb277b7 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:54.533558 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-8c4cc77e-0e59-45ae-8448-2ffb3bb277b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61664b664e1d45e686290d000f94f5ab'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:54.534191 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-8c4cc77e-0e59-45ae-8448-2ffb3bb277b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61664b664e1d45e686290d000f94f5ab'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:54.540775 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-8c4cc77e-0e59-45ae-8448-2ffb3bb277b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61664b664e1d45e686290d000f94f5ab'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:54.547871 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-8c4cc77e-0e59-45ae-8448-2ffb3bb277b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61664b664e1d45e686290d000f94f5ab'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:54.548572 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-8c4cc77e-0e59-45ae-8448-2ffb3bb277b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61664b664e1d45e686290d000f94f5ab'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:54.565166 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1025/2054] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:00:54 2021] DELETE /identity/v3/users/61664b664e1d45e686290d000f94f5ab => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:00:54.750735 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a0f075-7293-48e1-bc9f-85719c9770f3 service cinder] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:54.761378 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a0f075-7293-48e1-bc9f-85719c9770f3 service cinder] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:54.818330 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c4d50-8be8-4779-b88c-6abf88821b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:54.819225 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c4d50-8be8-4779-b88c-6abf88821b7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:54.819509 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c4d50-8be8-4779-b88c-6abf88821b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:54.819784 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c4d50-8be8-4779-b88c-6abf88821b7a admin admin] PATH_INFO: `/v3/projects/14dbe9b1ff9041858e25c4fafebc1a51` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:54.821037 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c4d50-8be8-4779-b88c-6abf88821b7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=14dbe9b1ff9041858e25c4fafebc1a51)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:54.823030 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c4d50-8be8-4779-b88c-6abf88821b7a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:54.878714 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-991c4d50-8be8-4779-b88c-6abf88821b7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14dbe9b1ff9041858e25c4fafebc1a51', 'request_id': 'req-991c4d50-8be8-4779-b88c-6abf88821b7a'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:54.886118 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-991c4d50-8be8-4779-b88c-6abf88821b7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14dbe9b1ff9041858e25c4fafebc1a51', 'request_id': 'req-991c4d50-8be8-4779-b88c-6abf88821b7a'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:54.891561 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-991c4d50-8be8-4779-b88c-6abf88821b7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14dbe9b1ff9041858e25c4fafebc1a51', 'request_id': 'req-991c4d50-8be8-4779-b88c-6abf88821b7a'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:54.902382 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-991c4d50-8be8-4779-b88c-6abf88821b7a admin admin] The token cache is being invalidate because project 14dbe9b1ff9041858e25c4fafebc1a51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:00:54.902663 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-991c4d50-8be8-4779-b88c-6abf88821b7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:54.903250 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-991c4d50-8be8-4779-b88c-6abf88821b7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:00:54.904969 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1030/2055] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:00:54 2021] DELETE /identity/v3/projects/14dbe9b1ff9041858e25c4fafebc1a51 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:00:54.911410 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7aa693-3e31-467c-a046-b3bf5cda257c None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:54.911793 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7aa693-3e31-467c-a046-b3bf5cda257c None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:54.912134 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7aa693-3e31-467c-a046-b3bf5cda257c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:54.931032 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-ef7aa693-3e31-467c-a046-b3bf5cda257c None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:00:54.932323 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-ef7aa693-3e31-467c-a046-b3bf5cda257c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:54.998758 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1026/2056] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:00:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:00:55.007047 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995d1c7-cdfe-4ce1-a766-cb571965180a None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:55.007364 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995d1c7-cdfe-4ce1-a766-cb571965180a None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:55.007643 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995d1c7-cdfe-4ce1-a766-cb571965180a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:55.026559 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-a995d1c7-cdfe-4ce1-a766-cb571965180a None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:00:55.027796 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-a995d1c7-cdfe-4ce1-a766-cb571965180a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:55.037022 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1031/2057] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:00:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:00:55.041401 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7aa693-3e31-467c-a046-b3bf5cda257c None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:55.051735 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7aa693-3e31-467c-a046-b3bf5cda257c None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:55.057186 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85204c2-0b29-4972-bb95-999aa709e5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:55.057880 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85204c2-0b29-4972-bb95-999aa709e5df admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:55.058151 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85204c2-0b29-4972-bb95-999aa709e5df admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:55.058426 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85204c2-0b29-4972-bb95-999aa709e5df admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:55.059173 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85204c2-0b29-4972-bb95-999aa709e5df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 05:00:55.059480 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85204c2-0b29-4972-bb95-999aa709e5df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:55.061235 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85204c2-0b29-4972-bb95-999aa709e5df admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:55.074921 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1027/2058] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 05:00:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 05:00:55.079334 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a995d1c7-cdfe-4ce1-a766-cb571965180a None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:55.088738 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a995d1c7-cdfe-4ce1-a766-cb571965180a None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:55.094453 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3cfec4-c034-4a31-aff6-12422968b37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:55.095115 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3cfec4-c034-4a31-aff6-12422968b37d admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:55.095392 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3cfec4-c034-4a31-aff6-12422968b37d admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:55.095668 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3cfec4-c034-4a31-aff6-12422968b37d admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:55.096389 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3cfec4-c034-4a31-aff6-12422968b37d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:55.098315 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3cfec4-c034-4a31-aff6-12422968b37d admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:55.126944 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1032/2059] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:00:55 2021] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:00:55.131702 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85204c2-0b29-4972-bb95-999aa709e5df admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:55.144559 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85204c2-0b29-4972-bb95-999aa709e5df admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:55.206519 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58876e72-c5dc-4d7f-a220-937e29878ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:55.207553 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58876e72-c5dc-4d7f-a220-937e29878ad1 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:55.207831 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58876e72-c5dc-4d7f-a220-937e29878ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:55.208106 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58876e72-c5dc-4d7f-a220-937e29878ad1 admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:55.208851 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58876e72-c5dc-4d7f-a220-937e29878ad1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:55.211308 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58876e72-c5dc-4d7f-a220-937e29878ad1 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:55.236915 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1028/2060] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:00:55 2021] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 05:00:55.238727 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3cfec4-c034-4a31-aff6-12422968b37d admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:55.249911 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3cfec4-c034-4a31-aff6-12422968b37d admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:55.255010 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7779a2e7-9ca6-411d-833a-d252583f6dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:55.255685 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779a2e7-9ca6-411d-833a-d252583f6dcd admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:55.255968 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779a2e7-9ca6-411d-833a-d252583f6dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:55.256244 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779a2e7-9ca6-411d-833a-d252583f6dcd admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:55.257052 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7779a2e7-9ca6-411d-833a-d252583f6dcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:55.258668 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7779a2e7-9ca6-411d-833a-d252583f6dcd admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:55.270892 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1033/2061] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:00:55 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:00:55.275190 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58876e72-c5dc-4d7f-a220-937e29878ad1 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:55.285672 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58876e72-c5dc-4d7f-a220-937e29878ad1 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:55.291221 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d8f06f-80bc-4c59-8ac3-bf4f9c768e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:55.291880 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8f06f-80bc-4c59-8ac3-bf4f9c768e82 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:55.292169 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8f06f-80bc-4c59-8ac3-bf4f9c768e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:55.292441 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8f06f-80bc-4c59-8ac3-bf4f9c768e82 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:55.293229 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d8f06f-80bc-4c59-8ac3-bf4f9c768e82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:55.294844 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d8f06f-80bc-4c59-8ac3-bf4f9c768e82 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:55.304856 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1029/2062] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:00:55 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:00:55.309103 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7779a2e7-9ca6-411d-833a-d252583f6dcd admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:55.319484 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7779a2e7-9ca6-411d-833a-d252583f6dcd admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:55.324151 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f128d1a5-6639-4a85-82bb-5ba82738fcfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:55.325075 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128d1a5-6639-4a85-82bb-5ba82738fcfb admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:55.325355 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128d1a5-6639-4a85-82bb-5ba82738fcfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:55.325627 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128d1a5-6639-4a85-82bb-5ba82738fcfb admin admin] PATH_INFO: `/v3/projects/9ef3eae52dae493e8ecc57504836d7f0/users/b490cc71f0534dbe8a8e63ec06ead6c3/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:55.341695 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f128d1a5-6639-4a85-82bb-5ba82738fcfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ef3eae52dae493e8ecc57504836d7f0, user_id=b490cc71f0534dbe8a8e63ec06ead6c3, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:55.344429 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f128d1a5-6639-4a85-82bb-5ba82738fcfb admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:55.358426 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1034/2063] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:00:55 2021] PUT /identity/v3/projects/9ef3eae52dae493e8ecc57504836d7f0/users/b490cc71f0534dbe8a8e63ec06ead6c3/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:00:55.368317 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438358d-1cf3-496a-98f5-c21668e8cab4 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:55.368712 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438358d-1cf3-496a-98f5-c21668e8cab4 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:55.369056 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438358d-1cf3-496a-98f5-c21668e8cab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:55.400131 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-8438358d-1cf3-496a-98f5-c21668e8cab4 None None] MFA Rules not processed for user `b490cc71f0534dbe8a8e63ec06ead6c3`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:00:55.401347 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-8438358d-1cf3-496a-98f5-c21668e8cab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:55.472261 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1030/2064] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:00:55 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 05:00:55.484629 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f128d1a5-6639-4a85-82bb-5ba82738fcfb admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:00:55.486493 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-f128d1a5-6639-4a85-82bb-5ba82738fcfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:00:55.557350 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f128d1a5-6639-4a85-82bb-5ba82738fcfb admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:00:55.563903 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ba8f9-51b9-411a-8460-568935571812 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f9ad1e8f8f74edcb44aabe17eb59648', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:00:55.564570 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ba8f9-51b9-411a-8460-568935571812 service nova] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:00:55.564863 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ba8f9-51b9-411a-8460-568935571812 service nova] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:00:55.565135 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ba8f9-51b9-411a-8460-568935571812 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:00:55.573980 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1ba8f9-51b9-411a-8460-568935571812 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:00:55.575639 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1ba8f9-51b9-411a-8460-568935571812 service nova] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:00:55.585010 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1035/2065] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:00:55 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:01:00.646359 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8438358d-1cf3-496a-98f5-c21668e8cab4 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:00.647894 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-8438358d-1cf3-496a-98f5-c21668e8cab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:00.737624 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8438358d-1cf3-496a-98f5-c21668e8cab4 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:00.742898 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421d330-aa24-4d7f-afa2-1d58a4f794cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:00.744729 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421d330-aa24-4d7f-afa2-1d58a4f794cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:00.745258 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421d330-aa24-4d7f-afa2-1d58a4f794cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:00.746038 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421d330-aa24-4d7f-afa2-1d58a4f794cf admin admin] PATH_INFO: `/v3/users/0540fe4014d54f638e8ae9bc4d2f9460` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:00.748142 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f421d330-aa24-4d7f-afa2-1d58a4f794cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=0540fe4014d54f638e8ae9bc4d2f9460)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:00.751277 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f421d330-aa24-4d7f-afa2-1d58a4f794cf admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:00.822775 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-f421d330-aa24-4d7f-afa2-1d58a4f794cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0540fe4014d54f638e8ae9bc4d2f9460'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:00.823484 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-f421d330-aa24-4d7f-afa2-1d58a4f794cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0540fe4014d54f638e8ae9bc4d2f9460'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:00.834002 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-f421d330-aa24-4d7f-afa2-1d58a4f794cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0540fe4014d54f638e8ae9bc4d2f9460'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:00.846519 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-f421d330-aa24-4d7f-afa2-1d58a4f794cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0540fe4014d54f638e8ae9bc4d2f9460'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:00.847325 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-f421d330-aa24-4d7f-afa2-1d58a4f794cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0540fe4014d54f638e8ae9bc4d2f9460'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:00.880368 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1031/2066] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:01:00 2021] DELETE /identity/v3/users/0540fe4014d54f638e8ae9bc4d2f9460 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:01:00.886713 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e3125-3e91-48b2-8aef-6604a31ceb21 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:00.887764 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e3125-3e91-48b2-8aef-6604a31ceb21 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:00.888349 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e3125-3e91-48b2-8aef-6604a31ceb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:00.910671 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-969e3125-3e91-48b2-8aef-6604a31ceb21 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:01:00.912336 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-969e3125-3e91-48b2-8aef-6604a31ceb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:01.038754 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1036/2067] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:01:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:01:01.041364 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421d330-aa24-4d7f-afa2-1d58a4f794cf admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:01.043174 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-f421d330-aa24-4d7f-afa2-1d58a4f794cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:01.049607 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166280d-b866-43cc-a286-a44f6556ea58 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:01.050138 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166280d-b866-43cc-a286-a44f6556ea58 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:01.050392 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166280d-b866-43cc-a286-a44f6556ea58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:01.086712 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-f166280d-b866-43cc-a286-a44f6556ea58 None None] MFA Rules not processed for user `f29f576d3a98449b8077c0df53968f07`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:01:01.088094 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-f166280d-b866-43cc-a286-a44f6556ea58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:01.122564 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421d330-aa24-4d7f-afa2-1d58a4f794cf admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:01.133524 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09807aa4-1b18-4f3b-bc3d-a06762187588 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:01.134115 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09807aa4-1b18-4f3b-bc3d-a06762187588 service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:01.134457 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09807aa4-1b18-4f3b-bc3d-a06762187588 service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:01.134858 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09807aa4-1b18-4f3b-bc3d-a06762187588 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:01.146878 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09807aa4-1b18-4f3b-bc3d-a06762187588 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:01.148412 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09807aa4-1b18-4f3b-bc3d-a06762187588 service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:01.162933 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1037/2068] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:01:01 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:01:01.168240 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1032/2069] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:01:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:01:01.460132 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f166280d-b866-43cc-a286-a44f6556ea58 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:01.461788 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-f166280d-b866-43cc-a286-a44f6556ea58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:01.479871 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f166280d-b866-43cc-a286-a44f6556ea58 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:01.484909 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56049929-ab57-494f-9462-1bee94866aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:01.486216 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56049929-ab57-494f-9462-1bee94866aef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:01.486653 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56049929-ab57-494f-9462-1bee94866aef admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:01.486922 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56049929-ab57-494f-9462-1bee94866aef admin admin] PATH_INFO: `/v3/users/2ad70d0f6140416a9184f7df34998495` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:01.488155 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56049929-ab57-494f-9462-1bee94866aef admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ad70d0f6140416a9184f7df34998495)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:01.490398 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56049929-ab57-494f-9462-1bee94866aef admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:01.544487 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09807aa4-1b18-4f3b-bc3d-a06762187588 service neutron] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:01.546027 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-09807aa4-1b18-4f3b-bc3d-a06762187588 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:01.551840 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-56049929-ab57-494f-9462-1bee94866aef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ad70d0f6140416a9184f7df34998495'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:01.552555 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-56049929-ab57-494f-9462-1bee94866aef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ad70d0f6140416a9184f7df34998495'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:01.566230 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-56049929-ab57-494f-9462-1bee94866aef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ad70d0f6140416a9184f7df34998495'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:01.572300 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09807aa4-1b18-4f3b-bc3d-a06762187588 service neutron] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:01.577946 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85604fa1-c2ba-4d89-bb73-4d6fec57b1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:01.578892 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85604fa1-c2ba-4d89-bb73-4d6fec57b1d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:01.579172 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85604fa1-c2ba-4d89-bb73-4d6fec57b1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:01.579824 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85604fa1-c2ba-4d89-bb73-4d6fec57b1d9 admin admin] PATH_INFO: `/v3/projects/3ff32c7bdcb04a629a7d97a982644d6a` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:01.580298 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-56049929-ab57-494f-9462-1bee94866aef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ad70d0f6140416a9184f7df34998495'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:01.580986 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85604fa1-c2ba-4d89-bb73-4d6fec57b1d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ff32c7bdcb04a629a7d97a982644d6a)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:01.582906 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85604fa1-c2ba-4d89-bb73-4d6fec57b1d9 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:01.596988 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-56049929-ab57-494f-9462-1bee94866aef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ad70d0f6140416a9184f7df34998495'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:01.603920 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1038/2070] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:01:01 2021] DELETE /identity/v3/users/2ad70d0f6140416a9184f7df34998495 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:01:01.608211 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f79528-a652-4c2d-91b9-ed72f452f603 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:01.608653 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f79528-a652-4c2d-91b9-ed72f452f603 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:01.609093 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f79528-a652-4c2d-91b9-ed72f452f603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:01.627652 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-46f79528-a652-4c2d-91b9-ed72f452f603 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:01:01.629011 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-46f79528-a652-4c2d-91b9-ed72f452f603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:01.639357 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-85604fa1-c2ba-4d89-bb73-4d6fec57b1d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ff32c7bdcb04a629a7d97a982644d6a', 'request_id': 'req-85604fa1-c2ba-4d89-bb73-4d6fec57b1d9'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:01.649721 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-85604fa1-c2ba-4d89-bb73-4d6fec57b1d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ff32c7bdcb04a629a7d97a982644d6a', 'request_id': 'req-85604fa1-c2ba-4d89-bb73-4d6fec57b1d9'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:01.656545 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-85604fa1-c2ba-4d89-bb73-4d6fec57b1d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ff32c7bdcb04a629a7d97a982644d6a', 'request_id': 'req-85604fa1-c2ba-4d89-bb73-4d6fec57b1d9'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:01.668099 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-85604fa1-c2ba-4d89-bb73-4d6fec57b1d9 admin admin] The token cache is being invalidate because project 3ff32c7bdcb04a629a7d97a982644d6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:01:01.668439 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-85604fa1-c2ba-4d89-bb73-4d6fec57b1d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:01.669149 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-85604fa1-c2ba-4d89-bb73-4d6fec57b1d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:01.671712 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1033/2071] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:01:01 2021] DELETE /identity/v3/projects/3ff32c7bdcb04a629a7d97a982644d6a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 05:01:01.675361 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85604fa1-c2ba-4d89-bb73-4d6fec57b1d9 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:01.677047 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-85604fa1-c2ba-4d89-bb73-4d6fec57b1d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:01.691407 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1039/2072] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:01:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:01:01.702324 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f79528-a652-4c2d-91b9-ed72f452f603 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:01.704002 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-46f79528-a652-4c2d-91b9-ed72f452f603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:01.758387 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85604fa1-c2ba-4d89-bb73-4d6fec57b1d9 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:01.763619 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca56c22f-c668-474f-a202-bf79d75d0c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:01.764889 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56c22f-c668-474f-a202-bf79d75d0c48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:01.765349 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56c22f-c668-474f-a202-bf79d75d0c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:01.765782 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56c22f-c668-474f-a202-bf79d75d0c48 admin admin] PATH_INFO: `/v3/users/da99a45f1a8045c19f1fd7640ac7c39e` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:01.767249 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca56c22f-c668-474f-a202-bf79d75d0c48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da99a45f1a8045c19f1fd7640ac7c39e)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:01.769427 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca56c22f-c668-474f-a202-bf79d75d0c48 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:01.776455 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f79528-a652-4c2d-91b9-ed72f452f603 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:01.780432 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ee539-5fee-46d5-9b6c-43d9bc91b7a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:01.781104 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ee539-5fee-46d5-9b6c-43d9bc91b7a7 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:01.781386 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ee539-5fee-46d5-9b6c-43d9bc91b7a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:01.781659 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ee539-5fee-46d5-9b6c-43d9bc91b7a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:01.792497 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324ee539-5fee-46d5-9b6c-43d9bc91b7a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:01.794454 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324ee539-5fee-46d5-9b6c-43d9bc91b7a7 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:01.808517 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1040/2073] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:01:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 24 05:01:01.831359 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-ca56c22f-c668-474f-a202-bf79d75d0c48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da99a45f1a8045c19f1fd7640ac7c39e'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:01.832082 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-ca56c22f-c668-474f-a202-bf79d75d0c48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da99a45f1a8045c19f1fd7640ac7c39e'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:01.840240 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-ca56c22f-c668-474f-a202-bf79d75d0c48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da99a45f1a8045c19f1fd7640ac7c39e'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:01.850684 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-ca56c22f-c668-474f-a202-bf79d75d0c48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da99a45f1a8045c19f1fd7640ac7c39e'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:01.851655 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-ca56c22f-c668-474f-a202-bf79d75d0c48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da99a45f1a8045c19f1fd7640ac7c39e'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:01.871851 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1034/2074] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:01:01 2021] DELETE /identity/v3/users/da99a45f1a8045c19f1fd7640ac7c39e => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 05:01:02.280305 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ee539-5fee-46d5-9b6c-43d9bc91b7a7 service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:02.282534 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-324ee539-5fee-46d5-9b6c-43d9bc91b7a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:02.300337 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ee539-5fee-46d5-9b6c-43d9bc91b7a7 service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:02.341383 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca56c22f-c668-474f-a202-bf79d75d0c48 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:02.343394 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-ca56c22f-c668-474f-a202-bf79d75d0c48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:02.423855 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d58d5-ca83-4c20-827d-15c272b3bba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:02.425045 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d58d5-ca83-4c20-827d-15c272b3bba4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:02.425327 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d58d5-ca83-4c20-827d-15c272b3bba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:02.425603 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d58d5-ca83-4c20-827d-15c272b3bba4 admin admin] PATH_INFO: `/v3/projects/067ad4d8c47c45c8ba2cd170e83c321c` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:02.426839 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34d58d5-ca83-4c20-827d-15c272b3bba4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=067ad4d8c47c45c8ba2cd170e83c321c)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:02.429229 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca56c22f-c668-474f-a202-bf79d75d0c48 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:02.430284 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34d58d5-ca83-4c20-827d-15c272b3bba4 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:02.435590 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce2a4e2-7f15-4ad4-b6be-d9de09c66700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:02.437361 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2a4e2-7f15-4ad4-b6be-d9de09c66700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:02.438422 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2a4e2-7f15-4ad4-b6be-d9de09c66700 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:02.438863 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2a4e2-7f15-4ad4-b6be-d9de09c66700 admin admin] PATH_INFO: `/v3/projects/563ade72768c4762a48c7004a0285942` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:02.440968 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce2a4e2-7f15-4ad4-b6be-d9de09c66700 admin admin] RBAC: Authorizing `identity:delete_project(project_id=563ade72768c4762a48c7004a0285942)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:02.443412 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce2a4e2-7f15-4ad4-b6be-d9de09c66700 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:02.500249 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-fce2a4e2-7f15-4ad4-b6be-d9de09c66700 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '563ade72768c4762a48c7004a0285942', 'request_id': 'req-fce2a4e2-7f15-4ad4-b6be-d9de09c66700'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:02.506899 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-a34d58d5-ca83-4c20-827d-15c272b3bba4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '067ad4d8c47c45c8ba2cd170e83c321c', 'request_id': 'req-a34d58d5-ca83-4c20-827d-15c272b3bba4'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:02.516135 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-a34d58d5-ca83-4c20-827d-15c272b3bba4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '067ad4d8c47c45c8ba2cd170e83c321c', 'request_id': 'req-a34d58d5-ca83-4c20-827d-15c272b3bba4'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:02.516576 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-fce2a4e2-7f15-4ad4-b6be-d9de09c66700 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '563ade72768c4762a48c7004a0285942', 'request_id': 'req-fce2a4e2-7f15-4ad4-b6be-d9de09c66700'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:02.523343 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-a34d58d5-ca83-4c20-827d-15c272b3bba4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '067ad4d8c47c45c8ba2cd170e83c321c', 'request_id': 'req-a34d58d5-ca83-4c20-827d-15c272b3bba4'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:02.528044 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-fce2a4e2-7f15-4ad4-b6be-d9de09c66700 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '563ade72768c4762a48c7004a0285942', 'request_id': 'req-fce2a4e2-7f15-4ad4-b6be-d9de09c66700'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:02.535254 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-a34d58d5-ca83-4c20-827d-15c272b3bba4 admin admin] The token cache is being invalidate because project 067ad4d8c47c45c8ba2cd170e83c321c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:01:02.535533 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-a34d58d5-ca83-4c20-827d-15c272b3bba4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:02.536365 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-a34d58d5-ca83-4c20-827d-15c272b3bba4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:02.537991 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1041/2075] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:01:02 2021] DELETE /identity/v3/projects/067ad4d8c47c45c8ba2cd170e83c321c => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:01:02.542655 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d58d5-ca83-4c20-827d-15c272b3bba4 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:02.544223 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-a34d58d5-ca83-4c20-827d-15c272b3bba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:02.545029 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-fce2a4e2-7f15-4ad4-b6be-d9de09c66700 admin admin] The token cache is being invalidate because project 563ade72768c4762a48c7004a0285942 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:01:02.545512 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-fce2a4e2-7f15-4ad4-b6be-d9de09c66700 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:02.547612 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-fce2a4e2-7f15-4ad4-b6be-d9de09c66700 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:02.549790 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1035/2076] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:01:02 2021] DELETE /identity/v3/projects/563ade72768c4762a48c7004a0285942 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:01:02.556827 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84ed46-74ae-4801-9c1d-63c806ab0a65 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:02.557186 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84ed46-74ae-4801-9c1d-63c806ab0a65 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:02.557530 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84ed46-74ae-4801-9c1d-63c806ab0a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:02.578324 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-ea84ed46-74ae-4801-9c1d-63c806ab0a65 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:01:02.579513 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-ea84ed46-74ae-4801-9c1d-63c806ab0a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:02.606884 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d58d5-ca83-4c20-827d-15c272b3bba4 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:02.611672 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2daf60-736b-48fe-a4e8-5623d889f1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:02.612479 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2daf60-736b-48fe-a4e8-5623d889f1a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:02.612784 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2daf60-736b-48fe-a4e8-5623d889f1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:02.613052 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2daf60-736b-48fe-a4e8-5623d889f1a3 admin admin] PATH_INFO: `/v3/users/ce37cbbbd2444e42b9fa17a9ad469b10` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:02.614271 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2daf60-736b-48fe-a4e8-5623d889f1a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce37cbbbd2444e42b9fa17a9ad469b10)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:02.616188 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2daf60-736b-48fe-a4e8-5623d889f1a3 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:02.637032 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1036/2077] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:01:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:01:02.644863 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc35b3-ba93-453d-804b-7fa6eaf7ab6e None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:02.645777 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc35b3-ba93-453d-804b-7fa6eaf7ab6e None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:02.646064 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc35b3-ba93-453d-804b-7fa6eaf7ab6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:02.664480 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-3bbc35b3-ba93-453d-804b-7fa6eaf7ab6e None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:01:02.665790 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-3bbc35b3-ba93-453d-804b-7fa6eaf7ab6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:02.666218 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-de2daf60-736b-48fe-a4e8-5623d889f1a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce37cbbbd2444e42b9fa17a9ad469b10'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:02.666890 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-de2daf60-736b-48fe-a4e8-5623d889f1a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce37cbbbd2444e42b9fa17a9ad469b10'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:02.674313 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1037/2078] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:01:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:01:02.675729 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-de2daf60-736b-48fe-a4e8-5623d889f1a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce37cbbbd2444e42b9fa17a9ad469b10'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:02.678442 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc35b3-ba93-453d-804b-7fa6eaf7ab6e None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:02.682892 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-de2daf60-736b-48fe-a4e8-5623d889f1a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce37cbbbd2444e42b9fa17a9ad469b10'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:02.687693 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc35b3-ba93-453d-804b-7fa6eaf7ab6e None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:02.692666 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37682957-e301-453a-b0dd-667e96f7e744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:02.693309 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37682957-e301-453a-b0dd-667e96f7e744 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:02.693590 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37682957-e301-453a-b0dd-667e96f7e744 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:02.693864 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37682957-e301-453a-b0dd-667e96f7e744 admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:02.694613 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37682957-e301-453a-b0dd-667e96f7e744 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 05:01:02.694717 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-de2daf60-736b-48fe-a4e8-5623d889f1a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce37cbbbd2444e42b9fa17a9ad469b10'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:02.694919 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37682957-e301-453a-b0dd-667e96f7e744 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:02.696588 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37682957-e301-453a-b0dd-667e96f7e744 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:02.700574 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1042/2079] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:01:02 2021] DELETE /identity/v3/users/ce37cbbbd2444e42b9fa17a9ad469b10 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:01:02.708775 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1038/2080] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 05:01:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 05:01:02.713385 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2daf60-736b-48fe-a4e8-5623d889f1a3 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:02.774900 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2daf60-736b-48fe-a4e8-5623d889f1a3 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:02.780294 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0248ba2-c4fa-44ef-903e-35e956cddab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:02.781119 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0248ba2-c4fa-44ef-903e-35e956cddab3 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:02.781518 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0248ba2-c4fa-44ef-903e-35e956cddab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:02.781906 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0248ba2-c4fa-44ef-903e-35e956cddab3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:02.782706 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0248ba2-c4fa-44ef-903e-35e956cddab3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:02.784714 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0248ba2-c4fa-44ef-903e-35e956cddab3 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:02.812919 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1043/2081] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:01:02 2021] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 05:01:02.815691 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37682957-e301-453a-b0dd-667e96f7e744 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:02.825577 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37682957-e301-453a-b0dd-667e96f7e744 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:02.884826 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e92cf94-2014-4974-9648-d8674a8b6f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:02.885424 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92cf94-2014-4974-9648-d8674a8b6f54 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:02.885738 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92cf94-2014-4974-9648-d8674a8b6f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:02.886008 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92cf94-2014-4974-9648-d8674a8b6f54 admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:02.886748 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e92cf94-2014-4974-9648-d8674a8b6f54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:02.888723 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e92cf94-2014-4974-9648-d8674a8b6f54 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:02.911627 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1039/2082] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:01:02 2021] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:01:02.915586 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0248ba2-c4fa-44ef-903e-35e956cddab3 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:02.925915 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0248ba2-c4fa-44ef-903e-35e956cddab3 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:02.930842 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67b1418-468a-42fd-9133-4683e073ffed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:02.931516 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b1418-468a-42fd-9133-4683e073ffed admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:02.931819 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b1418-468a-42fd-9133-4683e073ffed admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:02.932086 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b1418-468a-42fd-9133-4683e073ffed admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:02.932860 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67b1418-468a-42fd-9133-4683e073ffed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:02.934442 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67b1418-468a-42fd-9133-4683e073ffed admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:02.945338 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1044/2083] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:01:02 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:01:02.949421 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e92cf94-2014-4974-9648-d8674a8b6f54 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:02.960598 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e92cf94-2014-4974-9648-d8674a8b6f54 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:02.967285 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67b1418-468a-42fd-9133-4683e073ffed admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:02.968094 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a78441-628b-4604-bd4a-7cc6ea432c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:02.968854 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a78441-628b-4604-bd4a-7cc6ea432c4c admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:02.969199 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a78441-628b-4604-bd4a-7cc6ea432c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:02.969541 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-c67b1418-468a-42fd-9133-4683e073ffed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:02.969658 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a78441-628b-4604-bd4a-7cc6ea432c4c admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:02.970378 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a78441-628b-4604-bd4a-7cc6ea432c4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:02.972054 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a78441-628b-4604-bd4a-7cc6ea432c4c admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:02.983842 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1040/2084] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:01:02 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:01:02.987079 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67b1418-468a-42fd-9133-4683e073ffed admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:02.988687 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a78441-628b-4604-bd4a-7cc6ea432c4c admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:02.993110 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2dee2-91ce-46be-bbfc-1a233a7f5bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:02.994036 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2dee2-91ce-46be-bbfc-1a233a7f5bb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:02.994319 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2dee2-91ce-46be-bbfc-1a233a7f5bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:02.994615 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2dee2-91ce-46be-bbfc-1a233a7f5bb9 admin admin] PATH_INFO: `/v3/projects/8bb79799c4bf4d1c9ce969806e73435a` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:02.995900 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a2dee2-91ce-46be-bbfc-1a233a7f5bb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bb79799c4bf4d1c9ce969806e73435a)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:02.997888 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a2dee2-91ce-46be-bbfc-1a233a7f5bb9 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:02.999747 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a78441-628b-4604-bd4a-7cc6ea432c4c admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:03.004866 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9552a-f03a-436f-b3ee-3a4aaca0c291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:03.005767 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9552a-f03a-436f-b3ee-3a4aaca0c291 admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:03.006038 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9552a-f03a-436f-b3ee-3a4aaca0c291 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:03.006307 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9552a-f03a-436f-b3ee-3a4aaca0c291 admin admin] PATH_INFO: `/v3/projects/b6021dab557e4689b5974aca588777dd/users/4dfe1fdc0978491586fee41e8652bbf8/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:03.025485 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9552a-f03a-436f-b3ee-3a4aaca0c291 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6021dab557e4689b5974aca588777dd, user_id=4dfe1fdc0978491586fee41e8652bbf8, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:03.028461 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9552a-f03a-436f-b3ee-3a4aaca0c291 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:03.041930 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1041/2085] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:01:02 2021] PUT /identity/v3/projects/b6021dab557e4689b5974aca588777dd/users/4dfe1fdc0978491586fee41e8652bbf8/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 05:01:03.047001 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-90a2dee2-91ce-46be-bbfc-1a233a7f5bb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bb79799c4bf4d1c9ce969806e73435a', 'request_id': 'req-90a2dee2-91ce-46be-bbfc-1a233a7f5bb9'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:03.052659 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166ea97-d9e7-499f-a0a7-bd733952d804 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:03.053006 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166ea97-d9e7-499f-a0a7-bd733952d804 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:03.053284 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166ea97-d9e7-499f-a0a7-bd733952d804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:03.055566 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-90a2dee2-91ce-46be-bbfc-1a233a7f5bb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bb79799c4bf4d1c9ce969806e73435a', 'request_id': 'req-90a2dee2-91ce-46be-bbfc-1a233a7f5bb9'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:03.061179 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-90a2dee2-91ce-46be-bbfc-1a233a7f5bb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bb79799c4bf4d1c9ce969806e73435a', 'request_id': 'req-90a2dee2-91ce-46be-bbfc-1a233a7f5bb9'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:03.071769 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-90a2dee2-91ce-46be-bbfc-1a233a7f5bb9 admin admin] The token cache is being invalidate because project 8bb79799c4bf4d1c9ce969806e73435a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:01:03.072056 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-90a2dee2-91ce-46be-bbfc-1a233a7f5bb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:03.072739 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-90a2dee2-91ce-46be-bbfc-1a233a7f5bb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:03.074394 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1045/2086] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:01:02 2021] DELETE /identity/v3/projects/8bb79799c4bf4d1c9ce969806e73435a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 05:01:03.080141 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-9166ea97-d9e7-499f-a0a7-bd733952d804 None None] MFA Rules not processed for user `4dfe1fdc0978491586fee41e8652bbf8`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:01:03.080366 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba4add-423e-4e9b-b79e-8e715ed41e0a None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:03.080688 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba4add-423e-4e9b-b79e-8e715ed41e0a None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:03.080969 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba4add-423e-4e9b-b79e-8e715ed41e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:03.081462 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-9166ea97-d9e7-499f-a0a7-bd733952d804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:03.100010 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-4eba4add-423e-4e9b-b79e-8e715ed41e0a None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:01:03.101233 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-4eba4add-423e-4e9b-b79e-8e715ed41e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:03.146697 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1042/2087] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:01:03 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 05:01:03.156824 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166ea97-d9e7-499f-a0a7-bd733952d804 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:03.157823 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1046/2088] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:01:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 05:01:03.158298 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-9166ea97-d9e7-499f-a0a7-bd733952d804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:03.166432 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf11213-1347-41a6-abe5-11b7a43f9f9d None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:03.166716 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf11213-1347-41a6-abe5-11b7a43f9f9d None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:03.166988 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf11213-1347-41a6-abe5-11b7a43f9f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:03.184950 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-edf11213-1347-41a6-abe5-11b7a43f9f9d None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:01:03.186152 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-edf11213-1347-41a6-abe5-11b7a43f9f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:03.196805 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1047/2089] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:01:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 05:01:03.206013 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf11213-1347-41a6-abe5-11b7a43f9f9d None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:03.223333 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf11213-1347-41a6-abe5-11b7a43f9f9d None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:03.226551 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166ea97-d9e7-499f-a0a7-bd733952d804 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:03.228366 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1abe97b-b032-479e-8fc2-34f5da78b267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:03.229687 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1abe97b-b032-479e-8fc2-34f5da78b267 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:03.229977 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1abe97b-b032-479e-8fc2-34f5da78b267 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:03.230157 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d481104-bbca-4978-8e6e-15c21511aaa3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:03.230279 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1abe97b-b032-479e-8fc2-34f5da78b267 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:03.230930 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d481104-bbca-4978-8e6e-15c21511aaa3 service cinder] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:03.231038 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1abe97b-b032-479e-8fc2-34f5da78b267 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 05:01:03.231211 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d481104-bbca-4978-8e6e-15c21511aaa3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:03.231314 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1abe97b-b032-479e-8fc2-34f5da78b267 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:03.231469 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d481104-bbca-4978-8e6e-15c21511aaa3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:03.233697 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1abe97b-b032-479e-8fc2-34f5da78b267 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:03.241307 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d481104-bbca-4978-8e6e-15c21511aaa3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:03.242615 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d481104-bbca-4978-8e6e-15c21511aaa3 service cinder] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:03.247003 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1048/2090] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 05:01:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 05:01:03.251586 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1abe97b-b032-479e-8fc2-34f5da78b267 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:03.253061 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1043/2091] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:01:03 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:01:03.262271 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1abe97b-b032-479e-8fc2-34f5da78b267 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:03.267634 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6692144f-c21f-447b-a1f2-e897253cf58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:03.268289 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692144f-c21f-447b-a1f2-e897253cf58e admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:03.268603 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692144f-c21f-447b-a1f2-e897253cf58e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:03.268873 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692144f-c21f-447b-a1f2-e897253cf58e admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:03.269579 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6692144f-c21f-447b-a1f2-e897253cf58e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:03.271471 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6692144f-c21f-447b-a1f2-e897253cf58e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:03.300913 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1049/2092] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:01:03 2021] POST /identity/v3/projects => generated 363 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 05:01:03.301990 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d481104-bbca-4978-8e6e-15c21511aaa3 service cinder] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:03.312625 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d481104-bbca-4978-8e6e-15c21511aaa3 service cinder] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:03.365766 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819519c-22a2-42b0-9ad1-96e168916802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:03.366432 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819519c-22a2-42b0-9ad1-96e168916802 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:03.366738 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819519c-22a2-42b0-9ad1-96e168916802 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:03.367009 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819519c-22a2-42b0-9ad1-96e168916802 admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:03.367722 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a819519c-22a2-42b0-9ad1-96e168916802 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:03.369731 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a819519c-22a2-42b0-9ad1-96e168916802 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:03.391513 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1044/2093] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:01:03 2021] POST /identity/v3/users => generated 282 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 05:01:03.395948 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6692144f-c21f-447b-a1f2-e897253cf58e admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:03.407478 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6692144f-c21f-447b-a1f2-e897253cf58e admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:03.413554 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b79536-8cce-427a-be60-a188eb1a4239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:03.414236 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b79536-8cce-427a-be60-a188eb1a4239 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:03.414529 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b79536-8cce-427a-be60-a188eb1a4239 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:03.414787 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b79536-8cce-427a-be60-a188eb1a4239 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:03.415673 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b79536-8cce-427a-be60-a188eb1a4239 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:03.417187 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b79536-8cce-427a-be60-a188eb1a4239 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:03.428625 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1050/2094] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:01:03 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 24 05:01:03.432936 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819519c-22a2-42b0-9ad1-96e168916802 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:03.443377 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819519c-22a2-42b0-9ad1-96e168916802 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:03.448679 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e3a1a-712b-472b-a3f9-077545296893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:03.449346 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e3a1a-712b-472b-a3f9-077545296893 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:03.449621 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e3a1a-712b-472b-a3f9-077545296893 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:03.449888 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e3a1a-712b-472b-a3f9-077545296893 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:03.450644 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e3a1a-712b-472b-a3f9-077545296893 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:03.452460 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e3a1a-712b-472b-a3f9-077545296893 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:03.464605 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1045/2095] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:01:03 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:01:03.468885 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b79536-8cce-427a-be60-a188eb1a4239 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:03.479429 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b79536-8cce-427a-be60-a188eb1a4239 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:03.486858 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b749cc-7cdd-4070-8294-52e3f3defb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:03.487746 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b749cc-7cdd-4070-8294-52e3f3defb55 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:03.488267 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b749cc-7cdd-4070-8294-52e3f3defb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:03.488558 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b749cc-7cdd-4070-8294-52e3f3defb55 admin admin] PATH_INFO: `/v3/projects/f9ab9739d1554353a42853bbb50dfd54/users/38413e4e5431476cb140c9c4821906da/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:03.507388 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b749cc-7cdd-4070-8294-52e3f3defb55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9ab9739d1554353a42853bbb50dfd54, user_id=38413e4e5431476cb140c9c4821906da, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:03.510697 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b749cc-7cdd-4070-8294-52e3f3defb55 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:03.528050 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1051/2096] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:01:03 2021] PUT /identity/v3/projects/f9ab9739d1554353a42853bbb50dfd54/users/38413e4e5431476cb140c9c4821906da/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 05:01:03.538455 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c402b0e-20d4-44c6-b25f-e5a7dd9a6a0b None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:03.538744 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c402b0e-20d4-44c6-b25f-e5a7dd9a6a0b None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:03.539025 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c402b0e-20d4-44c6-b25f-e5a7dd9a6a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:03.576412 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-9c402b0e-20d4-44c6-b25f-e5a7dd9a6a0b None None] MFA Rules not processed for user `38413e4e5431476cb140c9c4821906da`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:01:03.578023 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-9c402b0e-20d4-44c6-b25f-e5a7dd9a6a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:03.648624 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1046/2097] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:01:03 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:01:03.653079 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b749cc-7cdd-4070-8294-52e3f3defb55 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:03.715153 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b749cc-7cdd-4070-8294-52e3f3defb55 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:03.720120 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64fe5c9-2f9b-4b62-827c-239b11e996f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:03.720798 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fe5c9-2f9b-4b62-827c-239b11e996f4 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:03.721078 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fe5c9-2f9b-4b62-827c-239b11e996f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:03.721348 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fe5c9-2f9b-4b62-827c-239b11e996f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:03.722057 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64fe5c9-2f9b-4b62-827c-239b11e996f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:03.723947 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64fe5c9-2f9b-4b62-827c-239b11e996f4 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:03.750176 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1052/2098] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:01:03 2021] POST /identity/v3/projects => generated 363 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 05:01:03.754331 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c402b0e-20d4-44c6-b25f-e5a7dd9a6a0b None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:03.765124 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c402b0e-20d4-44c6-b25f-e5a7dd9a6a0b None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:03.821860 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87184f6-3b31-4e0f-a839-9bc80eb45d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:03.822540 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87184f6-3b31-4e0f-a839-9bc80eb45d2f admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:03.822823 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87184f6-3b31-4e0f-a839-9bc80eb45d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:03.823059 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87184f6-3b31-4e0f-a839-9bc80eb45d2f admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:03.823798 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87184f6-3b31-4e0f-a839-9bc80eb45d2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:03.825771 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87184f6-3b31-4e0f-a839-9bc80eb45d2f admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:03.850066 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1047/2099] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:01:03 2021] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:01:03.855098 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64fe5c9-2f9b-4b62-827c-239b11e996f4 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:03.866467 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64fe5c9-2f9b-4b62-827c-239b11e996f4 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:03.871947 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a2096-a80d-4f1a-bb46-f82ee1a7695a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:03.872632 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a2096-a80d-4f1a-bb46-f82ee1a7695a admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:03.872912 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a2096-a80d-4f1a-bb46-f82ee1a7695a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:03.873181 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a2096-a80d-4f1a-bb46-f82ee1a7695a admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:03.874039 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00a2096-a80d-4f1a-bb46-f82ee1a7695a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:03.875630 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00a2096-a80d-4f1a-bb46-f82ee1a7695a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:03.886982 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1053/2100] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:01:03 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:01:03.892114 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87184f6-3b31-4e0f-a839-9bc80eb45d2f admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:03.907696 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87184f6-3b31-4e0f-a839-9bc80eb45d2f admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:03.915835 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b544a-f567-4273-80f9-f548b32dd542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:03.917057 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b544a-f567-4273-80f9-f548b32dd542 admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:03.917464 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b544a-f567-4273-80f9-f548b32dd542 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:03.917850 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b544a-f567-4273-80f9-f548b32dd542 admin admin] PATH_INFO: `/v3/projects/77e96adc90b34eb3b1a7fa92ccfb2d0d/users/e42052fd54c141ba9443e706670362ea/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:03.934247 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686b544a-f567-4273-80f9-f548b32dd542 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77e96adc90b34eb3b1a7fa92ccfb2d0d, user_id=e42052fd54c141ba9443e706670362ea, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:03.936951 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686b544a-f567-4273-80f9-f548b32dd542 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:03.952025 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1048/2101] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:01:03 2021] PUT /identity/v3/projects/77e96adc90b34eb3b1a7fa92ccfb2d0d/users/e42052fd54c141ba9443e706670362ea/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:01:03.957221 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a2096-a80d-4f1a-bb46-f82ee1a7695a admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:03.970226 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a2096-a80d-4f1a-bb46-f82ee1a7695a admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:04.035711 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d32f0-6075-4106-bdbc-6605043c0478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:04.036370 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d32f0-6075-4106-bdbc-6605043c0478 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:04.036683 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d32f0-6075-4106-bdbc-6605043c0478 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:04.036961 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d32f0-6075-4106-bdbc-6605043c0478 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:04.037697 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17d32f0-6075-4106-bdbc-6605043c0478 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:04.039329 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17d32f0-6075-4106-bdbc-6605043c0478 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:04.049509 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1054/2102] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:01:03 2021] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:01:04.053723 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b544a-f567-4273-80f9-f548b32dd542 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:04.064740 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b544a-f567-4273-80f9-f548b32dd542 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:04.069771 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612e6c0-b905-4cdc-8fd2-95f4cf0fe45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:04.070648 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612e6c0-b905-4cdc-8fd2-95f4cf0fe45b admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:04.070931 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612e6c0-b905-4cdc-8fd2-95f4cf0fe45b admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:04.071205 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612e6c0-b905-4cdc-8fd2-95f4cf0fe45b admin admin] PATH_INFO: `/v3/projects/77e96adc90b34eb3b1a7fa92ccfb2d0d/users/e42052fd54c141ba9443e706670362ea/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:04.073249 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2612e6c0-b905-4cdc-8fd2-95f4cf0fe45b admin admin] RBAC: Authorizing `identity:create_grant(project_id=77e96adc90b34eb3b1a7fa92ccfb2d0d, user_id=e42052fd54c141ba9443e706670362ea, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:04.075889 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2612e6c0-b905-4cdc-8fd2-95f4cf0fe45b admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:04.087372 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1049/2103] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:01:04 2021] PUT /identity/v3/projects/77e96adc90b34eb3b1a7fa92ccfb2d0d/users/e42052fd54c141ba9443e706670362ea/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:01:04.098079 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c66a74-3712-4c57-af57-3ef44a50e33c None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:04.098374 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c66a74-3712-4c57-af57-3ef44a50e33c None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:04.098680 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c66a74-3712-4c57-af57-3ef44a50e33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:04.126351 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-48c66a74-3712-4c57-af57-3ef44a50e33c None None] MFA Rules not processed for user `e42052fd54c141ba9443e706670362ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:01:04.127563 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-48c66a74-3712-4c57-af57-3ef44a50e33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:04.197513 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1055/2104] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:01:04 2021] POST /identity/v3/auth/tokens => generated 3297 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:01:04.208703 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612e6c0-b905-4cdc-8fd2-95f4cf0fe45b admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:04.271878 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612e6c0-b905-4cdc-8fd2-95f4cf0fe45b admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:04.276254 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6142949-95fd-43b2-8173-7617291c8b6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:04.276976 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6142949-95fd-43b2-8173-7617291c8b6f service cinder] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:04.277247 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6142949-95fd-43b2-8173-7617291c8b6f service cinder] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:04.277800 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6142949-95fd-43b2-8173-7617291c8b6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:04.288901 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6142949-95fd-43b2-8173-7617291c8b6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:04.290659 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6142949-95fd-43b2-8173-7617291c8b6f service cinder] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:04.302141 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1050/2105] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:01:04 2021] GET /identity/v3/auth/tokens => generated 3297 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:01:04.378678 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c66a74-3712-4c57-af57-3ef44a50e33c None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:04.388869 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c66a74-3712-4c57-af57-3ef44a50e33c None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:04.393401 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5643af60-8c85-46c7-8d3a-a11781a85003 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:04.394106 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643af60-8c85-46c7-8d3a-a11781a85003 service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:04.394360 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643af60-8c85-46c7-8d3a-a11781a85003 service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:04.394650 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643af60-8c85-46c7-8d3a-a11781a85003 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:04.458692 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5643af60-8c85-46c7-8d3a-a11781a85003 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:04.460365 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5643af60-8c85-46c7-8d3a-a11781a85003 service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:04.470286 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1056/2106] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:01:04 2021] GET /identity/v3/auth/tokens => generated 3230 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:01:08.317854 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6142949-95fd-43b2-8173-7617291c8b6f service cinder] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:08.405196 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6142949-95fd-43b2-8173-7617291c8b6f service cinder] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:08.410244 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd88ec-7e74-45cf-a00f-cda78498e4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:08.411323 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd88ec-7e74-45cf-a00f-cda78498e4fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:08.411811 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd88ec-7e74-45cf-a00f-cda78498e4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:08.412309 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd88ec-7e74-45cf-a00f-cda78498e4fb admin admin] PATH_INFO: `/v3/users/38413e4e5431476cb140c9c4821906da` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:08.414449 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd88ec-7e74-45cf-a00f-cda78498e4fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=38413e4e5431476cb140c9c4821906da)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:08.416832 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd88ec-7e74-45cf-a00f-cda78498e4fb admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:08.471300 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-58cd88ec-7e74-45cf-a00f-cda78498e4fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38413e4e5431476cb140c9c4821906da'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:08.471957 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-58cd88ec-7e74-45cf-a00f-cda78498e4fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38413e4e5431476cb140c9c4821906da'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:08.480950 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-58cd88ec-7e74-45cf-a00f-cda78498e4fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38413e4e5431476cb140c9c4821906da'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:08.492657 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-58cd88ec-7e74-45cf-a00f-cda78498e4fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38413e4e5431476cb140c9c4821906da'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:08.493741 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-58cd88ec-7e74-45cf-a00f-cda78498e4fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38413e4e5431476cb140c9c4821906da'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:08.520353 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1051/2107] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:01:08 2021] DELETE /identity/v3/users/38413e4e5431476cb140c9c4821906da => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:01:08.521569 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4355ddd-3133-4b44-b75f-68a679a35539 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:08.522003 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4355ddd-3133-4b44-b75f-68a679a35539 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:08.522119 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4355ddd-3133-4b44-b75f-68a679a35539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:08.542187 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-b4355ddd-3133-4b44-b75f-68a679a35539 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:01:08.543398 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-b4355ddd-3133-4b44-b75f-68a679a35539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:08.607344 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1057/2108] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:01:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 05:01:08.618913 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd88ec-7e74-45cf-a00f-cda78498e4fb admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:08.620386 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-58cd88ec-7e74-45cf-a00f-cda78498e4fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:08.684232 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd88ec-7e74-45cf-a00f-cda78498e4fb admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:08.693168 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf22b52-c0c8-4551-bad4-adbf34e9a8f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:08.693837 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf22b52-c0c8-4551-bad4-adbf34e9a8f8 service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:08.694119 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf22b52-c0c8-4551-bad4-adbf34e9a8f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:08.694490 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf22b52-c0c8-4551-bad4-adbf34e9a8f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:08.704681 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf22b52-c0c8-4551-bad4-adbf34e9a8f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:08.706141 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf22b52-c0c8-4551-bad4-adbf34e9a8f8 service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:08.716742 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1052/2109] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:01:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:01:09.025323 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4355ddd-3133-4b44-b75f-68a679a35539 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:09.027117 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-b4355ddd-3133-4b44-b75f-68a679a35539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:09.049781 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4355ddd-3133-4b44-b75f-68a679a35539 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:09.071895 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f3333-8ee8-41cb-8272-bcc862886097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:09.073322 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f3333-8ee8-41cb-8272-bcc862886097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:09.073782 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f3333-8ee8-41cb-8272-bcc862886097 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:09.074200 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f3333-8ee8-41cb-8272-bcc862886097 admin admin] PATH_INFO: `/v3/projects/f9ab9739d1554353a42853bbb50dfd54` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:09.083487 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f3333-8ee8-41cb-8272-bcc862886097 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9ab9739d1554353a42853bbb50dfd54)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:09.085969 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f3333-8ee8-41cb-8272-bcc862886097 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:09.138898 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-959f3333-8ee8-41cb-8272-bcc862886097 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9ab9739d1554353a42853bbb50dfd54', 'request_id': 'req-959f3333-8ee8-41cb-8272-bcc862886097'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:09.147949 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-959f3333-8ee8-41cb-8272-bcc862886097 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9ab9739d1554353a42853bbb50dfd54', 'request_id': 'req-959f3333-8ee8-41cb-8272-bcc862886097'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:09.156510 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-959f3333-8ee8-41cb-8272-bcc862886097 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9ab9739d1554353a42853bbb50dfd54', 'request_id': 'req-959f3333-8ee8-41cb-8272-bcc862886097'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:09.167691 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-959f3333-8ee8-41cb-8272-bcc862886097 admin admin] The token cache is being invalidate because project f9ab9739d1554353a42853bbb50dfd54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:01:09.167983 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-959f3333-8ee8-41cb-8272-bcc862886097 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:09.168675 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-959f3333-8ee8-41cb-8272-bcc862886097 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:09.170409 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1058/2110] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:01:09 2021] DELETE /identity/v3/projects/f9ab9739d1554353a42853bbb50dfd54 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:01:09.174388 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf22b52-c0c8-4551-bad4-adbf34e9a8f8 service neutron] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:09.184873 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf22b52-c0c8-4551-bad4-adbf34e9a8f8 service neutron] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:09.242697 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a9ab72-0591-4ed8-b198-828f479b738f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:09.243520 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a9ab72-0591-4ed8-b198-828f479b738f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:09.243797 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a9ab72-0591-4ed8-b198-828f479b738f admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:09.244065 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a9ab72-0591-4ed8-b198-828f479b738f admin admin] PATH_INFO: `/v3/users/e42052fd54c141ba9443e706670362ea` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:09.245354 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a9ab72-0591-4ed8-b198-828f479b738f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e42052fd54c141ba9443e706670362ea)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:09.247341 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a9ab72-0591-4ed8-b198-828f479b738f admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:09.304346 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-06a9ab72-0591-4ed8-b198-828f479b738f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e42052fd54c141ba9443e706670362ea'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:09.305065 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-06a9ab72-0591-4ed8-b198-828f479b738f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e42052fd54c141ba9443e706670362ea'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:09.312080 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-06a9ab72-0591-4ed8-b198-828f479b738f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e42052fd54c141ba9443e706670362ea'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:09.321362 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-06a9ab72-0591-4ed8-b198-828f479b738f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e42052fd54c141ba9443e706670362ea'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:09.322370 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-06a9ab72-0591-4ed8-b198-828f479b738f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e42052fd54c141ba9443e706670362ea'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:09.340644 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1053/2111] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:01:09 2021] DELETE /identity/v3/users/e42052fd54c141ba9443e706670362ea => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:01:09.611496 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f3333-8ee8-41cb-8272-bcc862886097 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:09.613869 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-959f3333-8ee8-41cb-8272-bcc862886097 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:09.636319 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f3333-8ee8-41cb-8272-bcc862886097 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:09.694810 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b597e88-7781-4885-84e7-b5c6d8de67b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:09.695848 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b597e88-7781-4885-84e7-b5c6d8de67b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:09.696223 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b597e88-7781-4885-84e7-b5c6d8de67b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:09.696627 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b597e88-7781-4885-84e7-b5c6d8de67b0 admin admin] PATH_INFO: `/v3/projects/77e96adc90b34eb3b1a7fa92ccfb2d0d` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:09.698091 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b597e88-7781-4885-84e7-b5c6d8de67b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77e96adc90b34eb3b1a7fa92ccfb2d0d)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:09.700132 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b597e88-7781-4885-84e7-b5c6d8de67b0 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:09.747797 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-6b597e88-7781-4885-84e7-b5c6d8de67b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77e96adc90b34eb3b1a7fa92ccfb2d0d', 'request_id': 'req-6b597e88-7781-4885-84e7-b5c6d8de67b0'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:09.756065 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-6b597e88-7781-4885-84e7-b5c6d8de67b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77e96adc90b34eb3b1a7fa92ccfb2d0d', 'request_id': 'req-6b597e88-7781-4885-84e7-b5c6d8de67b0'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:09.761845 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-6b597e88-7781-4885-84e7-b5c6d8de67b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77e96adc90b34eb3b1a7fa92ccfb2d0d', 'request_id': 'req-6b597e88-7781-4885-84e7-b5c6d8de67b0'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:09.773451 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-6b597e88-7781-4885-84e7-b5c6d8de67b0 admin admin] The token cache is being invalidate because project 77e96adc90b34eb3b1a7fa92ccfb2d0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:01:09.773737 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-6b597e88-7781-4885-84e7-b5c6d8de67b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:09.774377 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-6b597e88-7781-4885-84e7-b5c6d8de67b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:09.775930 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1059/2112] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:01:09 2021] DELETE /identity/v3/projects/77e96adc90b34eb3b1a7fa92ccfb2d0d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:01:09.782244 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a5f32-a56f-4b95-9b14-00f68b261ef7 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:09.782524 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a5f32-a56f-4b95-9b14-00f68b261ef7 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:09.782802 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a5f32-a56f-4b95-9b14-00f68b261ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:09.800255 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-774a5f32-a56f-4b95-9b14-00f68b261ef7 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:01:09.801525 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-774a5f32-a56f-4b95-9b14-00f68b261ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:09.870605 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1054/2113] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:01:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:01:09.879830 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d5071-f1d8-48f2-afc3-51410d0d87c1 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:09.880140 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d5071-f1d8-48f2-afc3-51410d0d87c1 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:09.880578 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d5071-f1d8-48f2-afc3-51410d0d87c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:09.900352 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-2a9d5071-f1d8-48f2-afc3-51410d0d87c1 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:01:09.901596 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-2a9d5071-f1d8-48f2-afc3-51410d0d87c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:09.914737 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1060/2114] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:01:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:01:09.921164 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a5f32-a56f-4b95-9b14-00f68b261ef7 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:09.938682 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a5f32-a56f-4b95-9b14-00f68b261ef7 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:09.947185 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17cfce-92e8-464c-a79b-661a9dd8b768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:09.948218 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17cfce-92e8-464c-a79b-661a9dd8b768 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:09.948708 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17cfce-92e8-464c-a79b-661a9dd8b768 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:09.949126 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17cfce-92e8-464c-a79b-661a9dd8b768 admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:09.950274 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef17cfce-92e8-464c-a79b-661a9dd8b768 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 05:01:09.950757 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef17cfce-92e8-464c-a79b-661a9dd8b768 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:09.952889 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef17cfce-92e8-464c-a79b-661a9dd8b768 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:09.967264 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1055/2115] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 05:01:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 05:01:09.971968 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d5071-f1d8-48f2-afc3-51410d0d87c1 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:09.982166 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d5071-f1d8-48f2-afc3-51410d0d87c1 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:09.988571 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cda136d-7834-4ed8-b1a5-27e8a428f53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:09.989223 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda136d-7834-4ed8-b1a5-27e8a428f53c admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:09.989503 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda136d-7834-4ed8-b1a5-27e8a428f53c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:09.989772 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda136d-7834-4ed8-b1a5-27e8a428f53c admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:09.990480 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cda136d-7834-4ed8-b1a5-27e8a428f53c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:09.992387 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cda136d-7834-4ed8-b1a5-27e8a428f53c admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:10.022050 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1061/2116] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:01:09 2021] POST /identity/v3/projects => generated 359 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:01:10.026532 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17cfce-92e8-464c-a79b-661a9dd8b768 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:10.037894 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17cfce-92e8-464c-a79b-661a9dd8b768 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:10.097446 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6f71b-758a-4365-b1d0-7faeafb2e89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:10.098147 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6f71b-758a-4365-b1d0-7faeafb2e89f admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:10.098421 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6f71b-758a-4365-b1d0-7faeafb2e89f admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:10.098695 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6f71b-758a-4365-b1d0-7faeafb2e89f admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:10.099416 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed6f71b-758a-4365-b1d0-7faeafb2e89f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:10.101450 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed6f71b-758a-4365-b1d0-7faeafb2e89f admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:10.126150 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1056/2117] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:01:10 2021] POST /identity/v3/users => generated 280 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 05:01:10.129936 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cda136d-7834-4ed8-b1a5-27e8a428f53c admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:10.140431 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cda136d-7834-4ed8-b1a5-27e8a428f53c admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:10.145459 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a3005-c6f8-4be4-b336-bba2723f2953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:10.146168 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a3005-c6f8-4be4-b336-bba2723f2953 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:10.146434 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a3005-c6f8-4be4-b336-bba2723f2953 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:10.146705 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a3005-c6f8-4be4-b336-bba2723f2953 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:10.147453 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a3005-c6f8-4be4-b336-bba2723f2953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:10.149092 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a3005-c6f8-4be4-b336-bba2723f2953 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:10.159661 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1062/2118] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:01:10 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:01:10.163639 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6f71b-758a-4365-b1d0-7faeafb2e89f admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:10.173750 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6f71b-758a-4365-b1d0-7faeafb2e89f admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:10.178501 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d96dbc-3fa5-4768-9829-dcea94dc2575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:10.179174 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d96dbc-3fa5-4768-9829-dcea94dc2575 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:10.179439 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d96dbc-3fa5-4768-9829-dcea94dc2575 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:10.179714 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d96dbc-3fa5-4768-9829-dcea94dc2575 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:10.180466 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d96dbc-3fa5-4768-9829-dcea94dc2575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:10.189110 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d96dbc-3fa5-4768-9829-dcea94dc2575 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:10.196097 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1057/2119] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:01:10 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 24 05:01:10.196810 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a3005-c6f8-4be4-b336-bba2723f2953 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:10.207018 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a3005-c6f8-4be4-b336-bba2723f2953 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:10.212315 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9160b3ba-2ca6-41c7-98b7-604155c9bf1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:10.213229 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160b3ba-2ca6-41c7-98b7-604155c9bf1c admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:10.213511 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160b3ba-2ca6-41c7-98b7-604155c9bf1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:10.213783 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160b3ba-2ca6-41c7-98b7-604155c9bf1c admin admin] PATH_INFO: `/v3/projects/3d6cb4e1721a417ea95ef38bb3ee1d10/users/0c8550fb71da435497fc0fb9f4b53ad4/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:10.228324 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9160b3ba-2ca6-41c7-98b7-604155c9bf1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d6cb4e1721a417ea95ef38bb3ee1d10, user_id=0c8550fb71da435497fc0fb9f4b53ad4, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:10.231076 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9160b3ba-2ca6-41c7-98b7-604155c9bf1c admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:10.245173 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1063/2120] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:01:10 2021] PUT /identity/v3/projects/3d6cb4e1721a417ea95ef38bb3ee1d10/users/0c8550fb71da435497fc0fb9f4b53ad4/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:01:10.255840 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30185206-995f-4c51-938e-372f4620eaf1 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:10.256160 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30185206-995f-4c51-938e-372f4620eaf1 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:10.256441 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30185206-995f-4c51-938e-372f4620eaf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:10.284097 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-30185206-995f-4c51-938e-372f4620eaf1 None None] MFA Rules not processed for user `0c8550fb71da435497fc0fb9f4b53ad4`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:01:10.285505 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-30185206-995f-4c51-938e-372f4620eaf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:10.352829 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1058/2121] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:01:10 2021] POST /identity/v3/auth/tokens => generated 3226 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:01:10.379377 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9160b3ba-2ca6-41c7-98b7-604155c9bf1c admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:10.381064 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-9160b3ba-2ca6-41c7-98b7-604155c9bf1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:10.442446 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9160b3ba-2ca6-41c7-98b7-604155c9bf1c admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:10.447158 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fcb189-28f2-4681-901b-2041211cca2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:10.447810 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fcb189-28f2-4681-901b-2041211cca2a service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:10.448090 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fcb189-28f2-4681-901b-2041211cca2a service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:10.448362 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fcb189-28f2-4681-901b-2041211cca2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:10.457256 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fcb189-28f2-4681-901b-2041211cca2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:10.458681 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fcb189-28f2-4681-901b-2041211cca2a service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:10.468305 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1064/2122] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:01:10 2021] GET /identity/v3/auth/tokens => generated 3226 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:01:10.482325 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30185206-995f-4c51-938e-372f4620eaf1 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:10.544694 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30185206-995f-4c51-938e-372f4620eaf1 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:10.550244 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec276fbc-21f4-4b8b-8c4f-bbd67a336e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:10.551102 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec276fbc-21f4-4b8b-8c4f-bbd67a336e60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:10.551376 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec276fbc-21f4-4b8b-8c4f-bbd67a336e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:10.551645 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec276fbc-21f4-4b8b-8c4f-bbd67a336e60 admin admin] PATH_INFO: `/v3/users/0c8550fb71da435497fc0fb9f4b53ad4` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:10.552954 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec276fbc-21f4-4b8b-8c4f-bbd67a336e60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c8550fb71da435497fc0fb9f4b53ad4)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:10.554955 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec276fbc-21f4-4b8b-8c4f-bbd67a336e60 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:10.605951 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-ec276fbc-21f4-4b8b-8c4f-bbd67a336e60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c8550fb71da435497fc0fb9f4b53ad4'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:10.606636 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-ec276fbc-21f4-4b8b-8c4f-bbd67a336e60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c8550fb71da435497fc0fb9f4b53ad4'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:10.613714 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-ec276fbc-21f4-4b8b-8c4f-bbd67a336e60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c8550fb71da435497fc0fb9f4b53ad4'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:10.623339 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-ec276fbc-21f4-4b8b-8c4f-bbd67a336e60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c8550fb71da435497fc0fb9f4b53ad4'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:10.624029 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-ec276fbc-21f4-4b8b-8c4f-bbd67a336e60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c8550fb71da435497fc0fb9f4b53ad4'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:10.641015 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1059/2123] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:01:10 2021] DELETE /identity/v3/users/0c8550fb71da435497fc0fb9f4b53ad4 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:01:10.646625 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9ee0a-a178-4f0c-b096-36c47e64bca4 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:10.647122 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9ee0a-a178-4f0c-b096-36c47e64bca4 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:10.647211 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9ee0a-a178-4f0c-b096-36c47e64bca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:10.672714 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-00d9ee0a-a178-4f0c-b096-36c47e64bca4 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:01:10.673932 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-00d9ee0a-a178-4f0c-b096-36c47e64bca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:10.736859 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1065/2124] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:01:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:01:10.747146 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec276fbc-21f4-4b8b-8c4f-bbd67a336e60 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:10.749109 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-ec276fbc-21f4-4b8b-8c4f-bbd67a336e60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:10.808909 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec276fbc-21f4-4b8b-8c4f-bbd67a336e60 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:10.813032 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848114f7-c6e4-4954-8984-0c9f8c7f8775 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:10.813682 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848114f7-c6e4-4954-8984-0c9f8c7f8775 service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:10.813962 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848114f7-c6e4-4954-8984-0c9f8c7f8775 service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:10.814233 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848114f7-c6e4-4954-8984-0c9f8c7f8775 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:10.823628 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848114f7-c6e4-4954-8984-0c9f8c7f8775 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:10.825167 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848114f7-c6e4-4954-8984-0c9f8c7f8775 service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:10.835902 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1060/2125] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:01:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:01:11.108828 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d9ee0a-a178-4f0c-b096-36c47e64bca4 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:11.110531 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-00d9ee0a-a178-4f0c-b096-36c47e64bca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:11.134626 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d9ee0a-a178-4f0c-b096-36c47e64bca4 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:11.141964 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c7f26-25ba-4e0b-88d1-529349263522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:11.142841 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c7f26-25ba-4e0b-88d1-529349263522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:11.143127 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c7f26-25ba-4e0b-88d1-529349263522 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:11.143503 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c7f26-25ba-4e0b-88d1-529349263522 admin admin] PATH_INFO: `/v3/projects/3d6cb4e1721a417ea95ef38bb3ee1d10` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:11.145487 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c7f26-25ba-4e0b-88d1-529349263522 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d6cb4e1721a417ea95ef38bb3ee1d10)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:11.147454 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c7f26-25ba-4e0b-88d1-529349263522 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:11.200328 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-c01c7f26-25ba-4e0b-88d1-529349263522 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d6cb4e1721a417ea95ef38bb3ee1d10', 'request_id': 'req-c01c7f26-25ba-4e0b-88d1-529349263522'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:11.209713 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-c01c7f26-25ba-4e0b-88d1-529349263522 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d6cb4e1721a417ea95ef38bb3ee1d10', 'request_id': 'req-c01c7f26-25ba-4e0b-88d1-529349263522'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:11.215450 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-c01c7f26-25ba-4e0b-88d1-529349263522 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d6cb4e1721a417ea95ef38bb3ee1d10', 'request_id': 'req-c01c7f26-25ba-4e0b-88d1-529349263522'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:11.226943 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-c01c7f26-25ba-4e0b-88d1-529349263522 admin admin] The token cache is being invalidate because project 3d6cb4e1721a417ea95ef38bb3ee1d10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:01:11.227223 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-c01c7f26-25ba-4e0b-88d1-529349263522 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:11.227875 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-c01c7f26-25ba-4e0b-88d1-529349263522 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:11.229482 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1066/2126] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:01:11 2021] DELETE /identity/v3/projects/3d6cb4e1721a417ea95ef38bb3ee1d10 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:01:11.235703 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de8fce-0d69-41e0-b5da-01604c5fa40d None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:11.236050 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de8fce-0d69-41e0-b5da-01604c5fa40d None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:11.236383 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de8fce-0d69-41e0-b5da-01604c5fa40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:11.254648 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-e9de8fce-0d69-41e0-b5da-01604c5fa40d None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:01:11.256046 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-e9de8fce-0d69-41e0-b5da-01604c5fa40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:11.324862 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1061/2127] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:01:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:01:11.333836 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30326104-b309-42f2-a459-a0ca533fd58d None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:11.334123 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30326104-b309-42f2-a459-a0ca533fd58d None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:11.334394 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30326104-b309-42f2-a459-a0ca533fd58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:11.353522 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-30326104-b309-42f2-a459-a0ca533fd58d None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:01:11.354640 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-30326104-b309-42f2-a459-a0ca533fd58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:11.363315 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1067/2128] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:01:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:01:11.369347 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de8fce-0d69-41e0-b5da-01604c5fa40d None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:11.380023 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de8fce-0d69-41e0-b5da-01604c5fa40d None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:11.384806 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc5628-650c-4e40-af1d-326d015cb436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:11.385461 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc5628-650c-4e40-af1d-326d015cb436 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:11.385757 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc5628-650c-4e40-af1d-326d015cb436 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:11.386013 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc5628-650c-4e40-af1d-326d015cb436 admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:11.386788 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efc5628-650c-4e40-af1d-326d015cb436 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 05:01:11.387092 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efc5628-650c-4e40-af1d-326d015cb436 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:11.388720 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efc5628-650c-4e40-af1d-326d015cb436 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:11.400985 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1062/2129] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 05:01:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 05:01:11.405344 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30326104-b309-42f2-a459-a0ca533fd58d None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:11.414496 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30326104-b309-42f2-a459-a0ca533fd58d None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:11.419325 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be15dc-09e9-4027-b4f9-9818a6919a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:11.419983 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be15dc-09e9-4027-b4f9-9818a6919a90 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:11.420267 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be15dc-09e9-4027-b4f9-9818a6919a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:11.420575 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be15dc-09e9-4027-b4f9-9818a6919a90 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:11.421289 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82be15dc-09e9-4027-b4f9-9818a6919a90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:11.423613 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82be15dc-09e9-4027-b4f9-9818a6919a90 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:11.451970 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1068/2130] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:01:11 2021] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:01:11.456167 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc5628-650c-4e40-af1d-326d015cb436 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:11.466897 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc5628-650c-4e40-af1d-326d015cb436 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:11.524947 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf933f7-91d0-4345-9034-da69c786a63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:11.525742 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf933f7-91d0-4345-9034-da69c786a63b admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:11.526024 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf933f7-91d0-4345-9034-da69c786a63b admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:11.526312 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf933f7-91d0-4345-9034-da69c786a63b admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:11.527011 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf933f7-91d0-4345-9034-da69c786a63b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:11.529040 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf933f7-91d0-4345-9034-da69c786a63b admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:11.550865 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1063/2131] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:01:11 2021] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:01:11.555081 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be15dc-09e9-4027-b4f9-9818a6919a90 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:11.565816 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be15dc-09e9-4027-b4f9-9818a6919a90 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:11.571477 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305911e-2824-4ca8-ad3a-0276e2efb553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:11.572169 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305911e-2824-4ca8-ad3a-0276e2efb553 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:11.572449 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305911e-2824-4ca8-ad3a-0276e2efb553 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:11.572757 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305911e-2824-4ca8-ad3a-0276e2efb553 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:11.573512 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f305911e-2824-4ca8-ad3a-0276e2efb553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:11.575191 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f305911e-2824-4ca8-ad3a-0276e2efb553 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:11.585399 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1069/2132] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:01:11 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:01:11.589416 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf933f7-91d0-4345-9034-da69c786a63b admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:11.600004 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf933f7-91d0-4345-9034-da69c786a63b admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:11.605244 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c6e08d-e15c-4196-a9d6-90c813d65ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:11.605824 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6e08d-e15c-4196-a9d6-90c813d65ddf admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:11.606154 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6e08d-e15c-4196-a9d6-90c813d65ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:11.606433 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6e08d-e15c-4196-a9d6-90c813d65ddf admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:11.607274 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c6e08d-e15c-4196-a9d6-90c813d65ddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:11.608990 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c6e08d-e15c-4196-a9d6-90c813d65ddf admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:11.621535 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1064/2133] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:01:11 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:01:11.625825 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305911e-2824-4ca8-ad3a-0276e2efb553 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:11.635811 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305911e-2824-4ca8-ad3a-0276e2efb553 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:11.641291 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afabb7d6-d4f5-4e13-980e-c0aa2295ad42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:11.642210 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afabb7d6-d4f5-4e13-980e-c0aa2295ad42 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:11.642481 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afabb7d6-d4f5-4e13-980e-c0aa2295ad42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:11.642749 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afabb7d6-d4f5-4e13-980e-c0aa2295ad42 admin admin] PATH_INFO: `/v3/projects/2cef64dc84ce4b078d87def0a50d04fc/users/b72895bc05a5419ebd84c06a91c5aaef/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:11.657685 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afabb7d6-d4f5-4e13-980e-c0aa2295ad42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cef64dc84ce4b078d87def0a50d04fc, user_id=b72895bc05a5419ebd84c06a91c5aaef, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:11.660352 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afabb7d6-d4f5-4e13-980e-c0aa2295ad42 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:11.676377 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1070/2134] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:01:11 2021] PUT /identity/v3/projects/2cef64dc84ce4b078d87def0a50d04fc/users/b72895bc05a5419ebd84c06a91c5aaef/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:01:11.687572 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac76687-1377-4315-ad26-57d0983b5e45 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:11.687987 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac76687-1377-4315-ad26-57d0983b5e45 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:11.688267 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac76687-1377-4315-ad26-57d0983b5e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:11.723765 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-7ac76687-1377-4315-ad26-57d0983b5e45 None None] MFA Rules not processed for user `b72895bc05a5419ebd84c06a91c5aaef`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:01:11.725017 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-7ac76687-1377-4315-ad26-57d0983b5e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:11.790887 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1065/2135] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:01:11 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:01:11.803752 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afabb7d6-d4f5-4e13-980e-c0aa2295ad42 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:11.805630 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-afabb7d6-d4f5-4e13-980e-c0aa2295ad42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:11.863517 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afabb7d6-d4f5-4e13-980e-c0aa2295ad42 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:11.867711 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e6223d-b145-47be-89a9-93fb7beafa2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:11.868355 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6223d-b145-47be-89a9-93fb7beafa2f service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:11.868663 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6223d-b145-47be-89a9-93fb7beafa2f service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:11.868944 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6223d-b145-47be-89a9-93fb7beafa2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:11.877951 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e6223d-b145-47be-89a9-93fb7beafa2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:11.879377 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e6223d-b145-47be-89a9-93fb7beafa2f service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:11.888718 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1071/2136] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:01:11 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:01:15.350416 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac76687-1377-4315-ad26-57d0983b5e45 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:15.351225 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e6223d-b145-47be-89a9-93fb7beafa2f service cinder] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:15.352997 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-c6e6223d-b145-47be-89a9-93fb7beafa2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:15.353202 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-7ac76687-1377-4315-ad26-57d0983b5e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:15.418537 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac76687-1377-4315-ad26-57d0983b5e45 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:15.421698 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e6223d-b145-47be-89a9-93fb7beafa2f service cinder] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:15.423648 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06518907-f823-456f-b745-6696a3817b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:15.424519 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06518907-f823-456f-b745-6696a3817b7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:15.424823 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06518907-f823-456f-b745-6696a3817b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:15.425095 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06518907-f823-456f-b745-6696a3817b7f admin admin] PATH_INFO: `/v3/users/8595d548c7a94c029b8c3fb6a0201e87` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:15.426311 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06518907-f823-456f-b745-6696a3817b7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8595d548c7a94c029b8c3fb6a0201e87)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:15.427333 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e40556e-8003-4614-affa-d43dca198402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:15.428375 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40556e-8003-4614-affa-d43dca198402 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:15.428846 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40556e-8003-4614-affa-d43dca198402 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:15.429066 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06518907-f823-456f-b745-6696a3817b7f admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:15.429409 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40556e-8003-4614-affa-d43dca198402 admin admin] PATH_INFO: `/v3/users/b490cc71f0534dbe8a8e63ec06ead6c3` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:15.431448 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e40556e-8003-4614-affa-d43dca198402 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b490cc71f0534dbe8a8e63ec06ead6c3)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:15.433593 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e40556e-8003-4614-affa-d43dca198402 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:15.491871 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-06518907-f823-456f-b745-6696a3817b7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8595d548c7a94c029b8c3fb6a0201e87'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:15.492625 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-06518907-f823-456f-b745-6696a3817b7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8595d548c7a94c029b8c3fb6a0201e87'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:15.493722 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-4e40556e-8003-4614-affa-d43dca198402 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b490cc71f0534dbe8a8e63ec06ead6c3'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:15.494730 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-4e40556e-8003-4614-affa-d43dca198402 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b490cc71f0534dbe8a8e63ec06ead6c3'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:15.500287 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-06518907-f823-456f-b745-6696a3817b7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8595d548c7a94c029b8c3fb6a0201e87'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:15.506057 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-4e40556e-8003-4614-affa-d43dca198402 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b490cc71f0534dbe8a8e63ec06ead6c3'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:15.510780 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-06518907-f823-456f-b745-6696a3817b7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8595d548c7a94c029b8c3fb6a0201e87'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:15.512899 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-06518907-f823-456f-b745-6696a3817b7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8595d548c7a94c029b8c3fb6a0201e87'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:15.513637 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-4e40556e-8003-4614-affa-d43dca198402 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b490cc71f0534dbe8a8e63ec06ead6c3'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:15.525359 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-4e40556e-8003-4614-affa-d43dca198402 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b490cc71f0534dbe8a8e63ec06ead6c3'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:15.530739 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1066/2137] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:01:15 2021] DELETE /identity/v3/users/8595d548c7a94c029b8c3fb6a0201e87 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:01:15.531688 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1072/2138] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:01:15 2021] DELETE /identity/v3/users/b490cc71f0534dbe8a8e63ec06ead6c3 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:01:15.537618 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a56bd-c07c-4e8a-9edd-4bcf0888c213 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:15.537770 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce02300-ed97-45ba-a771-539db88765d2 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:15.537921 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a56bd-c07c-4e8a-9edd-4bcf0888c213 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:15.538025 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce02300-ed97-45ba-a771-539db88765d2 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:15.538191 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce02300-ed97-45ba-a771-539db88765d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:15.538427 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a56bd-c07c-4e8a-9edd-4bcf0888c213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:15.556601 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-0ce02300-ed97-45ba-a771-539db88765d2 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:01:15.558156 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-0ce02300-ed97-45ba-a771-539db88765d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:15.558456 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-9c7a56bd-c07c-4e8a-9edd-4bcf0888c213 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:01:15.559676 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-9c7a56bd-c07c-4e8a-9edd-4bcf0888c213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:15.618213 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1067/2139] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:01:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:01:15.618675 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1073/2140] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:01:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:01:15.628796 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce02300-ed97-45ba-a771-539db88765d2 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:15.629546 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a56bd-c07c-4e8a-9edd-4bcf0888c213 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:15.630196 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-0ce02300-ed97-45ba-a771-539db88765d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:15.631101 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-9c7a56bd-c07c-4e8a-9edd-4bcf0888c213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:15.687799 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a56bd-c07c-4e8a-9edd-4bcf0888c213 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:15.688651 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce02300-ed97-45ba-a771-539db88765d2 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:15.694310 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29cfea-cdc5-4f21-b10f-6999fabceb82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:15.695063 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29cfea-cdc5-4f21-b10f-6999fabceb82 service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:15.695268 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29cfea-cdc5-4f21-b10f-6999fabceb82 service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:15.695618 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29cfea-cdc5-4f21-b10f-6999fabceb82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:15.695723 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5913744d-19f8-4c8b-a616-572c94b740b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:15.696328 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913744d-19f8-4c8b-a616-572c94b740b3 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:15.696654 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913744d-19f8-4c8b-a616-572c94b740b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:15.696895 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913744d-19f8-4c8b-a616-572c94b740b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:15.710802 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f29cfea-cdc5-4f21-b10f-6999fabceb82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:15.712302 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f29cfea-cdc5-4f21-b10f-6999fabceb82 service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:15.713275 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5913744d-19f8-4c8b-a616-572c94b740b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:15.714724 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5913744d-19f8-4c8b-a616-572c94b740b3 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:15.722922 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1068/2141] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:01:15 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 24 05:01:15.725935 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1074/2142] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:01:15 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 24 05:01:16.026261 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29cfea-cdc5-4f21-b10f-6999fabceb82 service neutron] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:16.028245 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-4f29cfea-cdc5-4f21-b10f-6999fabceb82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:16.064602 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29cfea-cdc5-4f21-b10f-6999fabceb82 service neutron] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:16.069531 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c5185-b00d-4e1e-a111-f1ace314ff05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:16.070386 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c5185-b00d-4e1e-a111-f1ace314ff05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:16.070667 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c5185-b00d-4e1e-a111-f1ace314ff05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:16.070960 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c5185-b00d-4e1e-a111-f1ace314ff05 admin admin] PATH_INFO: `/v3/projects/ba66883669904fcb843534f93dfdb65e` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:16.072165 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37c5185-b00d-4e1e-a111-f1ace314ff05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba66883669904fcb843534f93dfdb65e)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:16.074452 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37c5185-b00d-4e1e-a111-f1ace314ff05 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:16.095658 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5913744d-19f8-4c8b-a616-572c94b740b3 service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:16.097659 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-5913744d-19f8-4c8b-a616-572c94b740b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:16.112811 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5913744d-19f8-4c8b-a616-572c94b740b3 service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:16.119970 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7a620-187a-4d7f-968c-7c5bcd6e53ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:16.121284 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7a620-187a-4d7f-968c-7c5bcd6e53ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:16.121589 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7a620-187a-4d7f-968c-7c5bcd6e53ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:16.122098 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7a620-187a-4d7f-968c-7c5bcd6e53ee admin admin] PATH_INFO: `/v3/projects/9ef3eae52dae493e8ecc57504836d7f0` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:16.124007 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb7a620-187a-4d7f-968c-7c5bcd6e53ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ef3eae52dae493e8ecc57504836d7f0)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:16.127297 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb7a620-187a-4d7f-968c-7c5bcd6e53ee admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:16.135203 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-e37c5185-b00d-4e1e-a111-f1ace314ff05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba66883669904fcb843534f93dfdb65e', 'request_id': 'req-e37c5185-b00d-4e1e-a111-f1ace314ff05'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:16.144439 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-e37c5185-b00d-4e1e-a111-f1ace314ff05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba66883669904fcb843534f93dfdb65e', 'request_id': 'req-e37c5185-b00d-4e1e-a111-f1ace314ff05'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:16.157180 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-e37c5185-b00d-4e1e-a111-f1ace314ff05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba66883669904fcb843534f93dfdb65e', 'request_id': 'req-e37c5185-b00d-4e1e-a111-f1ace314ff05'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:16.172344 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-e37c5185-b00d-4e1e-a111-f1ace314ff05 admin admin] The token cache is being invalidate because project ba66883669904fcb843534f93dfdb65e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:01:16.173111 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-e37c5185-b00d-4e1e-a111-f1ace314ff05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:16.174094 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-e37c5185-b00d-4e1e-a111-f1ace314ff05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:16.181161 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1069/2143] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:01:16 2021] DELETE /identity/v3/projects/ba66883669904fcb843534f93dfdb65e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:01:16.183130 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc106372-ef28-4e6b-9fe7-621565c723d0 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:16.183415 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc106372-ef28-4e6b-9fe7-621565c723d0 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:16.183692 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc106372-ef28-4e6b-9fe7-621565c723d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:16.184902 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-7cb7a620-187a-4d7f-968c-7c5bcd6e53ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ef3eae52dae493e8ecc57504836d7f0', 'request_id': 'req-7cb7a620-187a-4d7f-968c-7c5bcd6e53ee'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:16.193520 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-7cb7a620-187a-4d7f-968c-7c5bcd6e53ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ef3eae52dae493e8ecc57504836d7f0', 'request_id': 'req-7cb7a620-187a-4d7f-968c-7c5bcd6e53ee'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:16.199573 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-7cb7a620-187a-4d7f-968c-7c5bcd6e53ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ef3eae52dae493e8ecc57504836d7f0', 'request_id': 'req-7cb7a620-187a-4d7f-968c-7c5bcd6e53ee'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:16.204606 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-dc106372-ef28-4e6b-9fe7-621565c723d0 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:01:16.205896 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-dc106372-ef28-4e6b-9fe7-621565c723d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:16.215281 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-7cb7a620-187a-4d7f-968c-7c5bcd6e53ee admin admin] The token cache is being invalidate because project 9ef3eae52dae493e8ecc57504836d7f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:01:16.216226 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-7cb7a620-187a-4d7f-968c-7c5bcd6e53ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:16.216624 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-7cb7a620-187a-4d7f-968c-7c5bcd6e53ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:16.220611 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1075/2144] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:01:16 2021] DELETE /identity/v3/projects/9ef3eae52dae493e8ecc57504836d7f0 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:01:16.224190 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a8de5-4e2c-45ad-8768-8381879047db None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:16.224585 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a8de5-4e2c-45ad-8768-8381879047db None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:16.224944 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a8de5-4e2c-45ad-8768-8381879047db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:16.244785 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-434a8de5-4e2c-45ad-8768-8381879047db None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:01:16.246102 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-434a8de5-4e2c-45ad-8768-8381879047db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:16.275749 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1070/2145] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:01:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:01:16.284380 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c90f4-1ba0-439b-8ce7-061a9de213e5 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:16.285288 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c90f4-1ba0-439b-8ce7-061a9de213e5 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:16.285288 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c90f4-1ba0-439b-8ce7-061a9de213e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:16.303993 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-148c90f4-1ba0-439b-8ce7-061a9de213e5 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:01:16.305433 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-148c90f4-1ba0-439b-8ce7-061a9de213e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:16.316673 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1076/2146] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:01:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 05:01:16.319965 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1071/2147] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:01:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:01:16.323182 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a8de5-4e2c-45ad-8768-8381879047db None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:16.323901 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b960a8-b080-4b28-a16c-a0a5249efb29 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:16.324191 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b960a8-b080-4b28-a16c-a0a5249efb29 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:16.324699 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b960a8-b080-4b28-a16c-a0a5249efb29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:16.333410 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a8de5-4e2c-45ad-8768-8381879047db None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:16.344206 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4fc30c-12ff-4673-8597-3f74c5c178c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:16.346615 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4fc30c-12ff-4673-8597-3f74c5c178c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:16.346615 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4fc30c-12ff-4673-8597-3f74c5c178c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:16.346615 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4fc30c-12ff-4673-8597-3f74c5c178c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:16.346928 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4fc30c-12ff-4673-8597-3f74c5c178c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 05:01:16.347127 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4fc30c-12ff-4673-8597-3f74c5c178c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:16.348767 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4fc30c-12ff-4673-8597-3f74c5c178c8 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:16.351978 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-57b960a8-b080-4b28-a16c-a0a5249efb29 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:01:16.353358 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-57b960a8-b080-4b28-a16c-a0a5249efb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:16.360587 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1077/2148] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 05:01:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 05:01:16.361758 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1072/2149] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:01:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 05:01:16.364888 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4fc30c-12ff-4673-8597-3f74c5c178c8 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:16.365744 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b960a8-b080-4b28-a16c-a0a5249efb29 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:16.374347 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4fc30c-12ff-4673-8597-3f74c5c178c8 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:16.374741 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b960a8-b080-4b28-a16c-a0a5249efb29 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:16.378936 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ff948-4f5b-4234-969c-d26198e87db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:16.379399 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fcf608-8a9e-4aa4-b52a-dbdcc53f244b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:16.379566 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ff948-4f5b-4234-969c-d26198e87db2 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:16.379846 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ff948-4f5b-4234-969c-d26198e87db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:16.380121 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ff948-4f5b-4234-969c-d26198e87db2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:16.380313 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fcf608-8a9e-4aa4-b52a-dbdcc53f244b admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:16.380665 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fcf608-8a9e-4aa4-b52a-dbdcc53f244b admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:16.380840 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617ff948-4f5b-4234-969c-d26198e87db2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:16.381060 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fcf608-8a9e-4aa4-b52a-dbdcc53f244b admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:16.381867 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fcf608-8a9e-4aa4-b52a-dbdcc53f244b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 05:01:16.382240 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fcf608-8a9e-4aa4-b52a-dbdcc53f244b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:16.382716 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617ff948-4f5b-4234-969c-d26198e87db2 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:16.383982 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fcf608-8a9e-4aa4-b52a-dbdcc53f244b admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:16.395741 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1073/2150] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 05:01:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 05:01:16.400514 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fcf608-8a9e-4aa4-b52a-dbdcc53f244b admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:16.411157 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fcf608-8a9e-4aa4-b52a-dbdcc53f244b admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:16.411709 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1078/2151] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:01:16 2021] POST /identity/v3/projects => generated 389 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 05:01:16.415443 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ff948-4f5b-4234-969c-d26198e87db2 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:16.466907 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef04e6f-1de6-4d14-94ee-77ea0df29fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:16.467595 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef04e6f-1de6-4d14-94ee-77ea0df29fe4 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:16.467875 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef04e6f-1de6-4d14-94ee-77ea0df29fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:16.468149 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef04e6f-1de6-4d14-94ee-77ea0df29fe4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:16.468921 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef04e6f-1de6-4d14-94ee-77ea0df29fe4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:16.470917 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef04e6f-1de6-4d14-94ee-77ea0df29fe4 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:16.477119 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ff948-4f5b-4234-969c-d26198e87db2 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:16.482179 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96620bbd-3a7b-4c1a-a69e-2ceb6418aaf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:16.482845 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96620bbd-3a7b-4c1a-a69e-2ceb6418aaf9 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:16.483124 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96620bbd-3a7b-4c1a-a69e-2ceb6418aaf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:16.483393 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96620bbd-3a7b-4c1a-a69e-2ceb6418aaf9 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:16.484091 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96620bbd-3a7b-4c1a-a69e-2ceb6418aaf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:16.486178 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96620bbd-3a7b-4c1a-a69e-2ceb6418aaf9 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:16.497550 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1074/2152] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:01:16 2021] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:01:16.501683 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef04e6f-1de6-4d14-94ee-77ea0df29fe4 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:16.515514 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1079/2153] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:01:16 2021] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 05:01:16.516853 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96620bbd-3a7b-4c1a-a69e-2ceb6418aaf9 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:16.526771 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96620bbd-3a7b-4c1a-a69e-2ceb6418aaf9 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:16.567277 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef04e6f-1de6-4d14-94ee-77ea0df29fe4 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:16.572087 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8695b0e-6262-48f1-a513-5f8253e30171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:16.572797 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8695b0e-6262-48f1-a513-5f8253e30171 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:16.573082 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8695b0e-6262-48f1-a513-5f8253e30171 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:16.573352 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8695b0e-6262-48f1-a513-5f8253e30171 admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:16.574065 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8695b0e-6262-48f1-a513-5f8253e30171 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:16.575997 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8695b0e-6262-48f1-a513-5f8253e30171 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:16.580233 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef345432-15b1-4ee3-914b-42ced8550196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:16.580986 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef345432-15b1-4ee3-914b-42ced8550196 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:16.581268 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef345432-15b1-4ee3-914b-42ced8550196 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:16.581550 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef345432-15b1-4ee3-914b-42ced8550196 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:16.582353 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef345432-15b1-4ee3-914b-42ced8550196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:16.584014 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef345432-15b1-4ee3-914b-42ced8550196 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:16.602333 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1080/2154] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:01:16 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 24 05:01:16.602753 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1075/2155] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:01:16 2021] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:01:16.602753 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8695b0e-6262-48f1-a513-5f8253e30171 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:16.603856 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef345432-15b1-4ee3-914b-42ced8550196 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:16.613641 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef345432-15b1-4ee3-914b-42ced8550196 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:16.615344 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8695b0e-6262-48f1-a513-5f8253e30171 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:16.618459 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69e75a-5691-47f5-ac05-34291a9f16ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:16.619142 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69e75a-5691-47f5-ac05-34291a9f16ce admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:16.619417 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69e75a-5691-47f5-ac05-34291a9f16ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:16.619732 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69e75a-5691-47f5-ac05-34291a9f16ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:16.620476 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f69e75a-5691-47f5-ac05-34291a9f16ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:16.620636 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b571f538-6d5a-4e37-b72c-e95d5eda6f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:16.621294 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571f538-6d5a-4e37-b72c-e95d5eda6f5d admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:16.621582 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571f538-6d5a-4e37-b72c-e95d5eda6f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:16.622033 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571f538-6d5a-4e37-b72c-e95d5eda6f5d admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:16.622138 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f69e75a-5691-47f5-ac05-34291a9f16ce admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:16.622791 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b571f538-6d5a-4e37-b72c-e95d5eda6f5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:16.624445 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b571f538-6d5a-4e37-b72c-e95d5eda6f5d admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:16.635518 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1081/2156] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:01:16 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:01:16.635697 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1076/2157] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:01:16 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 24 05:01:16.637078 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69e75a-5691-47f5-ac05-34291a9f16ce admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:16.638643 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b571f538-6d5a-4e37-b72c-e95d5eda6f5d admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:16.647416 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69e75a-5691-47f5-ac05-34291a9f16ce admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:16.651245 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b571f538-6d5a-4e37-b72c-e95d5eda6f5d admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:16.652297 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f134ae-af24-48c5-98a3-d4a590e10af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:16.653240 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f134ae-af24-48c5-98a3-d4a590e10af3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:16.653507 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f134ae-af24-48c5-98a3-d4a590e10af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:16.653786 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f134ae-af24-48c5-98a3-d4a590e10af3 admin admin] PATH_INFO: `/v3/projects/a7d897479c3e4e11a56492bd9a1f09e1/users/0ac6e333bc984e68bb439b21b75369bb/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:16.657768 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d319e-78cd-4dd3-93aa-4c76fa74f4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:16.658651 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d319e-78cd-4dd3-93aa-4c76fa74f4fd admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:16.659094 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d319e-78cd-4dd3-93aa-4c76fa74f4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:16.659513 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d319e-78cd-4dd3-93aa-4c76fa74f4fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:16.660407 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2d319e-78cd-4dd3-93aa-4c76fa74f4fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:16.662293 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2d319e-78cd-4dd3-93aa-4c76fa74f4fd admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:16.669672 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f134ae-af24-48c5-98a3-d4a590e10af3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7d897479c3e4e11a56492bd9a1f09e1, user_id=0ac6e333bc984e68bb439b21b75369bb, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:16.672444 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f134ae-af24-48c5-98a3-d4a590e10af3 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:16.678808 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1077/2158] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:01:16 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 24 05:01:16.683870 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d319e-78cd-4dd3-93aa-4c76fa74f4fd admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:16.692595 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1082/2159] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:01:16 2021] PUT /identity/v3/projects/a7d897479c3e4e11a56492bd9a1f09e1/users/0ac6e333bc984e68bb439b21b75369bb/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 05:01:16.700111 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33f38e-c316-4f22-9a44-9636df10487a None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:16.700402 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33f38e-c316-4f22-9a44-9636df10487a None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:16.700749 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33f38e-c316-4f22-9a44-9636df10487a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:16.703125 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d319e-78cd-4dd3-93aa-4c76fa74f4fd admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:16.731653 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-4f33f38e-c316-4f22-9a44-9636df10487a None None] MFA Rules not processed for user `0ac6e333bc984e68bb439b21b75369bb`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:01:16.733005 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-4f33f38e-c316-4f22-9a44-9636df10487a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:16.767264 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7de53-ca9e-46af-8768-c56f1eac1ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:16.768186 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7de53-ca9e-46af-8768-c56f1eac1ac4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:16.768462 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7de53-ca9e-46af-8768-c56f1eac1ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:16.768987 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7de53-ca9e-46af-8768-c56f1eac1ac4 admin admin] PATH_INFO: `/v3/projects/9f946192a481435b99c52be706eeb5f3/users/3f3126c2a51d4bb5bee33a0dd6fc827c/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:16.783039 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b7de53-ca9e-46af-8768-c56f1eac1ac4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f946192a481435b99c52be706eeb5f3, user_id=3f3126c2a51d4bb5bee33a0dd6fc827c, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:16.785775 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b7de53-ca9e-46af-8768-c56f1eac1ac4 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:16.796573 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1083/2160] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:01:16 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 05:01:16.799844 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1078/2161] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:01:16 2021] PUT /identity/v3/projects/9f946192a481435b99c52be706eeb5f3/users/3f3126c2a51d4bb5bee33a0dd6fc827c/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 05:01:16.807096 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33f38e-c316-4f22-9a44-9636df10487a None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:16.808466 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-4f33f38e-c316-4f22-9a44-9636df10487a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:16.810081 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca458ea-04d2-4e4f-8099-dd9543594218 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:16.810486 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca458ea-04d2-4e4f-8099-dd9543594218 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:16.810789 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca458ea-04d2-4e4f-8099-dd9543594218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:16.837680 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-6ca458ea-04d2-4e4f-8099-dd9543594218 None None] MFA Rules not processed for user `3f3126c2a51d4bb5bee33a0dd6fc827c`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:01:16.838866 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-6ca458ea-04d2-4e4f-8099-dd9543594218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:16.865195 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33f38e-c316-4f22-9a44-9636df10487a None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:16.901882 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1079/2162] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:01:16 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:01:16.906357 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca458ea-04d2-4e4f-8099-dd9543594218 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:16.913100 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc34c9-f157-4fe7-950b-7e7a39dbfe34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:16.913751 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc34c9-f157-4fe7-950b-7e7a39dbfe34 service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:16.914037 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc34c9-f157-4fe7-950b-7e7a39dbfe34 service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:16.914303 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc34c9-f157-4fe7-950b-7e7a39dbfe34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:16.967059 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca458ea-04d2-4e4f-8099-dd9543594218 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:16.969108 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cc34c9-f157-4fe7-950b-7e7a39dbfe34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:16.970659 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cc34c9-f157-4fe7-950b-7e7a39dbfe34 service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:16.972442 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e33d7-b3b3-4c89-826f-86601006f14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:16.973119 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e33d7-b3b3-4c89-826f-86601006f14c admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:16.973398 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e33d7-b3b3-4c89-826f-86601006f14c admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:16.973845 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e33d7-b3b3-4c89-826f-86601006f14c admin admin] PATH_INFO: `/v3/projects` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:16.974590 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699e33d7-b3b3-4c89-826f-86601006f14c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:16.976565 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699e33d7-b3b3-4c89-826f-86601006f14c admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:16.979914 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1084/2163] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:01:16 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:01:17.007322 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1080/2164] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:01:16 2021] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 05:01:17.011817 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc34c9-f157-4fe7-950b-7e7a39dbfe34 service cinder] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:17.023344 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc34c9-f157-4fe7-950b-7e7a39dbfe34 service cinder] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:17.081894 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6378711-6905-4bfa-a0c4-0e9407d9acb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:17.082671 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6378711-6905-4bfa-a0c4-0e9407d9acb8 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:17.083017 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6378711-6905-4bfa-a0c4-0e9407d9acb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:17.083360 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6378711-6905-4bfa-a0c4-0e9407d9acb8 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:17.084173 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6378711-6905-4bfa-a0c4-0e9407d9acb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:17.086501 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6378711-6905-4bfa-a0c4-0e9407d9acb8 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:17.108821 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1085/2165] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:01:17 2021] POST /identity/v3/users => generated 298 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:01:17.113537 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e33d7-b3b3-4c89-826f-86601006f14c admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:17.125451 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e33d7-b3b3-4c89-826f-86601006f14c admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:17.131762 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda764c-910a-4c78-a0aa-edaf27bf73f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:17.132413 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda764c-910a-4c78-a0aa-edaf27bf73f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:17.132728 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda764c-910a-4c78-a0aa-edaf27bf73f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:17.133006 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda764c-910a-4c78-a0aa-edaf27bf73f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:17.133804 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fda764c-910a-4c78-a0aa-edaf27bf73f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:17.135493 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fda764c-910a-4c78-a0aa-edaf27bf73f6 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:17.150575 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1081/2166] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:01:17 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:01:17.152141 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6378711-6905-4bfa-a0c4-0e9407d9acb8 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:17.167537 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6378711-6905-4bfa-a0c4-0e9407d9acb8 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:17.174639 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a537f8f-69b0-49cf-90c2-ce2432b24716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:17.175785 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a537f8f-69b0-49cf-90c2-ce2432b24716 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:17.176084 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a537f8f-69b0-49cf-90c2-ce2432b24716 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:17.176467 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a537f8f-69b0-49cf-90c2-ce2432b24716 admin admin] PATH_INFO: `/v3/projects/756fefc6141a4559af0d3b169ad99d09/users/db0a014dab1f43d28d37c592f6c72323/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:17.198572 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a537f8f-69b0-49cf-90c2-ce2432b24716 admin admin] RBAC: Authorizing `identity:create_grant(project_id=756fefc6141a4559af0d3b169ad99d09, user_id=db0a014dab1f43d28d37c592f6c72323, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:17.201580 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a537f8f-69b0-49cf-90c2-ce2432b24716 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:17.224435 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1086/2167] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:01:17 2021] PUT /identity/v3/projects/756fefc6141a4559af0d3b169ad99d09/users/db0a014dab1f43d28d37c592f6c72323/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 05:01:17.231524 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda764c-910a-4c78-a0aa-edaf27bf73f6 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:17.249547 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda764c-910a-4c78-a0aa-edaf27bf73f6 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:17.320651 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51397427-7023-48e6-82db-ae048319d62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:17.321410 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51397427-7023-48e6-82db-ae048319d62b admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:17.321755 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51397427-7023-48e6-82db-ae048319d62b admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:17.322092 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51397427-7023-48e6-82db-ae048319d62b admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:17.323080 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51397427-7023-48e6-82db-ae048319d62b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:17.325097 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51397427-7023-48e6-82db-ae048319d62b admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:17.336352 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1082/2168] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:01:17 2021] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:01:17.344742 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a537f8f-69b0-49cf-90c2-ce2432b24716 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:17.355603 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a537f8f-69b0-49cf-90c2-ce2432b24716 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:17.361715 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b6ff8-6d9d-4595-bcc5-20c07960e0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:17.362736 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b6ff8-6d9d-4595-bcc5-20c07960e0fd admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:17.363084 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b6ff8-6d9d-4595-bcc5-20c07960e0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:17.363446 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b6ff8-6d9d-4595-bcc5-20c07960e0fd admin admin] PATH_INFO: `/v3/projects/756fefc6141a4559af0d3b169ad99d09/users/db0a014dab1f43d28d37c592f6c72323/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:17.365612 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b6ff8-6d9d-4595-bcc5-20c07960e0fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=756fefc6141a4559af0d3b169ad99d09, user_id=db0a014dab1f43d28d37c592f6c72323, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:17.370200 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b6ff8-6d9d-4595-bcc5-20c07960e0fd admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:17.387089 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1087/2169] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:01:17 2021] PUT /identity/v3/projects/756fefc6141a4559af0d3b169ad99d09/users/db0a014dab1f43d28d37c592f6c72323/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:01:17.398963 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341af5dd-cc70-4324-8f59-2f68fb090c57 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:17.399486 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341af5dd-cc70-4324-8f59-2f68fb090c57 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:17.399486 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341af5dd-cc70-4324-8f59-2f68fb090c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:17.428375 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-341af5dd-cc70-4324-8f59-2f68fb090c57 None None] MFA Rules not processed for user `db0a014dab1f43d28d37c592f6c72323`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:01:17.429625 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-341af5dd-cc70-4324-8f59-2f68fb090c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:17.500213 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1083/2170] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:01:17 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:01:17.507414 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b6ff8-6d9d-4595-bcc5-20c07960e0fd admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:17.570898 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b6ff8-6d9d-4595-bcc5-20c07960e0fd admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:17.574871 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a716e84-97f2-4f5c-a4f6-f83f5d39312f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:17.575504 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a716e84-97f2-4f5c-a4f6-f83f5d39312f service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:17.575781 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a716e84-97f2-4f5c-a4f6-f83f5d39312f service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:17.576049 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a716e84-97f2-4f5c-a4f6-f83f5d39312f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:17.586534 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a716e84-97f2-4f5c-a4f6-f83f5d39312f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:17.588001 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a716e84-97f2-4f5c-a4f6-f83f5d39312f service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:17.598376 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1088/2171] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:01:17 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:01:17.701343 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341af5dd-cc70-4324-8f59-2f68fb090c57 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:17.714311 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341af5dd-cc70-4324-8f59-2f68fb090c57 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:17.718707 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc85a2ae-d4c4-4a10-b2f9-44b74a79c6a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:17.719361 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85a2ae-d4c4-4a10-b2f9-44b74a79c6a2 service cinder] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:17.719718 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85a2ae-d4c4-4a10-b2f9-44b74a79c6a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:17.720025 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85a2ae-d4c4-4a10-b2f9-44b74a79c6a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:17.780057 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc85a2ae-d4c4-4a10-b2f9-44b74a79c6a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:17.781541 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc85a2ae-d4c4-4a10-b2f9-44b74a79c6a2 service cinder] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:17.790562 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1084/2172] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:01:17 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:01:22.344810 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a716e84-97f2-4f5c-a4f6-f83f5d39312f service cinder] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:22.347655 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-3a716e84-97f2-4f5c-a4f6-f83f5d39312f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:22.433862 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a716e84-97f2-4f5c-a4f6-f83f5d39312f service cinder] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:22.439421 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd31cbeb-1f50-45fb-835a-b81291975fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:22.440355 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd31cbeb-1f50-45fb-835a-b81291975fce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:22.440654 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd31cbeb-1f50-45fb-835a-b81291975fce admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:22.440929 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd31cbeb-1f50-45fb-835a-b81291975fce admin admin] PATH_INFO: `/v3/users/4dfe1fdc0978491586fee41e8652bbf8` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:22.442189 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd31cbeb-1f50-45fb-835a-b81291975fce admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dfe1fdc0978491586fee41e8652bbf8)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:22.444311 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd31cbeb-1f50-45fb-835a-b81291975fce admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:22.495407 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-fd31cbeb-1f50-45fb-835a-b81291975fce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dfe1fdc0978491586fee41e8652bbf8'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:22.496118 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-fd31cbeb-1f50-45fb-835a-b81291975fce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dfe1fdc0978491586fee41e8652bbf8'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:22.505358 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-fd31cbeb-1f50-45fb-835a-b81291975fce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dfe1fdc0978491586fee41e8652bbf8'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:22.512566 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-fd31cbeb-1f50-45fb-835a-b81291975fce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dfe1fdc0978491586fee41e8652bbf8'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:22.525017 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-fd31cbeb-1f50-45fb-835a-b81291975fce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dfe1fdc0978491586fee41e8652bbf8'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:22.531302 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1089/2173] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:01:22 2021] DELETE /identity/v3/users/4dfe1fdc0978491586fee41e8652bbf8 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:01:22.535955 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4f155-9860-42b6-9412-b49cbed844a8 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:22.536425 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4f155-9860-42b6-9412-b49cbed844a8 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:22.536514 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4f155-9860-42b6-9412-b49cbed844a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:22.553961 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-93e4f155-9860-42b6-9412-b49cbed844a8 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:01:22.555397 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-93e4f155-9860-42b6-9412-b49cbed844a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:22.617095 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1085/2174] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:01:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:01:22.627249 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd31cbeb-1f50-45fb-835a-b81291975fce admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:22.628883 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-fd31cbeb-1f50-45fb-835a-b81291975fce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:22.685125 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd31cbeb-1f50-45fb-835a-b81291975fce admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:22.689261 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc02735-23bb-47d6-b425-0549b186d0ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:22.690075 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc02735-23bb-47d6-b425-0549b186d0ee service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:22.690359 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc02735-23bb-47d6-b425-0549b186d0ee service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:22.690637 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc02735-23bb-47d6-b425-0549b186d0ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:22.710476 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc02735-23bb-47d6-b425-0549b186d0ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:22.711942 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc02735-23bb-47d6-b425-0549b186d0ee service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:22.722351 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1090/2175] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:01:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 24 05:01:23.015710 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e4f155-9860-42b6-9412-b49cbed844a8 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:23.018289 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-93e4f155-9860-42b6-9412-b49cbed844a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:23.035210 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e4f155-9860-42b6-9412-b49cbed844a8 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:23.041798 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d2764-c5b8-41b5-8d69-557d3c6d8e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:23.042641 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d2764-c5b8-41b5-8d69-557d3c6d8e89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:23.043005 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d2764-c5b8-41b5-8d69-557d3c6d8e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:23.043426 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d2764-c5b8-41b5-8d69-557d3c6d8e89 admin admin] PATH_INFO: `/v3/projects/b6021dab557e4689b5974aca588777dd` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:23.044824 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d2764-c5b8-41b5-8d69-557d3c6d8e89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6021dab557e4689b5974aca588777dd)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:23.046750 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d2764-c5b8-41b5-8d69-557d3c6d8e89 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:23.098910 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-d20d2764-c5b8-41b5-8d69-557d3c6d8e89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6021dab557e4689b5974aca588777dd', 'request_id': 'req-d20d2764-c5b8-41b5-8d69-557d3c6d8e89'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:23.107171 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-d20d2764-c5b8-41b5-8d69-557d3c6d8e89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6021dab557e4689b5974aca588777dd', 'request_id': 'req-d20d2764-c5b8-41b5-8d69-557d3c6d8e89'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:23.113235 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-d20d2764-c5b8-41b5-8d69-557d3c6d8e89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6021dab557e4689b5974aca588777dd', 'request_id': 'req-d20d2764-c5b8-41b5-8d69-557d3c6d8e89'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:23.128041 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-d20d2764-c5b8-41b5-8d69-557d3c6d8e89 admin admin] The token cache is being invalidate because project b6021dab557e4689b5974aca588777dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:01:23.128422 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-d20d2764-c5b8-41b5-8d69-557d3c6d8e89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:23.129703 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-d20d2764-c5b8-41b5-8d69-557d3c6d8e89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:23.131257 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1086/2176] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:01:23 2021] DELETE /identity/v3/projects/b6021dab557e4689b5974aca588777dd => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:01:46.706301 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc02735-23bb-47d6-b425-0549b186d0ee service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:46.708032 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-6fc02735-23bb-47d6-b425-0549b186d0ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:46.722046 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc02735-23bb-47d6-b425-0549b186d0ee service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:46.781703 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602f80d-fefd-4b8c-841d-af951c22a0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:46.782741 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602f80d-fefd-4b8c-841d-af951c22a0d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:46.783021 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602f80d-fefd-4b8c-841d-af951c22a0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:46.783352 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602f80d-fefd-4b8c-841d-af951c22a0d7 admin admin] PATH_INFO: `/v3/users/3f3126c2a51d4bb5bee33a0dd6fc827c` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:46.784791 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7602f80d-fefd-4b8c-841d-af951c22a0d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f3126c2a51d4bb5bee33a0dd6fc827c)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:46.786935 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7602f80d-fefd-4b8c-841d-af951c22a0d7 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:46.840407 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-7602f80d-fefd-4b8c-841d-af951c22a0d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f3126c2a51d4bb5bee33a0dd6fc827c'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:46.841251 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-7602f80d-fefd-4b8c-841d-af951c22a0d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f3126c2a51d4bb5bee33a0dd6fc827c'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:46.853737 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-7602f80d-fefd-4b8c-841d-af951c22a0d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f3126c2a51d4bb5bee33a0dd6fc827c'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:46.861548 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-7602f80d-fefd-4b8c-841d-af951c22a0d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f3126c2a51d4bb5bee33a0dd6fc827c'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:46.873431 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-7602f80d-fefd-4b8c-841d-af951c22a0d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f3126c2a51d4bb5bee33a0dd6fc827c'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:46.879292 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1091/2177] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:01:46 2021] DELETE /identity/v3/users/3f3126c2a51d4bb5bee33a0dd6fc827c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:01:46.884151 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34138a-0e4a-4e44-a8cc-d2c9a0203991 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:46.884828 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34138a-0e4a-4e44-a8cc-d2c9a0203991 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:46.884828 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34138a-0e4a-4e44-a8cc-d2c9a0203991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:46.907518 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-1c34138a-0e4a-4e44-a8cc-d2c9a0203991 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:01:46.909393 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-1c34138a-0e4a-4e44-a8cc-d2c9a0203991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:46.984131 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1087/2178] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:01:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:01:46.990653 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602f80d-fefd-4b8c-841d-af951c22a0d7 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:46.992339 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-7602f80d-fefd-4b8c-841d-af951c22a0d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:47.052772 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602f80d-fefd-4b8c-841d-af951c22a0d7 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:47.066868 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66706fba-f706-4d0a-8258-24d7a298de6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:47.067524 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66706fba-f706-4d0a-8258-24d7a298de6b service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:47.067807 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66706fba-f706-4d0a-8258-24d7a298de6b service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:47.068079 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66706fba-f706-4d0a-8258-24d7a298de6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:47.078746 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66706fba-f706-4d0a-8258-24d7a298de6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:47.080235 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66706fba-f706-4d0a-8258-24d7a298de6b service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:47.091915 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1092/2179] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:01:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:01:47.362528 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34138a-0e4a-4e44-a8cc-d2c9a0203991 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:47.367245 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-1c34138a-0e4a-4e44-a8cc-d2c9a0203991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:47.387842 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34138a-0e4a-4e44-a8cc-d2c9a0203991 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:47.393387 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b49c692-e5b8-4b6b-ac2e-2dc6a619b578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:47.394314 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b49c692-e5b8-4b6b-ac2e-2dc6a619b578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:47.394668 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b49c692-e5b8-4b6b-ac2e-2dc6a619b578 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:47.394947 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b49c692-e5b8-4b6b-ac2e-2dc6a619b578 admin admin] PATH_INFO: `/v3/projects/9f946192a481435b99c52be706eeb5f3` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:47.396199 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b49c692-e5b8-4b6b-ac2e-2dc6a619b578 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f946192a481435b99c52be706eeb5f3)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:47.398359 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b49c692-e5b8-4b6b-ac2e-2dc6a619b578 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:47.448973 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3497540-790a-496a-a918-fdfd965eab32 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:47.449261 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3497540-790a-496a-a918-fdfd965eab32 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:47.449539 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3497540-790a-496a-a918-fdfd965eab32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:47.450623 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-4b49c692-e5b8-4b6b-ac2e-2dc6a619b578 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f946192a481435b99c52be706eeb5f3', 'request_id': 'req-4b49c692-e5b8-4b6b-ac2e-2dc6a619b578'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:47.460554 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-4b49c692-e5b8-4b6b-ac2e-2dc6a619b578 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f946192a481435b99c52be706eeb5f3', 'request_id': 'req-4b49c692-e5b8-4b6b-ac2e-2dc6a619b578'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:47.466975 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-4b49c692-e5b8-4b6b-ac2e-2dc6a619b578 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f946192a481435b99c52be706eeb5f3', 'request_id': 'req-4b49c692-e5b8-4b6b-ac2e-2dc6a619b578'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:47.469602 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-c3497540-790a-496a-a918-fdfd965eab32 None None] MFA Rules not processed for user `3d0ee2c830754741b0f9eedabf6bded8`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:01:47.471113 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-c3497540-790a-496a-a918-fdfd965eab32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:47.478009 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-4b49c692-e5b8-4b6b-ac2e-2dc6a619b578 admin admin] The token cache is being invalidate because project 9f946192a481435b99c52be706eeb5f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:01:47.478299 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-4b49c692-e5b8-4b6b-ac2e-2dc6a619b578 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:47.479405 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-4b49c692-e5b8-4b6b-ac2e-2dc6a619b578 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:47.480801 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1088/2180] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:01:47 2021] DELETE /identity/v3/projects/9f946192a481435b99c52be706eeb5f3 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 05:01:47.484586 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b49c692-e5b8-4b6b-ac2e-2dc6a619b578 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:47.486788 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-4b49c692-e5b8-4b6b-ac2e-2dc6a619b578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:47.526931 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1093/2181] 10.222.0.43 () {58 vars in 1009 bytes} [Fri Dec 24 05:01:47 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 05:01:47.552202 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b49c692-e5b8-4b6b-ac2e-2dc6a619b578 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:47.557290 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e283d0f-2589-402c-8d30-46da170a8590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:47.558067 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e283d0f-2589-402c-8d30-46da170a8590 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:47.558348 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e283d0f-2589-402c-8d30-46da170a8590 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:47.559246 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e283d0f-2589-402c-8d30-46da170a8590 admin admin] PATH_INFO: `/v3/users/db0a014dab1f43d28d37c592f6c72323` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:47.560199 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e283d0f-2589-402c-8d30-46da170a8590 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db0a014dab1f43d28d37c592f6c72323)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:47.562284 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e283d0f-2589-402c-8d30-46da170a8590 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:47.578110 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3497540-790a-496a-a918-fdfd965eab32 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:47.579559 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-c3497540-790a-496a-a918-fdfd965eab32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:47.610536 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-2e283d0f-2589-402c-8d30-46da170a8590 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db0a014dab1f43d28d37c592f6c72323'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:47.611179 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-2e283d0f-2589-402c-8d30-46da170a8590 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db0a014dab1f43d28d37c592f6c72323'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:47.617644 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-2e283d0f-2589-402c-8d30-46da170a8590 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db0a014dab1f43d28d37c592f6c72323'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:47.625044 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-2e283d0f-2589-402c-8d30-46da170a8590 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db0a014dab1f43d28d37c592f6c72323'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:47.625883 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-2e283d0f-2589-402c-8d30-46da170a8590 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db0a014dab1f43d28d37c592f6c72323'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:47.642751 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1089/2182] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:01:47 2021] DELETE /identity/v3/users/db0a014dab1f43d28d37c592f6c72323 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 05:01:47.649188 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3497540-790a-496a-a918-fdfd965eab32 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:47.711536 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b208df-8162-40b6-a2ec-cec2f330cd8d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218ae7d29b71487d86b11aeb380788ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:47.712357 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b208df-8162-40b6-a2ec-cec2f330cd8d service swift] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:47.712699 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b208df-8162-40b6-a2ec-cec2f330cd8d service swift] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:47.713104 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b208df-8162-40b6-a2ec-cec2f330cd8d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:47.715797 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-c7b208df-8162-40b6-a2ec-cec2f330cd8d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:47.774976 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b208df-8162-40b6-a2ec-cec2f330cd8d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:47.776688 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b208df-8162-40b6-a2ec-cec2f330cd8d service swift] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:47.785430 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1094/2183] 10.222.0.43 () {60 vars in 1384 bytes} [Fri Dec 24 05:01:47 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 24 05:01:47.914330 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e283d0f-2589-402c-8d30-46da170a8590 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:47.915958 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-2e283d0f-2589-402c-8d30-46da170a8590 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:47.992663 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e283d0f-2589-402c-8d30-46da170a8590 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:47.998653 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c475d9-f0fa-4034-be91-e311216bea0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:47.999512 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c475d9-f0fa-4034-be91-e311216bea0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:47.999790 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c475d9-f0fa-4034-be91-e311216bea0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:48.000061 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c475d9-f0fa-4034-be91-e311216bea0d admin admin] PATH_INFO: `/v3/projects/756fefc6141a4559af0d3b169ad99d09` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:48.001371 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c475d9-f0fa-4034-be91-e311216bea0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=756fefc6141a4559af0d3b169ad99d09)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:48.003311 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c475d9-f0fa-4034-be91-e311216bea0d admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:48.057569 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-38c475d9-f0fa-4034-be91-e311216bea0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '756fefc6141a4559af0d3b169ad99d09', 'request_id': 'req-38c475d9-f0fa-4034-be91-e311216bea0d'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:48.065878 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-38c475d9-f0fa-4034-be91-e311216bea0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '756fefc6141a4559af0d3b169ad99d09', 'request_id': 'req-38c475d9-f0fa-4034-be91-e311216bea0d'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:48.072927 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-38c475d9-f0fa-4034-be91-e311216bea0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '756fefc6141a4559af0d3b169ad99d09', 'request_id': 'req-38c475d9-f0fa-4034-be91-e311216bea0d'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:48.085811 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-38c475d9-f0fa-4034-be91-e311216bea0d admin admin] The token cache is being invalidate because project 756fefc6141a4559af0d3b169ad99d09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:01:48.086253 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-38c475d9-f0fa-4034-be91-e311216bea0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:48.086967 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-38c475d9-f0fa-4034-be91-e311216bea0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:48.088984 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1090/2184] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:01:47 2021] DELETE /identity/v3/projects/756fefc6141a4559af0d3b169ad99d09 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:01:48.095362 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf56090-2a5c-435a-a28a-208dbc42d8d6 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:48.095654 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf56090-2a5c-435a-a28a-208dbc42d8d6 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:48.095915 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf56090-2a5c-435a-a28a-208dbc42d8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:48.115884 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-0bf56090-2a5c-435a-a28a-208dbc42d8d6 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:01:48.117202 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-0bf56090-2a5c-435a-a28a-208dbc42d8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:48.188127 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1095/2185] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:01:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:01:48.195449 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649e949-2083-4e9a-aed8-6609647d3800 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:48.195810 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649e949-2083-4e9a-aed8-6609647d3800 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:48.196102 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649e949-2083-4e9a-aed8-6609647d3800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:48.215750 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-f649e949-2083-4e9a-aed8-6609647d3800 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:01:48.217007 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-f649e949-2083-4e9a-aed8-6609647d3800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:48.226217 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1091/2186] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:01:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:01:48.230584 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf56090-2a5c-435a-a28a-208dbc42d8d6 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:48.241655 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf56090-2a5c-435a-a28a-208dbc42d8d6 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:48.247269 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a762436c-c914-4b8e-ac4f-5478eb6c3064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:48.247891 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762436c-c914-4b8e-ac4f-5478eb6c3064 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:48.249016 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762436c-c914-4b8e-ac4f-5478eb6c3064 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:48.249016 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762436c-c914-4b8e-ac4f-5478eb6c3064 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:48.249475 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a762436c-c914-4b8e-ac4f-5478eb6c3064 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 05:01:48.250020 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a762436c-c914-4b8e-ac4f-5478eb6c3064 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:48.252195 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a762436c-c914-4b8e-ac4f-5478eb6c3064 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:48.265795 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1096/2187] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 05:01:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 05:01:48.273645 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649e949-2083-4e9a-aed8-6609647d3800 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:48.287020 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649e949-2083-4e9a-aed8-6609647d3800 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:48.292889 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d34744-d1f7-4009-bf24-491d61560d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:48.293556 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d34744-d1f7-4009-bf24-491d61560d1e admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:48.293834 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d34744-d1f7-4009-bf24-491d61560d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:48.294098 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d34744-d1f7-4009-bf24-491d61560d1e admin admin] PATH_INFO: `/v3/projects` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:48.294836 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d34744-d1f7-4009-bf24-491d61560d1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:48.296771 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d34744-d1f7-4009-bf24-491d61560d1e admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:48.326192 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1092/2188] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:01:48 2021] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:01:48.331461 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a762436c-c914-4b8e-ac4f-5478eb6c3064 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:48.341556 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a762436c-c914-4b8e-ac4f-5478eb6c3064 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:48.409315 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5544b7dc-2b2a-476e-81d5-bdb356e65f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:48.410034 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544b7dc-2b2a-476e-81d5-bdb356e65f27 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:48.410241 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544b7dc-2b2a-476e-81d5-bdb356e65f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:48.410558 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544b7dc-2b2a-476e-81d5-bdb356e65f27 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:48.411370 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5544b7dc-2b2a-476e-81d5-bdb356e65f27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:48.413552 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5544b7dc-2b2a-476e-81d5-bdb356e65f27 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:48.442154 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1097/2189] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:01:48 2021] POST /identity/v3/users => generated 291 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 05:01:48.447962 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d34744-d1f7-4009-bf24-491d61560d1e admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:48.461175 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d34744-d1f7-4009-bf24-491d61560d1e admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:48.466406 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8dff2-ab2d-432e-8390-f8d2e58d4698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:48.467090 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8dff2-ab2d-432e-8390-f8d2e58d4698 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:48.467365 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8dff2-ab2d-432e-8390-f8d2e58d4698 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:48.467639 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8dff2-ab2d-432e-8390-f8d2e58d4698 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:48.468424 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b8dff2-ab2d-432e-8390-f8d2e58d4698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:48.470170 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b8dff2-ab2d-432e-8390-f8d2e58d4698 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:48.482945 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1093/2190] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:01:48 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:01:48.489091 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5544b7dc-2b2a-476e-81d5-bdb356e65f27 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:48.503015 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5544b7dc-2b2a-476e-81d5-bdb356e65f27 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:48.509225 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8743a-0f91-4198-bd56-6d8efca3e3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:48.510415 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8743a-0f91-4198-bd56-6d8efca3e3bc admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:48.510821 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8743a-0f91-4198-bd56-6d8efca3e3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:48.511319 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8743a-0f91-4198-bd56-6d8efca3e3bc admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:48.512233 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8743a-0f91-4198-bd56-6d8efca3e3bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:48.514581 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8743a-0f91-4198-bd56-6d8efca3e3bc admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:48.527227 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1098/2191] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:01:48 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:01:48.531871 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8dff2-ab2d-432e-8390-f8d2e58d4698 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:48.545481 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8dff2-ab2d-432e-8390-f8d2e58d4698 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:48.551579 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cba59e9-6dd8-4e99-b4cb-4cdbe8a3232f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:48.552548 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba59e9-6dd8-4e99-b4cb-4cdbe8a3232f admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:48.552895 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba59e9-6dd8-4e99-b4cb-4cdbe8a3232f admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:48.553164 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba59e9-6dd8-4e99-b4cb-4cdbe8a3232f admin admin] PATH_INFO: `/v3/projects/963bf46e196f4b2ba1aae717a716f3f0/users/86b7dab2c8e342ffa7d9a1a32b36d72b/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:48.572240 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cba59e9-6dd8-4e99-b4cb-4cdbe8a3232f admin admin] RBAC: Authorizing `identity:create_grant(project_id=963bf46e196f4b2ba1aae717a716f3f0, user_id=86b7dab2c8e342ffa7d9a1a32b36d72b, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:48.575144 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cba59e9-6dd8-4e99-b4cb-4cdbe8a3232f admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:48.590713 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1094/2192] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:01:48 2021] PUT /identity/v3/projects/963bf46e196f4b2ba1aae717a716f3f0/users/86b7dab2c8e342ffa7d9a1a32b36d72b/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 05:01:48.602477 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d4fd1-f97f-45fa-9abb-ec16952f5cac None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:48.602767 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d4fd1-f97f-45fa-9abb-ec16952f5cac None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:48.603045 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d4fd1-f97f-45fa-9abb-ec16952f5cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:48.636742 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-7e8d4fd1-f97f-45fa-9abb-ec16952f5cac None None] MFA Rules not processed for user `86b7dab2c8e342ffa7d9a1a32b36d72b`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:01:48.637954 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-7e8d4fd1-f97f-45fa-9abb-ec16952f5cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:48.740048 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1099/2193] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:01:48 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:01:48.746950 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cba59e9-6dd8-4e99-b4cb-4cdbe8a3232f admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:48.822088 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cba59e9-6dd8-4e99-b4cb-4cdbe8a3232f admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:48.829876 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13fe80-2fc7-463b-8099-49bc93c457ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:48.831083 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13fe80-2fc7-463b-8099-49bc93c457ef admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:48.831467 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13fe80-2fc7-463b-8099-49bc93c457ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:48.831832 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13fe80-2fc7-463b-8099-49bc93c457ef admin admin] PATH_INFO: `/v3/projects` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:48.832890 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b13fe80-2fc7-463b-8099-49bc93c457ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:48.836249 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b13fe80-2fc7-463b-8099-49bc93c457ef admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:48.874555 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1095/2194] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:01:48 2021] POST /identity/v3/projects => generated 381 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:01:48.879157 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d4fd1-f97f-45fa-9abb-ec16952f5cac None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:48.890492 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d4fd1-f97f-45fa-9abb-ec16952f5cac None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:48.970801 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466cb16e-ec76-4ed3-919b-72dd7ad9bde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:48.971894 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466cb16e-ec76-4ed3-919b-72dd7ad9bde4 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:48.972367 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466cb16e-ec76-4ed3-919b-72dd7ad9bde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:48.972859 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466cb16e-ec76-4ed3-919b-72dd7ad9bde4 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:48.974032 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466cb16e-ec76-4ed3-919b-72dd7ad9bde4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:48.977249 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466cb16e-ec76-4ed3-919b-72dd7ad9bde4 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:49.002694 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1100/2195] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:01:48 2021] POST /identity/v3/users => generated 297 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:01:49.007703 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13fe80-2fc7-463b-8099-49bc93c457ef admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:49.021235 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13fe80-2fc7-463b-8099-49bc93c457ef admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:49.027281 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba6579b-b79d-413f-9f6a-8a2a1f5e1115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:49.027954 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6579b-b79d-413f-9f6a-8a2a1f5e1115 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:49.028234 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6579b-b79d-413f-9f6a-8a2a1f5e1115 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:49.028478 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6579b-b79d-413f-9f6a-8a2a1f5e1115 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:49.029290 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba6579b-b79d-413f-9f6a-8a2a1f5e1115 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:49.030952 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba6579b-b79d-413f-9f6a-8a2a1f5e1115 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:49.042313 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1096/2196] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:01:49 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:01:49.047248 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466cb16e-ec76-4ed3-919b-72dd7ad9bde4 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:49.063508 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466cb16e-ec76-4ed3-919b-72dd7ad9bde4 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:49.069829 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7b1e2c-a532-4e0e-b455-8e9e6b60f53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:49.071382 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b1e2c-a532-4e0e-b455-8e9e6b60f53c admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:49.071780 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b1e2c-a532-4e0e-b455-8e9e6b60f53c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:49.072163 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b1e2c-a532-4e0e-b455-8e9e6b60f53c admin admin] PATH_INFO: `/v3/projects/4112d41d9be6412b96f943f7bf78e0ba/users/459faf7e6f984a35851ba61c77ace1ca/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:49.093955 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7b1e2c-a532-4e0e-b455-8e9e6b60f53c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4112d41d9be6412b96f943f7bf78e0ba, user_id=459faf7e6f984a35851ba61c77ace1ca, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:49.097453 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7b1e2c-a532-4e0e-b455-8e9e6b60f53c admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:49.113596 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1101/2197] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:01:49 2021] PUT /identity/v3/projects/4112d41d9be6412b96f943f7bf78e0ba/users/459faf7e6f984a35851ba61c77ace1ca/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:01:49.120268 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba6579b-b79d-413f-9f6a-8a2a1f5e1115 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:49.133198 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba6579b-b79d-413f-9f6a-8a2a1f5e1115 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:49.201111 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7b8d4-9dba-4030-a7a2-da69cd7ca34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:49.201784 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7b8d4-9dba-4030-a7a2-da69cd7ca34f admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:49.202075 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7b8d4-9dba-4030-a7a2-da69cd7ca34f admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:49.202328 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7b8d4-9dba-4030-a7a2-da69cd7ca34f admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:49.203070 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa7b8d4-9dba-4030-a7a2-da69cd7ca34f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:49.205062 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa7b8d4-9dba-4030-a7a2-da69cd7ca34f admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:49.217524 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1097/2198] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:01:49 2021] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:01:49.222226 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7b1e2c-a532-4e0e-b455-8e9e6b60f53c admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:49.237483 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7b1e2c-a532-4e0e-b455-8e9e6b60f53c admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:49.243948 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f8d96-5875-4edd-b149-6168d2ee9115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:49.245216 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f8d96-5875-4edd-b149-6168d2ee9115 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:49.245630 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f8d96-5875-4edd-b149-6168d2ee9115 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:49.246582 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f8d96-5875-4edd-b149-6168d2ee9115 admin admin] PATH_INFO: `/v3/projects/4112d41d9be6412b96f943f7bf78e0ba/users/459faf7e6f984a35851ba61c77ace1ca/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:49.249185 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f8d96-5875-4edd-b149-6168d2ee9115 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4112d41d9be6412b96f943f7bf78e0ba, user_id=459faf7e6f984a35851ba61c77ace1ca, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:49.251885 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f8d96-5875-4edd-b149-6168d2ee9115 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:49.263940 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1102/2199] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:01:49 2021] PUT /identity/v3/projects/4112d41d9be6412b96f943f7bf78e0ba/users/459faf7e6f984a35851ba61c77ace1ca/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:01:49.275795 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926f3e0-b2ab-4b48-90cd-73aa17a6ff5d None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:49.276033 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926f3e0-b2ab-4b48-90cd-73aa17a6ff5d None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:49.276346 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926f3e0-b2ab-4b48-90cd-73aa17a6ff5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:49.305579 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-7926f3e0-b2ab-4b48-90cd-73aa17a6ff5d None None] MFA Rules not processed for user `459faf7e6f984a35851ba61c77ace1ca`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:01:49.306818 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-7926f3e0-b2ab-4b48-90cd-73aa17a6ff5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:49.379960 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1098/2200] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:01:49 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:01:49.391002 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f8d96-5875-4edd-b149-6168d2ee9115 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:49.392796 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-ed9f8d96-5875-4edd-b149-6168d2ee9115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:49.449599 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f8d96-5875-4edd-b149-6168d2ee9115 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:49.453278 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e427f-98ba-492d-971e-8f5fbe1076ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:49.453932 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e427f-98ba-492d-971e-8f5fbe1076ca service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:49.454207 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e427f-98ba-492d-971e-8f5fbe1076ca service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:49.454477 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e427f-98ba-492d-971e-8f5fbe1076ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:49.463779 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8e427f-98ba-492d-971e-8f5fbe1076ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:49.465332 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8e427f-98ba-492d-971e-8f5fbe1076ca service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:49.474778 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1103/2201] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:01:49 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:01:49.561954 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926f3e0-b2ab-4b48-90cd-73aa17a6ff5d None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:49.571912 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926f3e0-b2ab-4b48-90cd-73aa17a6ff5d None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:49.576504 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be23acd6-29e2-45c1-b963-baf992075af5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:49.577304 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be23acd6-29e2-45c1-b963-baf992075af5 service cinder] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:49.577587 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be23acd6-29e2-45c1-b963-baf992075af5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:49.577862 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be23acd6-29e2-45c1-b963-baf992075af5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:49.637493 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be23acd6-29e2-45c1-b963-baf992075af5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:49.638962 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be23acd6-29e2-45c1-b963-baf992075af5 service cinder] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:49.649154 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1099/2202] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:01:49 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:01:49.915890 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e427f-98ba-492d-971e-8f5fbe1076ca service cinder] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:49.982887 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e427f-98ba-492d-971e-8f5fbe1076ca service cinder] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:49.987792 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16afaa3-72f3-42e7-b1ba-648ed08adfa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:49.988689 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16afaa3-72f3-42e7-b1ba-648ed08adfa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:49.988969 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16afaa3-72f3-42e7-b1ba-648ed08adfa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:49.989255 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16afaa3-72f3-42e7-b1ba-648ed08adfa7 admin admin] PATH_INFO: `/v3/users/86b7dab2c8e342ffa7d9a1a32b36d72b` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:49.990475 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16afaa3-72f3-42e7-b1ba-648ed08adfa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86b7dab2c8e342ffa7d9a1a32b36d72b)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:49.992392 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16afaa3-72f3-42e7-b1ba-648ed08adfa7 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:50.040813 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b16afaa3-72f3-42e7-b1ba-648ed08adfa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86b7dab2c8e342ffa7d9a1a32b36d72b'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:50.041504 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b16afaa3-72f3-42e7-b1ba-648ed08adfa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86b7dab2c8e342ffa7d9a1a32b36d72b'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:50.051496 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b16afaa3-72f3-42e7-b1ba-648ed08adfa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86b7dab2c8e342ffa7d9a1a32b36d72b'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:50.058473 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b16afaa3-72f3-42e7-b1ba-648ed08adfa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86b7dab2c8e342ffa7d9a1a32b36d72b'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:50.069853 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b16afaa3-72f3-42e7-b1ba-648ed08adfa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86b7dab2c8e342ffa7d9a1a32b36d72b'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:50.075883 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1104/2203] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:01:49 2021] DELETE /identity/v3/users/86b7dab2c8e342ffa7d9a1a32b36d72b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:01:50.080584 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71f325-9293-4708-ba19-6c16efcd9ee0 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:50.081062 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71f325-9293-4708-ba19-6c16efcd9ee0 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:50.081170 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71f325-9293-4708-ba19-6c16efcd9ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:50.099246 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-3c71f325-9293-4708-ba19-6c16efcd9ee0 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:01:50.100433 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-3c71f325-9293-4708-ba19-6c16efcd9ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:50.169771 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1100/2204] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:01:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:01:50.180347 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16afaa3-72f3-42e7-b1ba-648ed08adfa7 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:50.181989 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-b16afaa3-72f3-42e7-b1ba-648ed08adfa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:50.242673 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16afaa3-72f3-42e7-b1ba-648ed08adfa7 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:50.246905 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38410e2c-921a-4318-8d7e-3c44993e520a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:50.247546 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38410e2c-921a-4318-8d7e-3c44993e520a service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:50.247820 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38410e2c-921a-4318-8d7e-3c44993e520a service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:50.248089 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38410e2c-921a-4318-8d7e-3c44993e520a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:50.257419 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38410e2c-921a-4318-8d7e-3c44993e520a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:50.258867 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38410e2c-921a-4318-8d7e-3c44993e520a service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:50.268798 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1105/2205] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:01:50 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:01:50.839882 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c71f325-9293-4708-ba19-6c16efcd9ee0 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:50.841683 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-3c71f325-9293-4708-ba19-6c16efcd9ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:50.854863 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c71f325-9293-4708-ba19-6c16efcd9ee0 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:50.860241 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6a943-e42c-41a1-89b3-7ee0d0d3914d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:50.861192 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6a943-e42c-41a1-89b3-7ee0d0d3914d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:50.861476 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6a943-e42c-41a1-89b3-7ee0d0d3914d admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:50.861750 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6a943-e42c-41a1-89b3-7ee0d0d3914d admin admin] PATH_INFO: `/v3/projects/963bf46e196f4b2ba1aae717a716f3f0` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:50.863022 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6a943-e42c-41a1-89b3-7ee0d0d3914d admin admin] RBAC: Authorizing `identity:delete_project(project_id=963bf46e196f4b2ba1aae717a716f3f0)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:50.864976 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6a943-e42c-41a1-89b3-7ee0d0d3914d admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:50.912997 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-27b6a943-e42c-41a1-89b3-7ee0d0d3914d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '963bf46e196f4b2ba1aae717a716f3f0', 'request_id': 'req-27b6a943-e42c-41a1-89b3-7ee0d0d3914d'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:50.921670 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-27b6a943-e42c-41a1-89b3-7ee0d0d3914d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '963bf46e196f4b2ba1aae717a716f3f0', 'request_id': 'req-27b6a943-e42c-41a1-89b3-7ee0d0d3914d'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:50.927408 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-27b6a943-e42c-41a1-89b3-7ee0d0d3914d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '963bf46e196f4b2ba1aae717a716f3f0', 'request_id': 'req-27b6a943-e42c-41a1-89b3-7ee0d0d3914d'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:50.939353 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-27b6a943-e42c-41a1-89b3-7ee0d0d3914d admin admin] The token cache is being invalidate because project 963bf46e196f4b2ba1aae717a716f3f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:01:50.939656 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-27b6a943-e42c-41a1-89b3-7ee0d0d3914d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:50.940383 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-27b6a943-e42c-41a1-89b3-7ee0d0d3914d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:50.942066 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1101/2206] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:01:50 2021] DELETE /identity/v3/projects/963bf46e196f4b2ba1aae717a716f3f0 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:01:50.946391 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38410e2c-921a-4318-8d7e-3c44993e520a service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:50.956692 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38410e2c-921a-4318-8d7e-3c44993e520a service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:51.017528 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd5412e-c854-4035-b0d7-aace5c4b3525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:51.018314 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5412e-c854-4035-b0d7-aace5c4b3525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:51.018601 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5412e-c854-4035-b0d7-aace5c4b3525 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:51.018875 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5412e-c854-4035-b0d7-aace5c4b3525 admin admin] PATH_INFO: `/v3/users/459faf7e6f984a35851ba61c77ace1ca` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:51.020093 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd5412e-c854-4035-b0d7-aace5c4b3525 admin admin] RBAC: Authorizing `identity:delete_user(user_id=459faf7e6f984a35851ba61c77ace1ca)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:51.022049 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd5412e-c854-4035-b0d7-aace5c4b3525 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:51.067461 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-7fd5412e-c854-4035-b0d7-aace5c4b3525 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '459faf7e6f984a35851ba61c77ace1ca'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:51.068118 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-7fd5412e-c854-4035-b0d7-aace5c4b3525 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '459faf7e6f984a35851ba61c77ace1ca'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:51.075580 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-7fd5412e-c854-4035-b0d7-aace5c4b3525 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '459faf7e6f984a35851ba61c77ace1ca'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:51.082319 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-7fd5412e-c854-4035-b0d7-aace5c4b3525 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '459faf7e6f984a35851ba61c77ace1ca'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:51.093863 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-7fd5412e-c854-4035-b0d7-aace5c4b3525 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '459faf7e6f984a35851ba61c77ace1ca'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:51.099709 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1106/2207] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:01:50 2021] DELETE /identity/v3/users/459faf7e6f984a35851ba61c77ace1ca => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:01:51.386114 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6a943-e42c-41a1-89b3-7ee0d0d3914d admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:51.389804 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-27b6a943-e42c-41a1-89b3-7ee0d0d3914d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:51.404649 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6a943-e42c-41a1-89b3-7ee0d0d3914d admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:51.463993 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ddc5b2-e181-40ee-b232-dfdb95121131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:51.464908 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddc5b2-e181-40ee-b232-dfdb95121131 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:51.465187 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddc5b2-e181-40ee-b232-dfdb95121131 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:51.465461 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddc5b2-e181-40ee-b232-dfdb95121131 admin admin] PATH_INFO: `/v3/projects/4112d41d9be6412b96f943f7bf78e0ba` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:51.466684 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ddc5b2-e181-40ee-b232-dfdb95121131 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4112d41d9be6412b96f943f7bf78e0ba)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:51.468664 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ddc5b2-e181-40ee-b232-dfdb95121131 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:51.517741 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-21ddc5b2-e181-40ee-b232-dfdb95121131 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4112d41d9be6412b96f943f7bf78e0ba', 'request_id': 'req-21ddc5b2-e181-40ee-b232-dfdb95121131'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:51.526824 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-21ddc5b2-e181-40ee-b232-dfdb95121131 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4112d41d9be6412b96f943f7bf78e0ba', 'request_id': 'req-21ddc5b2-e181-40ee-b232-dfdb95121131'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:51.533939 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-21ddc5b2-e181-40ee-b232-dfdb95121131 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4112d41d9be6412b96f943f7bf78e0ba', 'request_id': 'req-21ddc5b2-e181-40ee-b232-dfdb95121131'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:51.546050 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-21ddc5b2-e181-40ee-b232-dfdb95121131 admin admin] The token cache is being invalidate because project 4112d41d9be6412b96f943f7bf78e0ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:01:51.546229 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-21ddc5b2-e181-40ee-b232-dfdb95121131 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:51.546962 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-21ddc5b2-e181-40ee-b232-dfdb95121131 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:01:51.548975 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1102/2208] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:01:51 2021] DELETE /identity/v3/projects/4112d41d9be6412b96f943f7bf78e0ba => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 05:01:51.554713 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744417a-7eaa-4adf-9c48-618e338477f2 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:51.555260 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744417a-7eaa-4adf-9c48-618e338477f2 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:51.555812 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744417a-7eaa-4adf-9c48-618e338477f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:51.579591 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-9744417a-7eaa-4adf-9c48-618e338477f2 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:01:51.581022 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-9744417a-7eaa-4adf-9c48-618e338477f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:51.644232 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1107/2209] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:01:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:01:51.652556 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847fff13-b198-408a-a37f-4b17fd49caf7 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:51.652844 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847fff13-b198-408a-a37f-4b17fd49caf7 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:51.653125 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847fff13-b198-408a-a37f-4b17fd49caf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:51.673216 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-847fff13-b198-408a-a37f-4b17fd49caf7 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:01:51.675379 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-847fff13-b198-408a-a37f-4b17fd49caf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:51.685515 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1103/2210] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:01:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 05:01:51.689285 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9744417a-7eaa-4adf-9c48-618e338477f2 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:51.699398 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9744417a-7eaa-4adf-9c48-618e338477f2 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:51.704785 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee702e5-1b08-41c4-90d5-4addbd40a67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:51.705540 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee702e5-1b08-41c4-90d5-4addbd40a67b admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:51.705890 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee702e5-1b08-41c4-90d5-4addbd40a67b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:51.706226 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee702e5-1b08-41c4-90d5-4addbd40a67b admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:51.707037 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee702e5-1b08-41c4-90d5-4addbd40a67b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 05:01:51.707410 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee702e5-1b08-41c4-90d5-4addbd40a67b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:51.715100 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee702e5-1b08-41c4-90d5-4addbd40a67b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:51.735515 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1108/2211] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 05:01:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 05:01:51.736628 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847fff13-b198-408a-a37f-4b17fd49caf7 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:51.747546 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847fff13-b198-408a-a37f-4b17fd49caf7 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:51.753137 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb11a4a-e9e7-48f2-a8e0-c7b75b21ed91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:51.754067 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb11a4a-e9e7-48f2-a8e0-c7b75b21ed91 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:51.754352 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb11a4a-e9e7-48f2-a8e0-c7b75b21ed91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:51.754621 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb11a4a-e9e7-48f2-a8e0-c7b75b21ed91 admin admin] PATH_INFO: `/v3/projects` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:51.755532 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb11a4a-e9e7-48f2-a8e0-c7b75b21ed91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:51.757624 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb11a4a-e9e7-48f2-a8e0-c7b75b21ed91 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:51.792805 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1104/2212] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:01:51 2021] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:01:51.794001 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee702e5-1b08-41c4-90d5-4addbd40a67b admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:51.805526 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee702e5-1b08-41c4-90d5-4addbd40a67b admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:51.874057 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce2d171-2d6b-436a-b2a3-9f15abaee8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:51.874830 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2d171-2d6b-436a-b2a3-9f15abaee8a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:51.875179 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2d171-2d6b-436a-b2a3-9f15abaee8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:51.875515 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2d171-2d6b-436a-b2a3-9f15abaee8a7 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:51.876291 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce2d171-2d6b-436a-b2a3-9f15abaee8a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:51.878451 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce2d171-2d6b-436a-b2a3-9f15abaee8a7 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:51.904600 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1109/2213] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:01:51 2021] POST /identity/v3/users => generated 292 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:01:51.907564 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb11a4a-e9e7-48f2-a8e0-c7b75b21ed91 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:51.921887 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb11a4a-e9e7-48f2-a8e0-c7b75b21ed91 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:51.927096 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70789b13-66e9-440b-b77b-6c5ca2049ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:51.928031 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70789b13-66e9-440b-b77b-6c5ca2049ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:51.928412 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70789b13-66e9-440b-b77b-6c5ca2049ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:51.928954 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70789b13-66e9-440b-b77b-6c5ca2049ff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:51.929800 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70789b13-66e9-440b-b77b-6c5ca2049ff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:51.932494 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70789b13-66e9-440b-b77b-6c5ca2049ff7 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:51.944579 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1105/2214] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:01:51 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 24 05:01:51.948749 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce2d171-2d6b-436a-b2a3-9f15abaee8a7 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:51.964339 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce2d171-2d6b-436a-b2a3-9f15abaee8a7 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:51.971278 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0419ca33-6a18-4316-9194-93eaa475e156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:51.972310 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419ca33-6a18-4316-9194-93eaa475e156 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:51.972803 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419ca33-6a18-4316-9194-93eaa475e156 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:51.973439 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419ca33-6a18-4316-9194-93eaa475e156 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:51.974197 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0419ca33-6a18-4316-9194-93eaa475e156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:51.975853 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0419ca33-6a18-4316-9194-93eaa475e156 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:51.989012 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1110/2215] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:01:51 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 24 05:01:51.992853 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70789b13-66e9-440b-b77b-6c5ca2049ff7 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:52.006730 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70789b13-66e9-440b-b77b-6c5ca2049ff7 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:52.015547 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d8c842-363e-4400-9859-fcd04912e2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:52.016729 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8c842-363e-4400-9859-fcd04912e2dc admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:52.017066 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8c842-363e-4400-9859-fcd04912e2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:52.017458 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8c842-363e-4400-9859-fcd04912e2dc admin admin] PATH_INFO: `/v3/projects/f9dfd8d9ddc64e8b8f89b55ee841135c/users/d3843c0c145446be8d41ad71d308a246/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:52.037669 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d8c842-363e-4400-9859-fcd04912e2dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9dfd8d9ddc64e8b8f89b55ee841135c, user_id=d3843c0c145446be8d41ad71d308a246, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:52.041108 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d8c842-363e-4400-9859-fcd04912e2dc admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:52.064572 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1106/2216] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:01:51 2021] PUT /identity/v3/projects/f9dfd8d9ddc64e8b8f89b55ee841135c/users/d3843c0c145446be8d41ad71d308a246/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 05:01:52.075884 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd3531-4f9b-4448-abe3-bd415337274c None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:52.076264 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd3531-4f9b-4448-abe3-bd415337274c None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:52.076887 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd3531-4f9b-4448-abe3-bd415337274c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:52.113410 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-2bdd3531-4f9b-4448-abe3-bd415337274c None None] MFA Rules not processed for user `d3843c0c145446be8d41ad71d308a246`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:01:52.114621 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-2bdd3531-4f9b-4448-abe3-bd415337274c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:52.185188 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1111/2217] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:01:52 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:01:52.186883 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d8c842-363e-4400-9859-fcd04912e2dc admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:52.255887 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d8c842-363e-4400-9859-fcd04912e2dc admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:52.262195 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a4943-5e94-47d2-b167-a2144ca3d827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:52.263824 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a4943-5e94-47d2-b167-a2144ca3d827 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:52.263824 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a4943-5e94-47d2-b167-a2144ca3d827 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:52.263824 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a4943-5e94-47d2-b167-a2144ca3d827 admin admin] PATH_INFO: `/v3/projects` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:52.264933 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a4943-5e94-47d2-b167-a2144ca3d827 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:52.269646 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a4943-5e94-47d2-b167-a2144ca3d827 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:52.304661 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1107/2218] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:01:52 2021] POST /identity/v3/projects => generated 381 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 05:01:52.339254 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdd3531-4f9b-4448-abe3-bd415337274c None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:52.409778 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdd3531-4f9b-4448-abe3-bd415337274c None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:52.490680 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd4be1-cd96-415c-acb6-ffeb6b9803a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:52.491530 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd4be1-cd96-415c-acb6-ffeb6b9803a1 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:52.491921 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd4be1-cd96-415c-acb6-ffeb6b9803a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:52.492295 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd4be1-cd96-415c-acb6-ffeb6b9803a1 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:52.493772 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd4be1-cd96-415c-acb6-ffeb6b9803a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:52.496297 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd4be1-cd96-415c-acb6-ffeb6b9803a1 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:52.520472 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1112/2219] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:01:52 2021] POST /identity/v3/users => generated 291 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:01:52.524411 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a4943-5e94-47d2-b167-a2144ca3d827 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:52.538707 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a4943-5e94-47d2-b167-a2144ca3d827 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:52.544295 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff56ffc-265d-4ff4-9642-aa319011ed7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:52.544997 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff56ffc-265d-4ff4-9642-aa319011ed7a admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:52.545279 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff56ffc-265d-4ff4-9642-aa319011ed7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:52.545555 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff56ffc-265d-4ff4-9642-aa319011ed7a admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:52.546335 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff56ffc-265d-4ff4-9642-aa319011ed7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:52.548023 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff56ffc-265d-4ff4-9642-aa319011ed7a admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:52.564583 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1108/2220] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:01:52 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:01:52.567133 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd4be1-cd96-415c-acb6-ffeb6b9803a1 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:52.582897 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd4be1-cd96-415c-acb6-ffeb6b9803a1 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:52.593262 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b68b1-a6c6-43fd-96f2-f9982014ccac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:52.594292 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b68b1-a6c6-43fd-96f2-f9982014ccac admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:52.595584 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b68b1-a6c6-43fd-96f2-f9982014ccac admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:52.595965 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b68b1-a6c6-43fd-96f2-f9982014ccac admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:52.601745 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2b68b1-a6c6-43fd-96f2-f9982014ccac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:52.604136 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2b68b1-a6c6-43fd-96f2-f9982014ccac admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:52.616709 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1113/2221] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:01:52 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:01:52.621097 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff56ffc-265d-4ff4-9642-aa319011ed7a admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:52.633461 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff56ffc-265d-4ff4-9642-aa319011ed7a admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:52.638491 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e2d860-7a09-49ec-9f1d-120b5bb0050a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:52.639386 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2d860-7a09-49ec-9f1d-120b5bb0050a admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:52.639653 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2d860-7a09-49ec-9f1d-120b5bb0050a admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:52.639931 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2d860-7a09-49ec-9f1d-120b5bb0050a admin admin] PATH_INFO: `/v3/projects/9250e0222ac942fdb82cf40c147ec203/users/c1795fc8f9304e53a4f66a17543e65d4/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:52.657389 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e2d860-7a09-49ec-9f1d-120b5bb0050a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9250e0222ac942fdb82cf40c147ec203, user_id=c1795fc8f9304e53a4f66a17543e65d4, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:52.660510 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e2d860-7a09-49ec-9f1d-120b5bb0050a admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:52.678145 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1109/2222] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:01:52 2021] PUT /identity/v3/projects/9250e0222ac942fdb82cf40c147ec203/users/c1795fc8f9304e53a4f66a17543e65d4/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:01:52.688822 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc37d8d-bb8c-4452-a4b4-c1b011960e1e None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:52.689406 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc37d8d-bb8c-4452-a4b4-c1b011960e1e None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:52.689977 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc37d8d-bb8c-4452-a4b4-c1b011960e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:52.720838 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-3cc37d8d-bb8c-4452-a4b4-c1b011960e1e None None] MFA Rules not processed for user `c1795fc8f9304e53a4f66a17543e65d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:01:52.722145 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-3cc37d8d-bb8c-4452-a4b4-c1b011960e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:52.803443 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1114/2223] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:01:52 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:01:52.808337 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e2d860-7a09-49ec-9f1d-120b5bb0050a admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:52.905828 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e2d860-7a09-49ec-9f1d-120b5bb0050a admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:52.915065 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c4f78-7ddc-4daa-b73c-ca0c51b36781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:52.915990 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c4f78-7ddc-4daa-b73c-ca0c51b36781 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:52.916198 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c4f78-7ddc-4daa-b73c-ca0c51b36781 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:52.916705 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c4f78-7ddc-4daa-b73c-ca0c51b36781 admin admin] PATH_INFO: `/v3/projects` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:52.917429 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881c4f78-7ddc-4daa-b73c-ca0c51b36781 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:52.919530 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881c4f78-7ddc-4daa-b73c-ca0c51b36781 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:52.962187 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1110/2224] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:01:52 2021] POST /identity/v3/projects => generated 383 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:01:52.963812 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc37d8d-bb8c-4452-a4b4-c1b011960e1e None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:52.978564 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc37d8d-bb8c-4452-a4b4-c1b011960e1e None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:53.073984 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9bb36-8616-4500-9246-7266bbca7d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:53.074841 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9bb36-8616-4500-9246-7266bbca7d9a admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:53.076686 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9bb36-8616-4500-9246-7266bbca7d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:53.076686 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9bb36-8616-4500-9246-7266bbca7d9a admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:53.076686 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a9bb36-8616-4500-9246-7266bbca7d9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:53.078450 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a9bb36-8616-4500-9246-7266bbca7d9a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:53.106520 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1115/2225] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:01:52 2021] POST /identity/v3/users => generated 298 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 05:01:53.107735 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c4f78-7ddc-4daa-b73c-ca0c51b36781 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:53.121246 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c4f78-7ddc-4daa-b73c-ca0c51b36781 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:53.128570 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82f95c3-d0cc-4a9d-9eaf-4ec13059e949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:53.129244 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f95c3-d0cc-4a9d-9eaf-4ec13059e949 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:53.129527 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f95c3-d0cc-4a9d-9eaf-4ec13059e949 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:53.129805 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f95c3-d0cc-4a9d-9eaf-4ec13059e949 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:53.130562 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82f95c3-d0cc-4a9d-9eaf-4ec13059e949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:53.132321 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82f95c3-d0cc-4a9d-9eaf-4ec13059e949 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:53.158492 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1111/2226] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:01:53 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 24 05:01:53.160160 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9bb36-8616-4500-9246-7266bbca7d9a admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:53.186031 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9bb36-8616-4500-9246-7266bbca7d9a admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:53.206659 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936348b2-6554-435d-94b5-5b82df70edf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:53.211733 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936348b2-6554-435d-94b5-5b82df70edf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:53.211733 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936348b2-6554-435d-94b5-5b82df70edf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:53.211733 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936348b2-6554-435d-94b5-5b82df70edf8 admin admin] PATH_INFO: `/v3/projects/2e5022f9a8e64ae8a6a07a880fe829f7/users/7749ad4b2c0e4196ac1d89c510001183/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:53.236801 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936348b2-6554-435d-94b5-5b82df70edf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e5022f9a8e64ae8a6a07a880fe829f7, user_id=7749ad4b2c0e4196ac1d89c510001183, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:53.239382 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936348b2-6554-435d-94b5-5b82df70edf8 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:53.275001 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1116/2227] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:01:53 2021] PUT /identity/v3/projects/2e5022f9a8e64ae8a6a07a880fe829f7/users/7749ad4b2c0e4196ac1d89c510001183/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 05:01:53.286109 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82f95c3-d0cc-4a9d-9eaf-4ec13059e949 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:53.297349 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82f95c3-d0cc-4a9d-9eaf-4ec13059e949 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:53.383208 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228e1030-5b0b-4227-bc2b-472c82357bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:53.383974 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e1030-5b0b-4227-bc2b-472c82357bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:53.384319 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e1030-5b0b-4227-bc2b-472c82357bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:53.384699 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e1030-5b0b-4227-bc2b-472c82357bc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:53.385758 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228e1030-5b0b-4227-bc2b-472c82357bc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:53.387523 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228e1030-5b0b-4227-bc2b-472c82357bc2 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:53.411891 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1112/2228] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:01:53 2021] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:01:53.416993 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936348b2-6554-435d-94b5-5b82df70edf8 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:53.437901 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936348b2-6554-435d-94b5-5b82df70edf8 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:53.446184 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e2c6ae-4093-4607-856c-09c8510f39a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:53.447201 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2c6ae-4093-4607-856c-09c8510f39a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:53.447638 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2c6ae-4093-4607-856c-09c8510f39a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:53.448014 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2c6ae-4093-4607-856c-09c8510f39a4 admin admin] PATH_INFO: `/v3/projects/2e5022f9a8e64ae8a6a07a880fe829f7/users/7749ad4b2c0e4196ac1d89c510001183/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:53.451364 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e2c6ae-4093-4607-856c-09c8510f39a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e5022f9a8e64ae8a6a07a880fe829f7, user_id=7749ad4b2c0e4196ac1d89c510001183, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:53.455167 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e2c6ae-4093-4607-856c-09c8510f39a4 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:53.481666 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1117/2229] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:01:53 2021] PUT /identity/v3/projects/2e5022f9a8e64ae8a6a07a880fe829f7/users/7749ad4b2c0e4196ac1d89c510001183/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:01:53.491816 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7215ee0-de85-47be-8c1c-219dadfd7492 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:53.492119 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7215ee0-de85-47be-8c1c-219dadfd7492 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:53.492401 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7215ee0-de85-47be-8c1c-219dadfd7492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:53.531644 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-b7215ee0-de85-47be-8c1c-219dadfd7492 None None] MFA Rules not processed for user `7749ad4b2c0e4196ac1d89c510001183`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:01:53.531644 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-b7215ee0-de85-47be-8c1c-219dadfd7492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:53.619695 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1113/2230] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:01:53 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:01:53.671426 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e2c6ae-4093-4607-856c-09c8510f39a4 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:53.673563 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-04e2c6ae-4093-4607-856c-09c8510f39a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:01:53.744396 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e2c6ae-4093-4607-856c-09c8510f39a4 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:53.748489 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f379bf3-9825-4188-aeb9-950075ddade1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:53.749174 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f379bf3-9825-4188-aeb9-950075ddade1 service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:53.749454 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f379bf3-9825-4188-aeb9-950075ddade1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:53.749734 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f379bf3-9825-4188-aeb9-950075ddade1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:53.831198 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f379bf3-9825-4188-aeb9-950075ddade1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:53.836888 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f379bf3-9825-4188-aeb9-950075ddade1 service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:53.857645 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1118/2231] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:01:53 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:01:56.660827 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7215ee0-de85-47be-8c1c-219dadfd7492 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:56.676051 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7215ee0-de85-47be-8c1c-219dadfd7492 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:56.679938 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae47b526-f96e-45b2-8471-7cc325a000ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:56.680846 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47b526-f96e-45b2-8471-7cc325a000ec service cinder] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:56.681244 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47b526-f96e-45b2-8471-7cc325a000ec service cinder] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:56.681647 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47b526-f96e-45b2-8471-7cc325a000ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:56.772449 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae47b526-f96e-45b2-8471-7cc325a000ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:56.774622 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae47b526-f96e-45b2-8471-7cc325a000ec service cinder] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:56.794164 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1114/2232] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:01:56 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:01:59.352061 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f379bf3-9825-4188-aeb9-950075ddade1 service cinder] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:01:59.378344 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f379bf3-9825-4188-aeb9-950075ddade1 service cinder] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:01:59.382844 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ae685-541e-4ba6-a2e0-d60ee37f03f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:01:59.383488 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ae685-541e-4ba6-a2e0-d60ee37f03f4 service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:01:59.383780 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ae685-541e-4ba6-a2e0-d60ee37f03f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:01:59.384199 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ae685-541e-4ba6-a2e0-d60ee37f03f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:01:59.415833 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2ae685-541e-4ba6-a2e0-d60ee37f03f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:01:59.417362 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2ae685-541e-4ba6-a2e0-d60ee37f03f4 service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:01:59.427862 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1119/2233] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:01:59 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:02:04.881682 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae47b526-f96e-45b2-8471-7cc325a000ec service cinder] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:02:04.883856 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-ae47b526-f96e-45b2-8471-7cc325a000ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:02:05.064188 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae47b526-f96e-45b2-8471-7cc325a000ec service cinder] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:02:05.070599 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c304637-4cf9-456b-8d14-118eff0f32ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:02:05.071664 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c304637-4cf9-456b-8d14-118eff0f32ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:05.072010 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c304637-4cf9-456b-8d14-118eff0f32ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:05.072364 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c304637-4cf9-456b-8d14-118eff0f32ff admin admin] PATH_INFO: `/v3/users/0ac6e333bc984e68bb439b21b75369bb` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:05.074432 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c304637-4cf9-456b-8d14-118eff0f32ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ac6e333bc984e68bb439b21b75369bb)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:02:05.078016 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c304637-4cf9-456b-8d14-118eff0f32ff admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:02:05.153840 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-4c304637-4cf9-456b-8d14-118eff0f32ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ac6e333bc984e68bb439b21b75369bb'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:05.154779 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-4c304637-4cf9-456b-8d14-118eff0f32ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ac6e333bc984e68bb439b21b75369bb'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:05.169797 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-4c304637-4cf9-456b-8d14-118eff0f32ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ac6e333bc984e68bb439b21b75369bb'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:05.184747 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-4c304637-4cf9-456b-8d14-118eff0f32ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ac6e333bc984e68bb439b21b75369bb'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:05.185754 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-4c304637-4cf9-456b-8d14-118eff0f32ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ac6e333bc984e68bb439b21b75369bb'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:05.215744 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1115/2234] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:02:04 2021] DELETE /identity/v3/users/0ac6e333bc984e68bb439b21b75369bb => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:02:05.225926 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d22924-5f22-4541-a67a-a91c54608433 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:05.225926 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d22924-5f22-4541-a67a-a91c54608433 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:05.225926 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d22924-5f22-4541-a67a-a91c54608433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:05.254811 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-20d22924-5f22-4541-a67a-a91c54608433 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:02:05.256208 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-20d22924-5f22-4541-a67a-a91c54608433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:02:05.330739 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1120/2235] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:02:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:02:05.342900 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c304637-4cf9-456b-8d14-118eff0f32ff admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:02:05.344482 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-4c304637-4cf9-456b-8d14-118eff0f32ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:02:05.463326 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c304637-4cf9-456b-8d14-118eff0f32ff admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:02:05.467012 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c578a244-8acf-4b7e-9a83-6b8d4b2af47f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:02:05.467656 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578a244-8acf-4b7e-9a83-6b8d4b2af47f service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:05.467936 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578a244-8acf-4b7e-9a83-6b8d4b2af47f service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:05.468216 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578a244-8acf-4b7e-9a83-6b8d4b2af47f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:05.477217 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c578a244-8acf-4b7e-9a83-6b8d4b2af47f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:02:05.478684 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c578a244-8acf-4b7e-9a83-6b8d4b2af47f service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:02:05.488268 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1116/2236] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:02:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 24 05:02:05.798474 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d22924-5f22-4541-a67a-a91c54608433 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:02:05.799981 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-20d22924-5f22-4541-a67a-a91c54608433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:02:05.815764 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d22924-5f22-4541-a67a-a91c54608433 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:02:05.821786 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c917b18e-421f-49ab-9548-126cf1b932a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:02:05.822856 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917b18e-421f-49ab-9548-126cf1b932a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:05.823223 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917b18e-421f-49ab-9548-126cf1b932a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:05.823596 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917b18e-421f-49ab-9548-126cf1b932a5 admin admin] PATH_INFO: `/v3/projects/a7d897479c3e4e11a56492bd9a1f09e1` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:05.824875 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c917b18e-421f-49ab-9548-126cf1b932a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7d897479c3e4e11a56492bd9a1f09e1)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:02:05.826886 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c917b18e-421f-49ab-9548-126cf1b932a5 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:02:05.875128 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-c917b18e-421f-49ab-9548-126cf1b932a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7d897479c3e4e11a56492bd9a1f09e1', 'request_id': 'req-c917b18e-421f-49ab-9548-126cf1b932a5'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:05.887758 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-c917b18e-421f-49ab-9548-126cf1b932a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7d897479c3e4e11a56492bd9a1f09e1', 'request_id': 'req-c917b18e-421f-49ab-9548-126cf1b932a5'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:05.894411 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-c917b18e-421f-49ab-9548-126cf1b932a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7d897479c3e4e11a56492bd9a1f09e1', 'request_id': 'req-c917b18e-421f-49ab-9548-126cf1b932a5'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:05.907302 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-c917b18e-421f-49ab-9548-126cf1b932a5 admin admin] The token cache is being invalidate because project a7d897479c3e4e11a56492bd9a1f09e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:02:05.907641 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-c917b18e-421f-49ab-9548-126cf1b932a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:05.908364 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-c917b18e-421f-49ab-9548-126cf1b932a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:05.910020 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1121/2237] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:02:05 2021] DELETE /identity/v3/projects/a7d897479c3e4e11a56492bd9a1f09e1 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:02:06.626363 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c578a244-8acf-4b7e-9a83-6b8d4b2af47f service neutron] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:02:06.627894 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-c578a244-8acf-4b7e-9a83-6b8d4b2af47f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:02:06.641148 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c578a244-8acf-4b7e-9a83-6b8d4b2af47f service neutron] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:02:06.702590 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddca9f9-fb1c-449e-8dd9-15c69f6634a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:02:06.703282 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddca9f9-fb1c-449e-8dd9-15c69f6634a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:06.703570 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddca9f9-fb1c-449e-8dd9-15c69f6634a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:06.703853 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddca9f9-fb1c-449e-8dd9-15c69f6634a0 admin admin] PATH_INFO: `/v3/users/d3843c0c145446be8d41ad71d308a246` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:06.705200 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddca9f9-fb1c-449e-8dd9-15c69f6634a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3843c0c145446be8d41ad71d308a246)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:02:06.707233 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddca9f9-fb1c-449e-8dd9-15c69f6634a0 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:02:06.762236 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-1ddca9f9-fb1c-449e-8dd9-15c69f6634a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3843c0c145446be8d41ad71d308a246'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:06.763183 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-1ddca9f9-fb1c-449e-8dd9-15c69f6634a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3843c0c145446be8d41ad71d308a246'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:06.788643 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-1ddca9f9-fb1c-449e-8dd9-15c69f6634a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3843c0c145446be8d41ad71d308a246'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:06.803579 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-1ddca9f9-fb1c-449e-8dd9-15c69f6634a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3843c0c145446be8d41ad71d308a246'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:06.804748 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-1ddca9f9-fb1c-449e-8dd9-15c69f6634a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3843c0c145446be8d41ad71d308a246'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:06.857594 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1117/2238] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:02:06 2021] DELETE /identity/v3/users/d3843c0c145446be8d41ad71d308a246 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:02:06.862160 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110ec20-a034-4101-b9c4-a5f138c6957c None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:06.862681 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110ec20-a034-4101-b9c4-a5f138c6957c None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:06.863792 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110ec20-a034-4101-b9c4-a5f138c6957c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:06.893141 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-4110ec20-a034-4101-b9c4-a5f138c6957c None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:02:06.895318 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-4110ec20-a034-4101-b9c4-a5f138c6957c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:02:07.002576 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1122/2239] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:02:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 05:02:07.013351 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddca9f9-fb1c-449e-8dd9-15c69f6634a0 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:02:07.015201 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-1ddca9f9-fb1c-449e-8dd9-15c69f6634a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:02:07.086998 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddca9f9-fb1c-449e-8dd9-15c69f6634a0 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:02:07.091330 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4828af-404b-4d2e-879c-d85d84d7a1f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:02:07.092108 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4828af-404b-4d2e-879c-d85d84d7a1f4 service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:07.092517 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4828af-404b-4d2e-879c-d85d84d7a1f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:07.092912 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4828af-404b-4d2e-879c-d85d84d7a1f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:07.103119 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4828af-404b-4d2e-879c-d85d84d7a1f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:02:07.104861 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4828af-404b-4d2e-879c-d85d84d7a1f4 service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:02:07.115325 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1118/2240] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:02:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:02:07.444779 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4110ec20-a034-4101-b9c4-a5f138c6957c None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:02:07.446722 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-4110ec20-a034-4101-b9c4-a5f138c6957c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:02:07.459284 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4110ec20-a034-4101-b9c4-a5f138c6957c None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:02:07.466155 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4a4d30-3b71-4017-b5aa-312c17c12147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:02:07.467050 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a4d30-3b71-4017-b5aa-312c17c12147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:07.467331 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a4d30-3b71-4017-b5aa-312c17c12147 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:07.467777 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a4d30-3b71-4017-b5aa-312c17c12147 admin admin] PATH_INFO: `/v3/users/b72895bc05a5419ebd84c06a91c5aaef` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:07.469142 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4a4d30-3b71-4017-b5aa-312c17c12147 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b72895bc05a5419ebd84c06a91c5aaef)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:02:07.471582 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4a4d30-3b71-4017-b5aa-312c17c12147 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:02:07.489846 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4828af-404b-4d2e-879c-d85d84d7a1f4 service neutron] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:02:07.491466 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-ff4828af-404b-4d2e-879c-d85d84d7a1f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:02:07.509322 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4828af-404b-4d2e-879c-d85d84d7a1f4 service neutron] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:02:07.526974 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b6c2a8-e3da-4c29-af51-3d950b053bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:02:07.529233 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6c2a8-e3da-4c29-af51-3d950b053bf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:07.531779 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6c2a8-e3da-4c29-af51-3d950b053bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:07.532273 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6c2a8-e3da-4c29-af51-3d950b053bf9 admin admin] PATH_INFO: `/v3/projects/f9dfd8d9ddc64e8b8f89b55ee841135c` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:07.547785 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b6c2a8-e3da-4c29-af51-3d950b053bf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9dfd8d9ddc64e8b8f89b55ee841135c)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:02:07.549998 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b6c2a8-e3da-4c29-af51-3d950b053bf9 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:02:07.569195 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-9e4a4d30-3b71-4017-b5aa-312c17c12147 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b72895bc05a5419ebd84c06a91c5aaef'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:07.569892 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-9e4a4d30-3b71-4017-b5aa-312c17c12147 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b72895bc05a5419ebd84c06a91c5aaef'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:07.579408 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-9e4a4d30-3b71-4017-b5aa-312c17c12147 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b72895bc05a5419ebd84c06a91c5aaef'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:07.591881 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-9e4a4d30-3b71-4017-b5aa-312c17c12147 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b72895bc05a5419ebd84c06a91c5aaef'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:07.606439 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-9e4a4d30-3b71-4017-b5aa-312c17c12147 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b72895bc05a5419ebd84c06a91c5aaef'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:07.614054 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1123/2241] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:02:07 2021] DELETE /identity/v3/users/b72895bc05a5419ebd84c06a91c5aaef => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:02:07.618346 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a207d5-7b62-48fa-8e9b-fd0f385a9762 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:07.618830 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a207d5-7b62-48fa-8e9b-fd0f385a9762 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:07.619313 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a207d5-7b62-48fa-8e9b-fd0f385a9762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:07.621612 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-d8b6c2a8-e3da-4c29-af51-3d950b053bf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9dfd8d9ddc64e8b8f89b55ee841135c', 'request_id': 'req-d8b6c2a8-e3da-4c29-af51-3d950b053bf9'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:07.629975 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-d8b6c2a8-e3da-4c29-af51-3d950b053bf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9dfd8d9ddc64e8b8f89b55ee841135c', 'request_id': 'req-d8b6c2a8-e3da-4c29-af51-3d950b053bf9'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:07.642061 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-d8b6c2a8-e3da-4c29-af51-3d950b053bf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9dfd8d9ddc64e8b8f89b55ee841135c', 'request_id': 'req-d8b6c2a8-e3da-4c29-af51-3d950b053bf9'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:07.644085 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-86a207d5-7b62-48fa-8e9b-fd0f385a9762 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:02:07.645501 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-86a207d5-7b62-48fa-8e9b-fd0f385a9762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:02:07.655539 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-d8b6c2a8-e3da-4c29-af51-3d950b053bf9 admin admin] The token cache is being invalidate because project f9dfd8d9ddc64e8b8f89b55ee841135c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:02:07.655937 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-d8b6c2a8-e3da-4c29-af51-3d950b053bf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:07.656780 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-d8b6c2a8-e3da-4c29-af51-3d950b053bf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:07.658782 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1119/2242] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:02:07 2021] DELETE /identity/v3/projects/f9dfd8d9ddc64e8b8f89b55ee841135c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 05:02:07.663580 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b6c2a8-e3da-4c29-af51-3d950b053bf9 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:02:07.665026 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-d8b6c2a8-e3da-4c29-af51-3d950b053bf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:02:07.735224 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1124/2243] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:02:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 05:02:07.747440 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a207d5-7b62-48fa-8e9b-fd0f385a9762 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:02:07.749497 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-86a207d5-7b62-48fa-8e9b-fd0f385a9762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:02:07.757486 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b6c2a8-e3da-4c29-af51-3d950b053bf9 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:02:07.765869 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146642f3-d748-4b15-a093-d6855faa671f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:02:07.766840 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146642f3-d748-4b15-a093-d6855faa671f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:07.767192 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146642f3-d748-4b15-a093-d6855faa671f admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:07.767533 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146642f3-d748-4b15-a093-d6855faa671f admin admin] PATH_INFO: `/v3/users/c1795fc8f9304e53a4f66a17543e65d4` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:07.768912 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146642f3-d748-4b15-a093-d6855faa671f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1795fc8f9304e53a4f66a17543e65d4)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:02:07.770979 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146642f3-d748-4b15-a093-d6855faa671f admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:02:07.827170 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a207d5-7b62-48fa-8e9b-fd0f385a9762 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:02:07.827683 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-146642f3-d748-4b15-a093-d6855faa671f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1795fc8f9304e53a4f66a17543e65d4'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:07.828556 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-146642f3-d748-4b15-a093-d6855faa671f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1795fc8f9304e53a4f66a17543e65d4'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:07.831497 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e4dc58-6bca-4991-889f-9ca78fcd401e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:02:07.832390 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4dc58-6bca-4991-889f-9ca78fcd401e service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:07.832765 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4dc58-6bca-4991-889f-9ca78fcd401e service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:07.833125 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4dc58-6bca-4991-889f-9ca78fcd401e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:07.835415 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-c6e4dc58-6bca-4991-889f-9ca78fcd401e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:02:07.836683 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-146642f3-d748-4b15-a093-d6855faa671f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1795fc8f9304e53a4f66a17543e65d4'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:07.851739 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-146642f3-d748-4b15-a093-d6855faa671f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1795fc8f9304e53a4f66a17543e65d4'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:07.852478 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-146642f3-d748-4b15-a093-d6855faa671f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1795fc8f9304e53a4f66a17543e65d4'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:07.864255 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e4dc58-6bca-4991-889f-9ca78fcd401e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:02:07.868412 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e4dc58-6bca-4991-889f-9ca78fcd401e service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:02:07.879970 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1120/2244] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:02:07 2021] DELETE /identity/v3/users/c1795fc8f9304e53a4f66a17543e65d4 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:02:07.888737 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1125/2245] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:02:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 24 05:02:08.358097 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146642f3-d748-4b15-a093-d6855faa671f admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:02:08.359757 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-146642f3-d748-4b15-a093-d6855faa671f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:02:08.417730 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e4dc58-6bca-4991-889f-9ca78fcd401e service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:02:08.419872 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-c6e4dc58-6bca-4991-889f-9ca78fcd401e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:02:08.439731 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e4dc58-6bca-4991-889f-9ca78fcd401e service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:02:08.488474 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146642f3-d748-4b15-a093-d6855faa671f admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:02:08.493761 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76999afa-a7c3-4db5-8a9d-e0dcee23597b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:02:08.494852 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76999afa-a7c3-4db5-8a9d-e0dcee23597b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:08.495168 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76999afa-a7c3-4db5-8a9d-e0dcee23597b admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:08.495445 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76999afa-a7c3-4db5-8a9d-e0dcee23597b admin admin] PATH_INFO: `/v3/projects/9250e0222ac942fdb82cf40c147ec203` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:08.497013 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76999afa-a7c3-4db5-8a9d-e0dcee23597b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9250e0222ac942fdb82cf40c147ec203)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:02:08.498980 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76999afa-a7c3-4db5-8a9d-e0dcee23597b admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:02:08.523012 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc876d-1ca9-4af4-a9fc-acaffef7a897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:02:08.523876 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc876d-1ca9-4af4-a9fc-acaffef7a897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:08.524150 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc876d-1ca9-4af4-a9fc-acaffef7a897 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:08.524423 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc876d-1ca9-4af4-a9fc-acaffef7a897 admin admin] PATH_INFO: `/v3/projects/2cef64dc84ce4b078d87def0a50d04fc` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:08.525686 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dc876d-1ca9-4af4-a9fc-acaffef7a897 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cef64dc84ce4b078d87def0a50d04fc)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:02:08.527682 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dc876d-1ca9-4af4-a9fc-acaffef7a897 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:02:08.555006 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-76999afa-a7c3-4db5-8a9d-e0dcee23597b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9250e0222ac942fdb82cf40c147ec203', 'request_id': 'req-76999afa-a7c3-4db5-8a9d-e0dcee23597b'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:08.566776 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-76999afa-a7c3-4db5-8a9d-e0dcee23597b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9250e0222ac942fdb82cf40c147ec203', 'request_id': 'req-76999afa-a7c3-4db5-8a9d-e0dcee23597b'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:08.573739 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-76999afa-a7c3-4db5-8a9d-e0dcee23597b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9250e0222ac942fdb82cf40c147ec203', 'request_id': 'req-76999afa-a7c3-4db5-8a9d-e0dcee23597b'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:08.588949 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-76999afa-a7c3-4db5-8a9d-e0dcee23597b admin admin] The token cache is being invalidate because project 9250e0222ac942fdb82cf40c147ec203 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:02:08.589765 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-76999afa-a7c3-4db5-8a9d-e0dcee23597b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:08.590900 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-76999afa-a7c3-4db5-8a9d-e0dcee23597b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:08.593727 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1121/2246] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:02:08 2021] DELETE /identity/v3/projects/9250e0222ac942fdb82cf40c147ec203 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 05:02:08.597407 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76999afa-a7c3-4db5-8a9d-e0dcee23597b admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:02:08.599185 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-76999afa-a7c3-4db5-8a9d-e0dcee23597b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:02:08.612215 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-14dc876d-1ca9-4af4-a9fc-acaffef7a897 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cef64dc84ce4b078d87def0a50d04fc', 'request_id': 'req-14dc876d-1ca9-4af4-a9fc-acaffef7a897'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:08.621583 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-14dc876d-1ca9-4af4-a9fc-acaffef7a897 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cef64dc84ce4b078d87def0a50d04fc', 'request_id': 'req-14dc876d-1ca9-4af4-a9fc-acaffef7a897'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:08.628465 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-14dc876d-1ca9-4af4-a9fc-acaffef7a897 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cef64dc84ce4b078d87def0a50d04fc', 'request_id': 'req-14dc876d-1ca9-4af4-a9fc-acaffef7a897'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:08.641988 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-14dc876d-1ca9-4af4-a9fc-acaffef7a897 admin admin] The token cache is being invalidate because project 2cef64dc84ce4b078d87def0a50d04fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:02:08.642279 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-14dc876d-1ca9-4af4-a9fc-acaffef7a897 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:08.642947 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-14dc876d-1ca9-4af4-a9fc-acaffef7a897 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:08.648679 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1126/2247] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:02:08 2021] DELETE /identity/v3/projects/2cef64dc84ce4b078d87def0a50d04fc => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:02:08.651124 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5353d1-db74-4517-80ee-0daf1a493ff6 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:08.651526 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5353d1-db74-4517-80ee-0daf1a493ff6 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:08.652072 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5353d1-db74-4517-80ee-0daf1a493ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:08.674187 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76999afa-a7c3-4db5-8a9d-e0dcee23597b admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:02:08.716775 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-6d5353d1-db74-4517-80ee-0daf1a493ff6 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:02:08.718460 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-6d5353d1-db74-4517-80ee-0daf1a493ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:02:08.734726 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9840057-44f4-4e37-8c60-dd92b3858717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:02:08.735726 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9840057-44f4-4e37-8c60-dd92b3858717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:08.736009 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9840057-44f4-4e37-8c60-dd92b3858717 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:08.736281 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9840057-44f4-4e37-8c60-dd92b3858717 admin admin] PATH_INFO: `/v3/users/7749ad4b2c0e4196ac1d89c510001183` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:08.737637 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9840057-44f4-4e37-8c60-dd92b3858717 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7749ad4b2c0e4196ac1d89c510001183)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:02:08.739816 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9840057-44f4-4e37-8c60-dd92b3858717 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:02:08.810596 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-d9840057-44f4-4e37-8c60-dd92b3858717 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7749ad4b2c0e4196ac1d89c510001183'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:08.811413 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-d9840057-44f4-4e37-8c60-dd92b3858717 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7749ad4b2c0e4196ac1d89c510001183'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:08.833429 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-d9840057-44f4-4e37-8c60-dd92b3858717 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7749ad4b2c0e4196ac1d89c510001183'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:08.843077 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1127/2248] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:02:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:02:08.844193 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-d9840057-44f4-4e37-8c60-dd92b3858717 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7749ad4b2c0e4196ac1d89c510001183'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:08.845641 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-d9840057-44f4-4e37-8c60-dd92b3858717 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7749ad4b2c0e4196ac1d89c510001183'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:08.850935 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a99f4-0b2f-464b-b923-cef0de03f970 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:08.854813 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a99f4-0b2f-464b-b923-cef0de03f970 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:08.855483 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a99f4-0b2f-464b-b923-cef0de03f970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:08.875991 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-791a99f4-0b2f-464b-b923-cef0de03f970 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:02:08.878962 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1122/2249] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:02:08 2021] DELETE /identity/v3/users/7749ad4b2c0e4196ac1d89c510001183 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 05:02:08.879458 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-791a99f4-0b2f-464b-b923-cef0de03f970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:02:08.956867 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1128/2250] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:02:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:02:08.961635 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9840057-44f4-4e37-8c60-dd92b3858717 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:02:08.976161 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9840057-44f4-4e37-8c60-dd92b3858717 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:02:08.990395 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c21ee-2575-413b-a6af-e9e309859163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:02:08.990999 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c21ee-2575-413b-a6af-e9e309859163 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:08.991285 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c21ee-2575-413b-a6af-e9e309859163 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:08.991615 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c21ee-2575-413b-a6af-e9e309859163 admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:08.992493 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c21ee-2575-413b-a6af-e9e309859163 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 05:02:08.992772 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c21ee-2575-413b-a6af-e9e309859163 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:02:08.994418 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c21ee-2575-413b-a6af-e9e309859163 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:02:09.023333 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1123/2251] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 05:02:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 05:02:09.028825 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a99f4-0b2f-464b-b923-cef0de03f970 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:02:09.039330 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a99f4-0b2f-464b-b923-cef0de03f970 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:02:09.045444 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882f816-4911-4a9c-92a6-2a28d62ba73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:02:09.046381 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882f816-4911-4a9c-92a6-2a28d62ba73d admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:09.046933 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882f816-4911-4a9c-92a6-2a28d62ba73d admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:09.047597 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882f816-4911-4a9c-92a6-2a28d62ba73d admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:09.048683 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d882f816-4911-4a9c-92a6-2a28d62ba73d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:02:09.051285 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d882f816-4911-4a9c-92a6-2a28d62ba73d admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:02:09.101755 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1129/2252] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:02:09 2021] POST /identity/v3/projects => generated 375 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 05:02:09.104650 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c21ee-2575-413b-a6af-e9e309859163 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:02:09.125886 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c21ee-2575-413b-a6af-e9e309859163 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:02:09.201346 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ee523-f7eb-44e4-9b23-374577d63e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:02:09.202348 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ee523-f7eb-44e4-9b23-374577d63e4d admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:09.202815 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ee523-f7eb-44e4-9b23-374577d63e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:09.203155 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ee523-f7eb-44e4-9b23-374577d63e4d admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:09.204363 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287ee523-f7eb-44e4-9b23-374577d63e4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:02:09.206684 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287ee523-f7eb-44e4-9b23-374577d63e4d admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:02:09.256595 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1124/2253] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:02:09 2021] POST /identity/v3/users => generated 288 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 05:02:09.261210 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882f816-4911-4a9c-92a6-2a28d62ba73d admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:02:09.277202 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ee523-f7eb-44e4-9b23-374577d63e4d admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:02:09.279101 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-287ee523-f7eb-44e4-9b23-374577d63e4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:02:09.284228 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882f816-4911-4a9c-92a6-2a28d62ba73d admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:02:09.296775 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f58ef-4d9e-4f70-8b40-8afbdecaee58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:02:09.298439 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f58ef-4d9e-4f70-8b40-8afbdecaee58 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:09.298439 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f58ef-4d9e-4f70-8b40-8afbdecaee58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:09.298589 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f58ef-4d9e-4f70-8b40-8afbdecaee58 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:09.300099 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03f58ef-4d9e-4f70-8b40-8afbdecaee58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:02:09.303272 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03f58ef-4d9e-4f70-8b40-8afbdecaee58 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:02:09.326041 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1130/2254] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:02:09 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:02:09.330959 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f58ef-4d9e-4f70-8b40-8afbdecaee58 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:02:09.347666 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f58ef-4d9e-4f70-8b40-8afbdecaee58 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:02:09.353046 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841febf-fd5b-422b-9c4f-410c211e30c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:02:09.353810 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841febf-fd5b-422b-9c4f-410c211e30c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:09.354145 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841febf-fd5b-422b-9c4f-410c211e30c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:09.354427 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841febf-fd5b-422b-9c4f-410c211e30c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:09.356029 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0841febf-fd5b-422b-9c4f-410c211e30c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:02:09.356306 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ee523-f7eb-44e4-9b23-374577d63e4d admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:02:09.357721 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0841febf-fd5b-422b-9c4f-410c211e30c5 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:02:09.375727 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1131/2255] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:02:09 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:02:09.378218 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c2c94-00e4-4823-9258-2cbadd5f4160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:02:09.379791 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c2c94-00e4-4823-9258-2cbadd5f4160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:09.380123 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841febf-fd5b-422b-9c4f-410c211e30c5 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:02:09.380725 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c2c94-00e4-4823-9258-2cbadd5f4160 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:09.381234 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c2c94-00e4-4823-9258-2cbadd5f4160 admin admin] PATH_INFO: `/v3/projects/2e5022f9a8e64ae8a6a07a880fe829f7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:09.385846 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4c2c94-00e4-4823-9258-2cbadd5f4160 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e5022f9a8e64ae8a6a07a880fe829f7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:02:09.390028 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4c2c94-00e4-4823-9258-2cbadd5f4160 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:02:09.391007 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841febf-fd5b-422b-9c4f-410c211e30c5 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:02:09.410990 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b25f99-751e-4581-905f-4bac2b6f2676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:02:09.413816 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b25f99-751e-4581-905f-4bac2b6f2676 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:09.414107 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b25f99-751e-4581-905f-4bac2b6f2676 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:09.414389 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b25f99-751e-4581-905f-4bac2b6f2676 admin admin] PATH_INFO: `/v3/projects/0ac8f71efa214005afee4763d429edbe/users/65caca4af15c465aa4846ce957c1f277/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:09.455984 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b25f99-751e-4581-905f-4bac2b6f2676 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ac8f71efa214005afee4763d429edbe, user_id=65caca4af15c465aa4846ce957c1f277, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:02:09.458973 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b25f99-751e-4581-905f-4bac2b6f2676 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:02:09.466921 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-bb4c2c94-00e4-4823-9258-2cbadd5f4160 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e5022f9a8e64ae8a6a07a880fe829f7', 'request_id': 'req-bb4c2c94-00e4-4823-9258-2cbadd5f4160'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:09.482170 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-bb4c2c94-00e4-4823-9258-2cbadd5f4160 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e5022f9a8e64ae8a6a07a880fe829f7', 'request_id': 'req-bb4c2c94-00e4-4823-9258-2cbadd5f4160'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:09.490501 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-bb4c2c94-00e4-4823-9258-2cbadd5f4160 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e5022f9a8e64ae8a6a07a880fe829f7', 'request_id': 'req-bb4c2c94-00e4-4823-9258-2cbadd5f4160'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:09.494653 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1132/2256] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:02:09 2021] PUT /identity/v3/projects/0ac8f71efa214005afee4763d429edbe/users/65caca4af15c465aa4846ce957c1f277/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:02:09.506061 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-bb4c2c94-00e4-4823-9258-2cbadd5f4160 admin admin] The token cache is being invalidate because project 2e5022f9a8e64ae8a6a07a880fe829f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:02:09.506717 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2e32b-25af-4d22-b357-0e395b822208 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:09.507174 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-bb4c2c94-00e4-4823-9258-2cbadd5f4160 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:09.508195 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-bb4c2c94-00e4-4823-9258-2cbadd5f4160 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:09.510451 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1125/2257] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:02:09 2021] DELETE /identity/v3/projects/2e5022f9a8e64ae8a6a07a880fe829f7 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:02:09.511884 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2e32b-25af-4d22-b357-0e395b822208 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:09.512386 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2e32b-25af-4d22-b357-0e395b822208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:09.516737 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85775967-6b28-487f-ba5a-119fcce09685 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:09.517702 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85775967-6b28-487f-ba5a-119fcce09685 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:09.518228 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85775967-6b28-487f-ba5a-119fcce09685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:09.544198 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-85775967-6b28-487f-ba5a-119fcce09685 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:02:09.546181 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-85775967-6b28-487f-ba5a-119fcce09685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:02:09.567668 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-1ed2e32b-25af-4d22-b357-0e395b822208 None None] MFA Rules not processed for user `65caca4af15c465aa4846ce957c1f277`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:02:09.567668 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-1ed2e32b-25af-4d22-b357-0e395b822208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:02:09.663093 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1133/2258] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:02:09 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:02:09.664111 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed2e32b-25af-4d22-b357-0e395b822208 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:02:09.668148 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-1ed2e32b-25af-4d22-b357-0e395b822208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:02:09.689596 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1126/2259] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:02:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:02:09.702413 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d68d15-d68e-45bf-af10-c42e24a7c9db None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:09.702706 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d68d15-d68e-45bf-af10-c42e24a7c9db None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:09.702981 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d68d15-d68e-45bf-af10-c42e24a7c9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:09.730233 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-77d68d15-d68e-45bf-af10-c42e24a7c9db None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:02:09.732013 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-77d68d15-d68e-45bf-af10-c42e24a7c9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:02:09.741967 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed2e32b-25af-4d22-b357-0e395b822208 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:02:09.745598 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1127/2260] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:02:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:02:09.746851 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d68d15-d68e-45bf-af10-c42e24a7c9db None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:02:09.747347 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46618d7-ad02-48bb-95aa-988f85b573ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:02:09.748070 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46618d7-ad02-48bb-95aa-988f85b573ad service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:09.748357 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46618d7-ad02-48bb-95aa-988f85b573ad service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:09.748705 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46618d7-ad02-48bb-95aa-988f85b573ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:09.757923 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46618d7-ad02-48bb-95aa-988f85b573ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:02:09.758129 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d68d15-d68e-45bf-af10-c42e24a7c9db None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:02:09.759616 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46618d7-ad02-48bb-95aa-988f85b573ad service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:02:09.766975 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146134ff-5588-4f7e-9ea7-446da75fea76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:02:09.768204 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146134ff-5588-4f7e-9ea7-446da75fea76 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:09.768329 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146134ff-5588-4f7e-9ea7-446da75fea76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:09.768670 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146134ff-5588-4f7e-9ea7-446da75fea76 admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:09.770204 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146134ff-5588-4f7e-9ea7-446da75fea76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 05:02:09.770474 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146134ff-5588-4f7e-9ea7-446da75fea76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:02:09.772255 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146134ff-5588-4f7e-9ea7-446da75fea76 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:02:09.772830 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1134/2261] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:02:09 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:02:09.794283 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1128/2262] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 05:02:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 05:02:09.795297 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46618d7-ad02-48bb-95aa-988f85b573ad service cinder] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:02:09.820260 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46618d7-ad02-48bb-95aa-988f85b573ad service cinder] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:02:09.833435 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01163d0-d7e4-45e6-b3c1-6b78a7fcdc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:02:09.834470 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01163d0-d7e4-45e6-b3c1-6b78a7fcdc4a admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:09.835317 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01163d0-d7e4-45e6-b3c1-6b78a7fcdc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:09.835815 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01163d0-d7e4-45e6-b3c1-6b78a7fcdc4a admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:09.836669 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01163d0-d7e4-45e6-b3c1-6b78a7fcdc4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:02:09.838793 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01163d0-d7e4-45e6-b3c1-6b78a7fcdc4a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:02:09.889575 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1135/2263] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:02:09 2021] POST /identity/v3/projects => generated 367 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:02:09.895683 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146134ff-5588-4f7e-9ea7-446da75fea76 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:02:09.912076 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146134ff-5588-4f7e-9ea7-446da75fea76 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:02:09.999131 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e88ff7-fb64-4732-bc5f-b4953aa5d8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:02:10.000710 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e88ff7-fb64-4732-bc5f-b4953aa5d8ff admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:10.000710 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e88ff7-fb64-4732-bc5f-b4953aa5d8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:10.002212 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e88ff7-fb64-4732-bc5f-b4953aa5d8ff admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:10.002212 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e88ff7-fb64-4732-bc5f-b4953aa5d8ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:02:10.004289 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e88ff7-fb64-4732-bc5f-b4953aa5d8ff admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:02:10.065940 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01163d0-d7e4-45e6-b3c1-6b78a7fcdc4a admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:02:10.079711 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1129/2264] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:02:09 2021] POST /identity/v3/users => generated 284 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:02:10.087016 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01163d0-d7e4-45e6-b3c1-6b78a7fcdc4a admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:02:10.110570 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7708296-f678-4c07-9195-00d84d553458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:02:10.110570 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7708296-f678-4c07-9195-00d84d553458 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:10.110570 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7708296-f678-4c07-9195-00d84d553458 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:10.110570 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7708296-f678-4c07-9195-00d84d553458 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:10.111322 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7708296-f678-4c07-9195-00d84d553458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:02:10.111322 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7708296-f678-4c07-9195-00d84d553458 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:02:10.121995 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1136/2265] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:02:10 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 24 05:02:10.126881 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e88ff7-fb64-4732-bc5f-b4953aa5d8ff admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:02:10.138845 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e88ff7-fb64-4732-bc5f-b4953aa5d8ff admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:02:10.146960 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f49feb-b2ef-4afb-b3a5-1313f3d73bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:02:10.148077 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f49feb-b2ef-4afb-b3a5-1313f3d73bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:10.148823 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f49feb-b2ef-4afb-b3a5-1313f3d73bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:10.149321 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f49feb-b2ef-4afb-b3a5-1313f3d73bb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:10.150360 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f49feb-b2ef-4afb-b3a5-1313f3d73bb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:02:10.152900 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f49feb-b2ef-4afb-b3a5-1313f3d73bb0 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:02:10.174037 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7708296-f678-4c07-9195-00d84d553458 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:02:10.181403 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1130/2266] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:02:10 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:02:10.186868 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7708296-f678-4c07-9195-00d84d553458 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:02:10.192963 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d9c9d3-2675-4c9e-b680-3f3d9173b376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:02:10.193972 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9c9d3-2675-4c9e-b680-3f3d9173b376 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:10.194356 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9c9d3-2675-4c9e-b680-3f3d9173b376 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:10.194675 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9c9d3-2675-4c9e-b680-3f3d9173b376 admin admin] PATH_INFO: `/v3/projects/c3a93b5704664252a75434c60a003e42/users/dce418c6af754f72aa4adefa2fb44da1/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:10.219542 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d9c9d3-2675-4c9e-b680-3f3d9173b376 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3a93b5704664252a75434c60a003e42, user_id=dce418c6af754f72aa4adefa2fb44da1, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:02:10.222792 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d9c9d3-2675-4c9e-b680-3f3d9173b376 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:02:10.260652 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1137/2267] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:02:10 2021] PUT /identity/v3/projects/c3a93b5704664252a75434c60a003e42/users/dce418c6af754f72aa4adefa2fb44da1/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:02:10.268987 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5e542-e80a-42a9-82db-6ac43edd7a95 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:10.269396 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5e542-e80a-42a9-82db-6ac43edd7a95 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:10.270204 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5e542-e80a-42a9-82db-6ac43edd7a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:10.312266 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-08c5e542-e80a-42a9-82db-6ac43edd7a95 None None] MFA Rules not processed for user `dce418c6af754f72aa4adefa2fb44da1`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:02:10.314541 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-08c5e542-e80a-42a9-82db-6ac43edd7a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:02:10.449446 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1131/2268] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:02:10 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:02:10.463358 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d9c9d3-2675-4c9e-b680-3f3d9173b376 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:02:10.465829 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-a0d9c9d3-2675-4c9e-b680-3f3d9173b376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:02:10.551869 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d9c9d3-2675-4c9e-b680-3f3d9173b376 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:02:10.556407 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea3e6ac-1558-4c3f-be5c-dbfc68b994af service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1782324ce854868bd11b32bd24b435c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:02:10.557351 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3e6ac-1558-4c3f-be5c-dbfc68b994af service glance] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:10.557953 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3e6ac-1558-4c3f-be5c-dbfc68b994af service glance] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:10.557953 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3e6ac-1558-4c3f-be5c-dbfc68b994af service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:10.567418 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea3e6ac-1558-4c3f-be5c-dbfc68b994af service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:02:10.568956 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea3e6ac-1558-4c3f-be5c-dbfc68b994af service glance] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:02:10.578858 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1138/2269] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:02:10 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:02:12.991750 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848f0ab-9421-4f5d-bc63-338847b83dd6 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:12.992621 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848f0ab-9421-4f5d-bc63-338847b83dd6 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:12.993248 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848f0ab-9421-4f5d-bc63-338847b83dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:13.012622 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-3848f0ab-9421-4f5d-bc63-338847b83dd6 None None] MFA Rules not processed for user `f29f576d3a98449b8077c0df53968f07`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:02:13.014341 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-3848f0ab-9421-4f5d-bc63-338847b83dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:02:13.082789 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1132/2270] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:02:12 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:02:14.441664 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea3e6ac-1558-4c3f-be5c-dbfc68b994af service glance] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:02:14.443810 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-4ea3e6ac-1558-4c3f-be5c-dbfc68b994af service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:02:14.555331 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea3e6ac-1558-4c3f-be5c-dbfc68b994af service glance] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:02:14.560813 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa32f0-cf59-4bcc-9d14-a51d2711ba29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:02:14.561767 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa32f0-cf59-4bcc-9d14-a51d2711ba29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:14.562090 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa32f0-cf59-4bcc-9d14-a51d2711ba29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:14.562385 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa32f0-cf59-4bcc-9d14-a51d2711ba29 admin admin] PATH_INFO: `/v3/users/65caca4af15c465aa4846ce957c1f277` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:14.563619 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa32f0-cf59-4bcc-9d14-a51d2711ba29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65caca4af15c465aa4846ce957c1f277)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:02:14.565729 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa32f0-cf59-4bcc-9d14-a51d2711ba29 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:02:14.627296 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-36aa32f0-cf59-4bcc-9d14-a51d2711ba29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65caca4af15c465aa4846ce957c1f277'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:14.628083 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-36aa32f0-cf59-4bcc-9d14-a51d2711ba29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65caca4af15c465aa4846ce957c1f277'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:14.637159 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-36aa32f0-cf59-4bcc-9d14-a51d2711ba29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65caca4af15c465aa4846ce957c1f277'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:14.643930 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-36aa32f0-cf59-4bcc-9d14-a51d2711ba29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65caca4af15c465aa4846ce957c1f277'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:14.659012 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-36aa32f0-cf59-4bcc-9d14-a51d2711ba29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65caca4af15c465aa4846ce957c1f277'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:14.665243 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1139/2271] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:02:14 2021] DELETE /identity/v3/users/65caca4af15c465aa4846ce957c1f277 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 05:02:14.670439 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e326d-8ab8-4db2-9430-03e1f42351da None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:14.670951 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e326d-8ab8-4db2-9430-03e1f42351da None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:14.671044 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e326d-8ab8-4db2-9430-03e1f42351da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:14.690373 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-b41e326d-8ab8-4db2-9430-03e1f42351da None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:02:14.691632 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-b41e326d-8ab8-4db2-9430-03e1f42351da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:02:14.755958 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1133/2272] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:02:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:02:14.766342 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa32f0-cf59-4bcc-9d14-a51d2711ba29 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:02:14.767777 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-36aa32f0-cf59-4bcc-9d14-a51d2711ba29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:02:14.913964 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa32f0-cf59-4bcc-9d14-a51d2711ba29 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:02:14.922242 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c8b07c-8378-4883-9823-ea019a8647b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:02:14.922891 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8b07c-8378-4883-9823-ea019a8647b2 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:14.923175 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8b07c-8378-4883-9823-ea019a8647b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:14.923449 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8b07c-8378-4883-9823-ea019a8647b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:14.937024 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c8b07c-8378-4883-9823-ea019a8647b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:02:14.938512 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c8b07c-8378-4883-9823-ea019a8647b2 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:02:14.952250 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1140/2273] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:02:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:02:15.298971 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e326d-8ab8-4db2-9430-03e1f42351da None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:02:15.300604 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-b41e326d-8ab8-4db2-9430-03e1f42351da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:02:15.325314 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e326d-8ab8-4db2-9430-03e1f42351da None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:02:15.331918 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5987cba1-9a78-4fb3-87aa-d73fd8e42cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:02:15.332922 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5987cba1-9a78-4fb3-87aa-d73fd8e42cc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:15.333259 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5987cba1-9a78-4fb3-87aa-d73fd8e42cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:15.333594 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5987cba1-9a78-4fb3-87aa-d73fd8e42cc1 admin admin] PATH_INFO: `/v3/projects/0ac8f71efa214005afee4763d429edbe` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:15.335214 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5987cba1-9a78-4fb3-87aa-d73fd8e42cc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ac8f71efa214005afee4763d429edbe)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:02:15.337327 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5987cba1-9a78-4fb3-87aa-d73fd8e42cc1 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:02:15.402449 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-5987cba1-9a78-4fb3-87aa-d73fd8e42cc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ac8f71efa214005afee4763d429edbe', 'request_id': 'req-5987cba1-9a78-4fb3-87aa-d73fd8e42cc1'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:15.411378 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-5987cba1-9a78-4fb3-87aa-d73fd8e42cc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ac8f71efa214005afee4763d429edbe', 'request_id': 'req-5987cba1-9a78-4fb3-87aa-d73fd8e42cc1'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:15.417325 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-5987cba1-9a78-4fb3-87aa-d73fd8e42cc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ac8f71efa214005afee4763d429edbe', 'request_id': 'req-5987cba1-9a78-4fb3-87aa-d73fd8e42cc1'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:15.440673 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-5987cba1-9a78-4fb3-87aa-d73fd8e42cc1 admin admin] The token cache is being invalidate because project 0ac8f71efa214005afee4763d429edbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:02:15.441354 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-5987cba1-9a78-4fb3-87aa-d73fd8e42cc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:15.444091 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-5987cba1-9a78-4fb3-87aa-d73fd8e42cc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:15.450373 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1134/2274] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:02:15 2021] DELETE /identity/v3/projects/0ac8f71efa214005afee4763d429edbe => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:02:15.452364 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cad4eb-72fb-4218-93ca-dd53584c9a7b None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:15.452911 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cad4eb-72fb-4218-93ca-dd53584c9a7b None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:15.453020 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cad4eb-72fb-4218-93ca-dd53584c9a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:15.472065 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-69cad4eb-72fb-4218-93ca-dd53584c9a7b None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:02:15.473263 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-69cad4eb-72fb-4218-93ca-dd53584c9a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:02:15.533319 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1141/2275] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:02:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 05:02:15.542445 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120b1ef-238e-4988-8477-97e95b0d0c17 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:15.543161 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120b1ef-238e-4988-8477-97e95b0d0c17 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:15.543417 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120b1ef-238e-4988-8477-97e95b0d0c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:15.563994 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-f120b1ef-238e-4988-8477-97e95b0d0c17 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:02:15.565344 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-f120b1ef-238e-4988-8477-97e95b0d0c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:02:15.573634 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1135/2276] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:02:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:02:15.578125 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cad4eb-72fb-4218-93ca-dd53584c9a7b None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:02:15.589903 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cad4eb-72fb-4218-93ca-dd53584c9a7b None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:02:15.599698 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d411226-8cb3-4f8f-919c-2b5dc2b3b879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:02:15.601069 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d411226-8cb3-4f8f-919c-2b5dc2b3b879 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:15.601360 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d411226-8cb3-4f8f-919c-2b5dc2b3b879 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:15.601638 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d411226-8cb3-4f8f-919c-2b5dc2b3b879 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:15.602395 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d411226-8cb3-4f8f-919c-2b5dc2b3b879 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 05:02:15.602706 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d411226-8cb3-4f8f-919c-2b5dc2b3b879 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:02:15.604325 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d411226-8cb3-4f8f-919c-2b5dc2b3b879 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:02:15.617189 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1142/2277] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 05:02:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 05:02:15.621697 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120b1ef-238e-4988-8477-97e95b0d0c17 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:02:15.631735 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120b1ef-238e-4988-8477-97e95b0d0c17 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:02:15.636883 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6dfdf-e8e0-49c1-8871-aef2394bea83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:02:15.637552 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6dfdf-e8e0-49c1-8871-aef2394bea83 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:15.637836 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6dfdf-e8e0-49c1-8871-aef2394bea83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:15.638111 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6dfdf-e8e0-49c1-8871-aef2394bea83 admin admin] PATH_INFO: `/v3/projects` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:15.638859 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6dfdf-e8e0-49c1-8871-aef2394bea83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:02:15.640897 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6dfdf-e8e0-49c1-8871-aef2394bea83 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:02:15.667668 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1136/2278] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:02:15 2021] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:02:15.672279 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d411226-8cb3-4f8f-919c-2b5dc2b3b879 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:02:15.683717 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d411226-8cb3-4f8f-919c-2b5dc2b3b879 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:02:15.758868 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932cc6f4-3b05-426d-9eb2-e21fea9b3875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:02:15.759554 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932cc6f4-3b05-426d-9eb2-e21fea9b3875 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:15.759864 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932cc6f4-3b05-426d-9eb2-e21fea9b3875 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:15.760125 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932cc6f4-3b05-426d-9eb2-e21fea9b3875 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:15.760907 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932cc6f4-3b05-426d-9eb2-e21fea9b3875 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:02:15.763596 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932cc6f4-3b05-426d-9eb2-e21fea9b3875 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:02:15.788551 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1143/2279] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:02:15 2021] POST /identity/v3/users => generated 288 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 05:02:15.792747 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6dfdf-e8e0-49c1-8871-aef2394bea83 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:02:15.804309 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6dfdf-e8e0-49c1-8871-aef2394bea83 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:02:15.809047 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df611ef-0f50-46ae-974f-0556603f4768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:02:15.809721 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df611ef-0f50-46ae-974f-0556603f4768 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:15.809999 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df611ef-0f50-46ae-974f-0556603f4768 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:15.810277 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df611ef-0f50-46ae-974f-0556603f4768 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:15.811046 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df611ef-0f50-46ae-974f-0556603f4768 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:02:15.812907 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df611ef-0f50-46ae-974f-0556603f4768 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:02:15.824974 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1137/2280] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:02:15 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:02:15.827911 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932cc6f4-3b05-426d-9eb2-e21fea9b3875 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:02:15.839843 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932cc6f4-3b05-426d-9eb2-e21fea9b3875 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:02:15.845314 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd045b-b84f-4c52-9760-fb36bd5b130e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:02:15.845947 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd045b-b84f-4c52-9760-fb36bd5b130e admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:15.846228 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd045b-b84f-4c52-9760-fb36bd5b130e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:15.846687 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd045b-b84f-4c52-9760-fb36bd5b130e admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:15.847492 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd045b-b84f-4c52-9760-fb36bd5b130e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:02:15.849350 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd045b-b84f-4c52-9760-fb36bd5b130e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:02:15.860865 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1144/2281] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:02:15 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:02:15.865524 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df611ef-0f50-46ae-974f-0556603f4768 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:02:15.879860 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df611ef-0f50-46ae-974f-0556603f4768 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:02:15.886061 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db31ae2-330f-4507-b30d-54762e1c37d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:02:15.887612 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db31ae2-330f-4507-b30d-54762e1c37d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:15.887953 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db31ae2-330f-4507-b30d-54762e1c37d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:15.888796 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db31ae2-330f-4507-b30d-54762e1c37d9 admin admin] PATH_INFO: `/v3/projects/aad82f86c5b5403799701feca92f316e/users/a777bab1007446e3bdcf9332119a2c9e/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:15.906672 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db31ae2-330f-4507-b30d-54762e1c37d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aad82f86c5b5403799701feca92f316e, user_id=a777bab1007446e3bdcf9332119a2c9e, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:02:15.909645 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db31ae2-330f-4507-b30d-54762e1c37d9 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:02:15.926029 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1138/2282] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:02:15 2021] PUT /identity/v3/projects/aad82f86c5b5403799701feca92f316e/users/a777bab1007446e3bdcf9332119a2c9e/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:02:15.939182 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d2d20-5c98-42a1-b229-076e184fcbdb None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:15.939599 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d2d20-5c98-42a1-b229-076e184fcbdb None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:15.939880 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d2d20-5c98-42a1-b229-076e184fcbdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:15.978609 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-5e1d2d20-5c98-42a1-b229-076e184fcbdb None None] MFA Rules not processed for user `a777bab1007446e3bdcf9332119a2c9e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:02:15.981074 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-5e1d2d20-5c98-42a1-b229-076e184fcbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:02:16.056125 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1145/2283] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:02:15 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:02:16.067942 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db31ae2-330f-4507-b30d-54762e1c37d9 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:02:16.069906 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-9db31ae2-330f-4507-b30d-54762e1c37d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:02:16.126982 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db31ae2-330f-4507-b30d-54762e1c37d9 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:02:16.130779 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0254ee58-b7e8-43f4-bddc-49ea22f857d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:02:16.131393 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0254ee58-b7e8-43f4-bddc-49ea22f857d2 service cinder] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:16.131678 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0254ee58-b7e8-43f4-bddc-49ea22f857d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:16.131957 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0254ee58-b7e8-43f4-bddc-49ea22f857d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:16.141186 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0254ee58-b7e8-43f4-bddc-49ea22f857d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:02:16.142805 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0254ee58-b7e8-43f4-bddc-49ea22f857d2 service cinder] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:02:16.152179 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1139/2284] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:02:16 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:02:18.558833 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d6416-e494-4de3-94ff-bcf3dfe64acc None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:18.559453 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d6416-e494-4de3-94ff-bcf3dfe64acc None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:18.559453 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d6416-e494-4de3-94ff-bcf3dfe64acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:18.581781 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-8c0d6416-e494-4de3-94ff-bcf3dfe64acc None None] MFA Rules not processed for user `3d0ee2c830754741b0f9eedabf6bded8`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:02:18.583044 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-8c0d6416-e494-4de3-94ff-bcf3dfe64acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:02:18.635755 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e2806-c29c-45e9-8de9-e81eb32fbef2 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:18.637261 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e2806-c29c-45e9-8de9-e81eb32fbef2 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:18.637706 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e2806-c29c-45e9-8de9-e81eb32fbef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:18.656114 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-2c7e2806-c29c-45e9-8de9-e81eb32fbef2 None None] MFA Rules not processed for user `a777bab1007446e3bdcf9332119a2c9e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:02:18.657387 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-2c7e2806-c29c-45e9-8de9-e81eb32fbef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:02:18.664476 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1140/2285] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:02:18 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 05:02:18.668718 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1146/2286] 10.222.0.43 () {58 vars in 967 bytes} [Fri Dec 24 05:02:18 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:02:18.689224 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d6416-e494-4de3-94ff-bcf3dfe64acc None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:02:18.690710 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-8c0d6416-e494-4de3-94ff-bcf3dfe64acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:02:18.767049 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d6416-e494-4de3-94ff-bcf3dfe64acc None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:02:18.772139 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abdb331-5375-43be-8e87-a1c3cc0f8538 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218ae7d29b71487d86b11aeb380788ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:02:18.772933 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abdb331-5375-43be-8e87-a1c3cc0f8538 service swift] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:18.773227 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abdb331-5375-43be-8e87-a1c3cc0f8538 service swift] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:18.773493 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abdb331-5375-43be-8e87-a1c3cc0f8538 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:18.783156 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abdb331-5375-43be-8e87-a1c3cc0f8538 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:02:18.784770 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abdb331-5375-43be-8e87-a1c3cc0f8538 service swift] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:02:18.793110 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1147/2287] 10.222.0.43 () {60 vars in 1384 bytes} [Fri Dec 24 05:02:18 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 24 05:02:21.057020 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e2806-c29c-45e9-8de9-e81eb32fbef2 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:02:21.059271 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-2c7e2806-c29c-45e9-8de9-e81eb32fbef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:02:21.125608 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e2806-c29c-45e9-8de9-e81eb32fbef2 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:02:21.131974 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f60f7d-fb45-43da-bf37-427007ed9869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:02:21.132996 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f60f7d-fb45-43da-bf37-427007ed9869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:21.133345 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f60f7d-fb45-43da-bf37-427007ed9869 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:21.133816 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f60f7d-fb45-43da-bf37-427007ed9869 admin admin] PATH_INFO: `/v3/users/fbefbd7e98c94b7598f4af35532d60cb` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:21.135390 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f60f7d-fb45-43da-bf37-427007ed9869 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbefbd7e98c94b7598f4af35532d60cb)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:02:21.137950 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f60f7d-fb45-43da-bf37-427007ed9869 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:02:21.192351 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-80f60f7d-fb45-43da-bf37-427007ed9869 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbefbd7e98c94b7598f4af35532d60cb'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:21.193033 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-80f60f7d-fb45-43da-bf37-427007ed9869 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbefbd7e98c94b7598f4af35532d60cb'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:21.199940 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-80f60f7d-fb45-43da-bf37-427007ed9869 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbefbd7e98c94b7598f4af35532d60cb'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:21.208599 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-80f60f7d-fb45-43da-bf37-427007ed9869 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbefbd7e98c94b7598f4af35532d60cb'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:21.209213 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-80f60f7d-fb45-43da-bf37-427007ed9869 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbefbd7e98c94b7598f4af35532d60cb'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:21.228260 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1141/2288] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:02:21 2021] DELETE /identity/v3/users/fbefbd7e98c94b7598f4af35532d60cb => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:02:21.457380 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abdb331-5375-43be-8e87-a1c3cc0f8538 service swift] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:02:21.473580 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abdb331-5375-43be-8e87-a1c3cc0f8538 service swift] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:02:21.578493 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be760b8-6ffa-4040-9e3b-c9e26b092e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:02:21.579704 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be760b8-6ffa-4040-9e3b-c9e26b092e53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:21.580146 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be760b8-6ffa-4040-9e3b-c9e26b092e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:21.580591 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be760b8-6ffa-4040-9e3b-c9e26b092e53 admin admin] PATH_INFO: `/v3/projects/1e014b3683d841968563e0aa0705e862` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:21.581960 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be760b8-6ffa-4040-9e3b-c9e26b092e53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e014b3683d841968563e0aa0705e862)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:02:21.595728 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be760b8-6ffa-4040-9e3b-c9e26b092e53 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:02:21.650914 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-8be760b8-6ffa-4040-9e3b-c9e26b092e53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e014b3683d841968563e0aa0705e862', 'request_id': 'req-8be760b8-6ffa-4040-9e3b-c9e26b092e53'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:21.672562 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-8be760b8-6ffa-4040-9e3b-c9e26b092e53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e014b3683d841968563e0aa0705e862', 'request_id': 'req-8be760b8-6ffa-4040-9e3b-c9e26b092e53'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:21.680436 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-8be760b8-6ffa-4040-9e3b-c9e26b092e53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e014b3683d841968563e0aa0705e862', 'request_id': 'req-8be760b8-6ffa-4040-9e3b-c9e26b092e53'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:21.696553 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-8be760b8-6ffa-4040-9e3b-c9e26b092e53 admin admin] The token cache is being invalidate because project 1e014b3683d841968563e0aa0705e862 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:02:21.697449 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-8be760b8-6ffa-4040-9e3b-c9e26b092e53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:21.698137 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-8be760b8-6ffa-4040-9e3b-c9e26b092e53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:02:21.700178 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1148/2289] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:02:21 2021] DELETE /identity/v3/projects/1e014b3683d841968563e0aa0705e862 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 05:02:21.705910 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c29ed-892b-4593-8834-9235c35db6c7 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:21.706203 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c29ed-892b-4593-8834-9235c35db6c7 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:21.706479 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c29ed-892b-4593-8834-9235c35db6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:21.740878 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-393c29ed-892b-4593-8834-9235c35db6c7 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:02:21.742189 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-393c29ed-892b-4593-8834-9235c35db6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:02:21.804571 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1142/2290] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:02:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:02:21.812458 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f711fa-492f-4ada-a21b-56a292556f29 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:21.812796 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f711fa-492f-4ada-a21b-56a292556f29 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:21.813071 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f711fa-492f-4ada-a21b-56a292556f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:21.843317 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-f2f711fa-492f-4ada-a21b-56a292556f29 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:02:21.844593 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-f2f711fa-492f-4ada-a21b-56a292556f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:02:21.852949 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1149/2291] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:02:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:02:21.857759 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c29ed-892b-4593-8834-9235c35db6c7 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:02:21.869479 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c29ed-892b-4593-8834-9235c35db6c7 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:02:21.875752 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c99648-beae-4aed-9bea-4161ab7f4752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:02:21.876729 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c99648-beae-4aed-9bea-4161ab7f4752 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:21.876979 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c99648-beae-4aed-9bea-4161ab7f4752 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:21.877280 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c99648-beae-4aed-9bea-4161ab7f4752 admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:21.878148 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c99648-beae-4aed-9bea-4161ab7f4752 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 05:02:21.878507 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c99648-beae-4aed-9bea-4161ab7f4752 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:02:21.880388 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c99648-beae-4aed-9bea-4161ab7f4752 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:02:21.894614 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1143/2292] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 05:02:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 05:02:21.899124 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f711fa-492f-4ada-a21b-56a292556f29 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:02:21.908817 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f711fa-492f-4ada-a21b-56a292556f29 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:02:21.927586 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f063c66-0c5d-4e21-b506-3c1a30106a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:02:21.928375 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f063c66-0c5d-4e21-b506-3c1a30106a00 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:21.928762 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f063c66-0c5d-4e21-b506-3c1a30106a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:21.929112 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f063c66-0c5d-4e21-b506-3c1a30106a00 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:21.929971 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f063c66-0c5d-4e21-b506-3c1a30106a00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:02:21.932045 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f063c66-0c5d-4e21-b506-3c1a30106a00 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:02:21.962112 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1150/2293] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:02:21 2021] POST /identity/v3/projects => generated 383 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 05:02:21.966277 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c99648-beae-4aed-9bea-4161ab7f4752 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:02:21.976724 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c99648-beae-4aed-9bea-4161ab7f4752 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:02:22.035108 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d923bd-89c3-4720-b212-2a706cf85f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:02:22.035722 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d923bd-89c3-4720-b212-2a706cf85f38 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:22.036003 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d923bd-89c3-4720-b212-2a706cf85f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:22.036272 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d923bd-89c3-4720-b212-2a706cf85f38 admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:22.037029 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d923bd-89c3-4720-b212-2a706cf85f38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:02:22.038964 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d923bd-89c3-4720-b212-2a706cf85f38 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:02:22.065538 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1144/2294] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:02:21 2021] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:02:22.072238 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f063c66-0c5d-4e21-b506-3c1a30106a00 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:02:22.085681 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f063c66-0c5d-4e21-b506-3c1a30106a00 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:02:22.091200 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e22d036-e2a5-431d-b690-0581c6c52608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:02:22.091882 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22d036-e2a5-431d-b690-0581c6c52608 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:22.092164 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22d036-e2a5-431d-b690-0581c6c52608 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:22.092437 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22d036-e2a5-431d-b690-0581c6c52608 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:22.093210 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e22d036-e2a5-431d-b690-0581c6c52608 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:02:22.094825 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e22d036-e2a5-431d-b690-0581c6c52608 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:02:22.108083 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1151/2295] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:02:22 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:02:22.111800 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d923bd-89c3-4720-b212-2a706cf85f38 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:02:22.124211 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d923bd-89c3-4720-b212-2a706cf85f38 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:02:22.129279 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98361f80-4871-43de-8732-0df62008b51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:02:22.129939 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98361f80-4871-43de-8732-0df62008b51d admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:22.130202 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98361f80-4871-43de-8732-0df62008b51d admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:22.130472 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98361f80-4871-43de-8732-0df62008b51d admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:22.131249 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98361f80-4871-43de-8732-0df62008b51d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:02:22.132892 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98361f80-4871-43de-8732-0df62008b51d admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:02:22.143206 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1145/2296] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:02:22 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:02:22.147412 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e22d036-e2a5-431d-b690-0581c6c52608 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:02:22.157919 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e22d036-e2a5-431d-b690-0581c6c52608 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:02:22.163182 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b4bf98-5d1b-4b6d-ab05-31972e82bcef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:02:22.164578 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4bf98-5d1b-4b6d-ab05-31972e82bcef admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:22.164855 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4bf98-5d1b-4b6d-ab05-31972e82bcef admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:22.165125 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4bf98-5d1b-4b6d-ab05-31972e82bcef admin admin] PATH_INFO: `/v3/projects/122a6a1d32d648c6938f0b159bb3641c/users/82fc245c775844e6af2acc79a1e637e8/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:22.181574 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b4bf98-5d1b-4b6d-ab05-31972e82bcef admin admin] RBAC: Authorizing `identity:create_grant(project_id=122a6a1d32d648c6938f0b159bb3641c, user_id=82fc245c775844e6af2acc79a1e637e8, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:02:22.184808 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b4bf98-5d1b-4b6d-ab05-31972e82bcef admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:02:22.199527 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1152/2297] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:02:22 2021] PUT /identity/v3/projects/122a6a1d32d648c6938f0b159bb3641c/users/82fc245c775844e6af2acc79a1e637e8/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 05:02:22.204698 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c234012-c503-45f5-b1d8-5d26c71cf6aa None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:22.204980 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c234012-c503-45f5-b1d8-5d26c71cf6aa None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:22.205274 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c234012-c503-45f5-b1d8-5d26c71cf6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:22.228367 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-8c234012-c503-45f5-b1d8-5d26c71cf6aa None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:02:22.229998 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-8c234012-c503-45f5-b1d8-5d26c71cf6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:02:22.298425 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1146/2298] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:02:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 05:02:22.311375 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b4bf98-5d1b-4b6d-ab05-31972e82bcef admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:02:22.314935 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-f9b4bf98-5d1b-4b6d-ab05-31972e82bcef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:02:22.379281 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b4bf98-5d1b-4b6d-ab05-31972e82bcef admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:02:22.383451 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0bb916-d09b-4cd7-9987-d2cdd2cb0776 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:02:22.383897 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0bb916-d09b-4cd7-9987-d2cdd2cb0776 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:22.384177 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0bb916-d09b-4cd7-9987-d2cdd2cb0776 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:22.384452 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0bb916-d09b-4cd7-9987-d2cdd2cb0776 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:22.395235 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0bb916-d09b-4cd7-9987-d2cdd2cb0776 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:02:22.396857 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0bb916-d09b-4cd7-9987-d2cdd2cb0776 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:02:22.406772 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1153/2299] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:02:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:02:23.184142 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baad869-3a9b-4d51-b374-657dcbe061ab None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:23.184735 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baad869-3a9b-4d51-b374-657dcbe061ab None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:23.184900 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baad869-3a9b-4d51-b374-657dcbe061ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:23.217225 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-1baad869-3a9b-4d51-b374-657dcbe061ab None None] MFA Rules not processed for user `82fc245c775844e6af2acc79a1e637e8`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:02:23.218460 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-1baad869-3a9b-4d51-b374-657dcbe061ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:02:23.335933 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1147/2300] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:02:23 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 05:02:23.337147 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0bb916-d09b-4cd7-9987-d2cdd2cb0776 service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:02:23.338970 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-9d0bb916-d09b-4cd7-9987-d2cdd2cb0776 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:02:23.431500 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0bb916-d09b-4cd7-9987-d2cdd2cb0776 service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:02:23.436244 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed4e63-54d3-40c2-8026-ea5c02df79e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:02:23.437058 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed4e63-54d3-40c2-8026-ea5c02df79e5 service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:23.437432 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed4e63-54d3-40c2-8026-ea5c02df79e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:23.437799 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed4e63-54d3-40c2-8026-ea5c02df79e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:23.447642 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ed4e63-54d3-40c2-8026-ea5c02df79e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:02:23.449778 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ed4e63-54d3-40c2-8026-ea5c02df79e5 service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:02:23.461346 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1154/2301] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:02:23 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:02:25.922862 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e3ca6-3d98-40d4-93bb-8d43b8da7e3c None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:25.923385 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e3ca6-3d98-40d4-93bb-8d43b8da7e3c None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:25.923385 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e3ca6-3d98-40d4-93bb-8d43b8da7e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:25.942257 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-746e3ca6-3d98-40d4-93bb-8d43b8da7e3c None None] MFA Rules not processed for user `82fc245c775844e6af2acc79a1e637e8`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:02:25.943504 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-746e3ca6-3d98-40d4-93bb-8d43b8da7e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:02:25.952328 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1148/2302] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:02:25 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:02:27.066480 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed4e63-54d3-40c2-8026-ea5c02df79e5 service cinder] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:02:27.068127 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-86ed4e63-54d3-40c2-8026-ea5c02df79e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:02:27.164003 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed4e63-54d3-40c2-8026-ea5c02df79e5 service cinder] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:02:27.170157 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67b033-5f8e-457f-9585-09d38552da18 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '430d6177e74c4dbda7fb83d04c75617e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:02:27.170777 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67b033-5f8e-457f-9585-09d38552da18 service placement] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:27.171020 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67b033-5f8e-457f-9585-09d38552da18 service placement] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:27.171331 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67b033-5f8e-457f-9585-09d38552da18 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:27.173426 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-8d67b033-5f8e-457f-9585-09d38552da18 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:02:27.189181 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d67b033-5f8e-457f-9585-09d38552da18 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:02:27.190795 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d67b033-5f8e-457f-9585-09d38552da18 service placement] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:02:27.202828 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1155/2303] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:02:27 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:02:43.699384 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5fd1d0-2f39-4bfa-86ef-8f6d61e95726 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:43.700083 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5fd1d0-2f39-4bfa-86ef-8f6d61e95726 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:43.700176 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5fd1d0-2f39-4bfa-86ef-8f6d61e95726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:43.735305 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-aa5fd1d0-2f39-4bfa-86ef-8f6d61e95726 None None] MFA Rules not processed for user `3d0ee2c830754741b0f9eedabf6bded8`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:02:43.736499 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-aa5fd1d0-2f39-4bfa-86ef-8f6d61e95726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:02:43.804118 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1149/2304] 10.222.0.43 () {58 vars in 1009 bytes} [Fri Dec 24 05:02:43 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:02:43.817172 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67b033-5f8e-457f-9585-09d38552da18 service placement] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:02:43.818671 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-8d67b033-5f8e-457f-9585-09d38552da18 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:02:43.892324 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67b033-5f8e-457f-9585-09d38552da18 service placement] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:02:43.898582 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e86f8b0-fb39-4b7a-a2a7-609b98031ede service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218ae7d29b71487d86b11aeb380788ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:02:43.899225 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86f8b0-fb39-4b7a-a2a7-609b98031ede service swift] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:43.899565 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86f8b0-fb39-4b7a-a2a7-609b98031ede service swift] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:43.899822 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86f8b0-fb39-4b7a-a2a7-609b98031ede service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:43.908304 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e86f8b0-fb39-4b7a-a2a7-609b98031ede service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:02:43.909948 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e86f8b0-fb39-4b7a-a2a7-609b98031ede service swift] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:02:43.918548 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1156/2305] 10.222.0.43 () {60 vars in 1384 bytes} [Fri Dec 24 05:02:43 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 24 05:02:44.485130 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7d7a3-84d0-474b-8e4e-4a07565f1fe7 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:44.485425 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7d7a3-84d0-474b-8e4e-4a07565f1fe7 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:44.485706 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7d7a3-84d0-474b-8e4e-4a07565f1fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:44.505729 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-e2d7d7a3-84d0-474b-8e4e-4a07565f1fe7 None None] MFA Rules not processed for user `3d0ee2c830754741b0f9eedabf6bded8`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:02:44.507252 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-e2d7d7a3-84d0-474b-8e4e-4a07565f1fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:02:44.515502 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1150/2306] 10.222.0.43 () {58 vars in 967 bytes} [Fri Dec 24 05:02:44 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:02:44.530476 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e86f8b0-fb39-4b7a-a2a7-609b98031ede service swift] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:02:44.541583 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e86f8b0-fb39-4b7a-a2a7-609b98031ede service swift] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:02:44.547625 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f334ef-bda2-415b-85a5-7848c7f35dbb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218ae7d29b71487d86b11aeb380788ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:02:44.547817 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f334ef-bda2-415b-85a5-7848c7f35dbb service swift] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:44.548100 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f334ef-bda2-415b-85a5-7848c7f35dbb service swift] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:44.548380 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f334ef-bda2-415b-85a5-7848c7f35dbb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:44.557711 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f334ef-bda2-415b-85a5-7848c7f35dbb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:02:44.559770 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f334ef-bda2-415b-85a5-7848c7f35dbb service swift] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:02:44.569335 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1157/2307] 10.222.0.43 () {60 vars in 1384 bytes} [Fri Dec 24 05:02:44 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 24 05:02:44.819196 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b154c6-92e8-4eb7-8245-e1f0f48f8aa9 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:44.819689 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b154c6-92e8-4eb7-8245-e1f0f48f8aa9 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:44.819994 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b154c6-92e8-4eb7-8245-e1f0f48f8aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:44.840272 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-25b154c6-92e8-4eb7-8245-e1f0f48f8aa9 None None] MFA Rules not processed for user `3d0ee2c830754741b0f9eedabf6bded8`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:02:44.841525 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-25b154c6-92e8-4eb7-8245-e1f0f48f8aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:02:44.849057 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1151/2308] 10.222.0.43 () {58 vars in 1009 bytes} [Fri Dec 24 05:02:44 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:02:44.863863 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f334ef-bda2-415b-85a5-7848c7f35dbb service swift] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:02:44.874463 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f334ef-bda2-415b-85a5-7848c7f35dbb service swift] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:02:44.881184 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30780274-f307-4492-a3c0-b5eead16f588 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218ae7d29b71487d86b11aeb380788ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:02:44.881745 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30780274-f307-4492-a3c0-b5eead16f588 service swift] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:44.882100 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30780274-f307-4492-a3c0-b5eead16f588 service swift] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:44.882362 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30780274-f307-4492-a3c0-b5eead16f588 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:44.890795 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30780274-f307-4492-a3c0-b5eead16f588 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:02:44.892359 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30780274-f307-4492-a3c0-b5eead16f588 service swift] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:02:44.900783 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1158/2309] 10.222.0.43 () {60 vars in 1384 bytes} [Fri Dec 24 05:02:44 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 24 05:02:45.232500 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da755670-061c-4d8e-8fb1-7c6737e29345 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:45.232810 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da755670-061c-4d8e-8fb1-7c6737e29345 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:45.233811 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da755670-061c-4d8e-8fb1-7c6737e29345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:45.255022 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-da755670-061c-4d8e-8fb1-7c6737e29345 None None] MFA Rules not processed for user `3d0ee2c830754741b0f9eedabf6bded8`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:02:45.256692 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-da755670-061c-4d8e-8fb1-7c6737e29345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:02:45.265540 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1152/2310] 10.222.0.43 () {58 vars in 967 bytes} [Fri Dec 24 05:02:45 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:02:45.281443 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30780274-f307-4492-a3c0-b5eead16f588 service swift] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:02:45.293036 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30780274-f307-4492-a3c0-b5eead16f588 service swift] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:02:45.301372 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d91f1-eea7-4301-b88a-cef2434dff3e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218ae7d29b71487d86b11aeb380788ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:02:45.302323 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d91f1-eea7-4301-b88a-cef2434dff3e service swift] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:02:45.302726 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d91f1-eea7-4301-b88a-cef2434dff3e service swift] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:02:45.303031 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d91f1-eea7-4301-b88a-cef2434dff3e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:02:45.313377 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6d91f1-eea7-4301-b88a-cef2434dff3e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:02:45.314986 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6d91f1-eea7-4301-b88a-cef2434dff3e service swift] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:02:45.325837 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1159/2311] 10.222.0.43 () {60 vars in 1384 bytes} [Fri Dec 24 05:02:45 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 24 05:03:02.111977 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da755670-061c-4d8e-8fb1-7c6737e29345 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:03:02.113631 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-da755670-061c-4d8e-8fb1-7c6737e29345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:03:02.129833 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da755670-061c-4d8e-8fb1-7c6737e29345 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:03:02.134884 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da25563-b04c-4f0a-be83-94df2cf28118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:03:02.135776 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da25563-b04c-4f0a-be83-94df2cf28118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:03:02.136058 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da25563-b04c-4f0a-be83-94df2cf28118 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:03:02.136332 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da25563-b04c-4f0a-be83-94df2cf28118 admin admin] PATH_INFO: `/v3/users/a777bab1007446e3bdcf9332119a2c9e` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:03:02.137847 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da25563-b04c-4f0a-be83-94df2cf28118 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a777bab1007446e3bdcf9332119a2c9e)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:03:02.139791 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da25563-b04c-4f0a-be83-94df2cf28118 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:03:02.187344 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-0da25563-b04c-4f0a-be83-94df2cf28118 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a777bab1007446e3bdcf9332119a2c9e'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:03:02.187989 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-0da25563-b04c-4f0a-be83-94df2cf28118 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a777bab1007446e3bdcf9332119a2c9e'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:03:02.194850 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-0da25563-b04c-4f0a-be83-94df2cf28118 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a777bab1007446e3bdcf9332119a2c9e'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:03:02.204607 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-0da25563-b04c-4f0a-be83-94df2cf28118 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a777bab1007446e3bdcf9332119a2c9e'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:03:02.205264 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-0da25563-b04c-4f0a-be83-94df2cf28118 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a777bab1007446e3bdcf9332119a2c9e'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:03:02.223622 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1153/2312] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:03:02 2021] DELETE /identity/v3/users/a777bab1007446e3bdcf9332119a2c9e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:03:02.229004 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d4ffe-de19-4bed-8c66-b3ded6172801 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:03:02.229587 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d4ffe-de19-4bed-8c66-b3ded6172801 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:03:02.229587 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d4ffe-de19-4bed-8c66-b3ded6172801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:03:02.247437 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-ff5d4ffe-de19-4bed-8c66-b3ded6172801 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:03:02.248677 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-ff5d4ffe-de19-4bed-8c66-b3ded6172801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:03:02.328727 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1160/2313] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:03:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 05:03:02.336012 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da25563-b04c-4f0a-be83-94df2cf28118 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:03:02.338056 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-0da25563-b04c-4f0a-be83-94df2cf28118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:03:02.402270 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da25563-b04c-4f0a-be83-94df2cf28118 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:03:02.406849 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22239269-bb1f-4f33-8d30-0a3aedd06bbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:03:02.407504 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22239269-bb1f-4f33-8d30-0a3aedd06bbb service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:03:02.407786 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22239269-bb1f-4f33-8d30-0a3aedd06bbb service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:03:02.408060 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22239269-bb1f-4f33-8d30-0a3aedd06bbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:03:02.417343 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22239269-bb1f-4f33-8d30-0a3aedd06bbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:03:02.419141 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22239269-bb1f-4f33-8d30-0a3aedd06bbb service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:03:02.428900 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1154/2314] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:03:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:03:02.612288 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d4ffe-de19-4bed-8c66-b3ded6172801 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:03:02.613736 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-ff5d4ffe-de19-4bed-8c66-b3ded6172801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:03:02.627777 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d4ffe-de19-4bed-8c66-b3ded6172801 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:03:02.633785 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60096a62-135e-4563-9805-b7510d562326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:03:02.635345 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60096a62-135e-4563-9805-b7510d562326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:03:02.635521 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60096a62-135e-4563-9805-b7510d562326 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:03:02.635773 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60096a62-135e-4563-9805-b7510d562326 admin admin] PATH_INFO: `/v3/projects/aad82f86c5b5403799701feca92f316e` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:03:02.637230 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60096a62-135e-4563-9805-b7510d562326 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aad82f86c5b5403799701feca92f316e)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:03:02.639518 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60096a62-135e-4563-9805-b7510d562326 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:03:02.691533 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-60096a62-135e-4563-9805-b7510d562326 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aad82f86c5b5403799701feca92f316e', 'request_id': 'req-60096a62-135e-4563-9805-b7510d562326'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:03:02.698877 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-60096a62-135e-4563-9805-b7510d562326 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aad82f86c5b5403799701feca92f316e', 'request_id': 'req-60096a62-135e-4563-9805-b7510d562326'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:03:02.704782 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-60096a62-135e-4563-9805-b7510d562326 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aad82f86c5b5403799701feca92f316e', 'request_id': 'req-60096a62-135e-4563-9805-b7510d562326'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:03:02.715940 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-60096a62-135e-4563-9805-b7510d562326 admin admin] The token cache is being invalidate because project aad82f86c5b5403799701feca92f316e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:03:02.716232 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-60096a62-135e-4563-9805-b7510d562326 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:03:02.716905 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-60096a62-135e-4563-9805-b7510d562326 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:03:02.718444 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1161/2315] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:03:02 2021] DELETE /identity/v3/projects/aad82f86c5b5403799701feca92f316e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:03:07.840664 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22239269-bb1f-4f33-8d30-0a3aedd06bbb service neutron] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:03:07.843139 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-22239269-bb1f-4f33-8d30-0a3aedd06bbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:03:07.861121 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22239269-bb1f-4f33-8d30-0a3aedd06bbb service neutron] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:03:07.921246 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed84e0-865e-4ec5-b8fc-07620e6aaf4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:03:07.922160 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed84e0-865e-4ec5-b8fc-07620e6aaf4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:03:07.922468 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed84e0-865e-4ec5-b8fc-07620e6aaf4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:03:07.922740 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed84e0-865e-4ec5-b8fc-07620e6aaf4d admin admin] PATH_INFO: `/v3/users/dce418c6af754f72aa4adefa2fb44da1` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:03:07.924056 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deed84e0-865e-4ec5-b8fc-07620e6aaf4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=dce418c6af754f72aa4adefa2fb44da1)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:03:07.926061 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deed84e0-865e-4ec5-b8fc-07620e6aaf4d admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:03:07.974684 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-deed84e0-865e-4ec5-b8fc-07620e6aaf4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dce418c6af754f72aa4adefa2fb44da1'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:03:07.975405 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-deed84e0-865e-4ec5-b8fc-07620e6aaf4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dce418c6af754f72aa4adefa2fb44da1'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:03:07.982030 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-deed84e0-865e-4ec5-b8fc-07620e6aaf4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dce418c6af754f72aa4adefa2fb44da1'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:03:07.990771 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-deed84e0-865e-4ec5-b8fc-07620e6aaf4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dce418c6af754f72aa4adefa2fb44da1'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:03:07.991385 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-deed84e0-865e-4ec5-b8fc-07620e6aaf4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dce418c6af754f72aa4adefa2fb44da1'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:03:08.008148 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1155/2316] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:03:07 2021] DELETE /identity/v3/users/dce418c6af754f72aa4adefa2fb44da1 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:03:08.012742 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b092be-728b-4b01-90dd-60260926cbb6 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:03:08.013226 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b092be-728b-4b01-90dd-60260926cbb6 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:03:08.013423 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b092be-728b-4b01-90dd-60260926cbb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:03:08.031320 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-b4b092be-728b-4b01-90dd-60260926cbb6 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:03:08.032558 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-b4b092be-728b-4b01-90dd-60260926cbb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:03:08.098089 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1162/2317] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:03:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:03:08.107902 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed84e0-865e-4ec5-b8fc-07620e6aaf4d admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:03:08.109565 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-deed84e0-865e-4ec5-b8fc-07620e6aaf4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:03:08.172468 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed84e0-865e-4ec5-b8fc-07620e6aaf4d admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:03:08.179851 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3291d835-bae2-49b5-b7ff-9a783948f9be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:03:08.180895 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291d835-bae2-49b5-b7ff-9a783948f9be service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:03:08.181359 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291d835-bae2-49b5-b7ff-9a783948f9be service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:03:08.181760 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291d835-bae2-49b5-b7ff-9a783948f9be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:03:08.192924 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3291d835-bae2-49b5-b7ff-9a783948f9be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:03:08.194387 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3291d835-bae2-49b5-b7ff-9a783948f9be service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:03:08.204395 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1156/2318] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:03:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:03:08.473458 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b092be-728b-4b01-90dd-60260926cbb6 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:03:08.474968 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-b4b092be-728b-4b01-90dd-60260926cbb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:03:08.487421 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b092be-728b-4b01-90dd-60260926cbb6 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:03:08.493210 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a385993a-d5a7-4153-93e6-d46cb9a7e432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:03:08.493786 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385993a-d5a7-4153-93e6-d46cb9a7e432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:03:08.494062 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385993a-d5a7-4153-93e6-d46cb9a7e432 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:03:08.494340 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385993a-d5a7-4153-93e6-d46cb9a7e432 admin admin] PATH_INFO: `/v3/projects/c3a93b5704664252a75434c60a003e42` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:03:08.495697 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a385993a-d5a7-4153-93e6-d46cb9a7e432 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3a93b5704664252a75434c60a003e42)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:03:08.498126 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a385993a-d5a7-4153-93e6-d46cb9a7e432 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:03:08.545191 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-a385993a-d5a7-4153-93e6-d46cb9a7e432 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3a93b5704664252a75434c60a003e42', 'request_id': 'req-a385993a-d5a7-4153-93e6-d46cb9a7e432'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:03:08.553705 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-a385993a-d5a7-4153-93e6-d46cb9a7e432 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3a93b5704664252a75434c60a003e42', 'request_id': 'req-a385993a-d5a7-4153-93e6-d46cb9a7e432'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:03:08.559308 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-a385993a-d5a7-4153-93e6-d46cb9a7e432 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3a93b5704664252a75434c60a003e42', 'request_id': 'req-a385993a-d5a7-4153-93e6-d46cb9a7e432'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:03:08.570219 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-a385993a-d5a7-4153-93e6-d46cb9a7e432 admin admin] The token cache is being invalidate because project c3a93b5704664252a75434c60a003e42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:03:08.570523 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-a385993a-d5a7-4153-93e6-d46cb9a7e432 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:03:08.571192 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-a385993a-d5a7-4153-93e6-d46cb9a7e432 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:03:08.572774 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1163/2319] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:03:08 2021] DELETE /identity/v3/projects/c3a93b5704664252a75434c60a003e42 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:03:08.578813 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea290936-35b4-476f-9d3f-0c4f057d7609 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:03:08.579094 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea290936-35b4-476f-9d3f-0c4f057d7609 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:03:08.579361 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea290936-35b4-476f-9d3f-0c4f057d7609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:03:08.598756 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-ea290936-35b4-476f-9d3f-0c4f057d7609 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:03:08.600137 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-ea290936-35b4-476f-9d3f-0c4f057d7609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:03:08.662077 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1157/2320] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:03:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:03:08.672824 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17764d9-ac68-43c4-a2fc-41250977a3c9 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:03:08.673116 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17764d9-ac68-43c4-a2fc-41250977a3c9 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:03:08.673392 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17764d9-ac68-43c4-a2fc-41250977a3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:03:08.693600 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-a17764d9-ac68-43c4-a2fc-41250977a3c9 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:03:08.694831 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-a17764d9-ac68-43c4-a2fc-41250977a3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:03:08.705273 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1164/2321] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:03:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:03:08.710547 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea290936-35b4-476f-9d3f-0c4f057d7609 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:03:08.725720 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea290936-35b4-476f-9d3f-0c4f057d7609 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:03:08.732744 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8539dd75-0b08-4136-8c57-c630503602c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:03:08.733403 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539dd75-0b08-4136-8c57-c630503602c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:03:08.733816 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539dd75-0b08-4136-8c57-c630503602c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:03:08.734098 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539dd75-0b08-4136-8c57-c630503602c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:03:08.734856 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8539dd75-0b08-4136-8c57-c630503602c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 05:03:08.735161 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8539dd75-0b08-4136-8c57-c630503602c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:03:08.736796 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8539dd75-0b08-4136-8c57-c630503602c0 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:03:08.749010 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1158/2322] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 05:03:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 05:03:08.753645 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17764d9-ac68-43c4-a2fc-41250977a3c9 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:03:08.763422 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17764d9-ac68-43c4-a2fc-41250977a3c9 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:03:08.769370 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9be3c3-bc50-4f47-9067-6745a65b0915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:03:08.770018 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9be3c3-bc50-4f47-9067-6745a65b0915 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:03:08.770294 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9be3c3-bc50-4f47-9067-6745a65b0915 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:03:08.770563 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9be3c3-bc50-4f47-9067-6745a65b0915 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:03:08.771265 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9be3c3-bc50-4f47-9067-6745a65b0915 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:03:08.773204 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9be3c3-bc50-4f47-9067-6745a65b0915 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:03:08.803167 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1165/2323] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:03:08 2021] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:03:08.807137 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8539dd75-0b08-4136-8c57-c630503602c0 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:03:08.817582 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8539dd75-0b08-4136-8c57-c630503602c0 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:03:08.873994 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b9403-2d33-479a-abc6-706719ebc9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:03:08.874626 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b9403-2d33-479a-abc6-706719ebc9b6 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:03:08.874825 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b9403-2d33-479a-abc6-706719ebc9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:03:08.875102 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b9403-2d33-479a-abc6-706719ebc9b6 admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:03:08.875813 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698b9403-2d33-479a-abc6-706719ebc9b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:03:08.877765 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698b9403-2d33-479a-abc6-706719ebc9b6 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:03:08.898022 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1159/2324] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:03:08 2021] POST /identity/v3/users => generated 283 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:03:08.903032 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9be3c3-bc50-4f47-9067-6745a65b0915 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:03:08.920608 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9be3c3-bc50-4f47-9067-6745a65b0915 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:03:08.929382 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef9838-d326-4c12-afc8-39f8a91d54bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:03:08.930342 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef9838-d326-4c12-afc8-39f8a91d54bd admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:03:08.930727 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef9838-d326-4c12-afc8-39f8a91d54bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:03:08.931011 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef9838-d326-4c12-afc8-39f8a91d54bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:03:08.932011 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef9838-d326-4c12-afc8-39f8a91d54bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:03:08.934797 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef9838-d326-4c12-afc8-39f8a91d54bd admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:03:08.945583 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1166/2325] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:03:08 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:03:08.949861 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b9403-2d33-479a-abc6-706719ebc9b6 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:03:08.960392 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b9403-2d33-479a-abc6-706719ebc9b6 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:03:08.966114 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45584e83-658e-4546-bcaa-7224f72c50a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:03:08.966794 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45584e83-658e-4546-bcaa-7224f72c50a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:03:08.967070 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45584e83-658e-4546-bcaa-7224f72c50a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:03:08.967339 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45584e83-658e-4546-bcaa-7224f72c50a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:03:08.968086 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45584e83-658e-4546-bcaa-7224f72c50a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:03:08.969723 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45584e83-658e-4546-bcaa-7224f72c50a1 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:03:08.979962 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1160/2326] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:03:08 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 24 05:03:08.984793 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef9838-d326-4c12-afc8-39f8a91d54bd admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:03:08.995129 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef9838-d326-4c12-afc8-39f8a91d54bd admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:03:09.000857 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05d52e-74e5-48d0-839e-a4c5dc2533c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:03:09.001734 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05d52e-74e5-48d0-839e-a4c5dc2533c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:03:09.002011 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05d52e-74e5-48d0-839e-a4c5dc2533c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:03:09.002281 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05d52e-74e5-48d0-839e-a4c5dc2533c6 admin admin] PATH_INFO: `/v3/projects/d8349f37b35345c4a0e662431f5ddf08/users/0e3f80aaeccd4b27b03686dd8fc1c854/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:03:09.017419 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f05d52e-74e5-48d0-839e-a4c5dc2533c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8349f37b35345c4a0e662431f5ddf08, user_id=0e3f80aaeccd4b27b03686dd8fc1c854, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:03:09.020208 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f05d52e-74e5-48d0-839e-a4c5dc2533c6 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:03:09.039500 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1167/2327] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:03:08 2021] PUT /identity/v3/projects/d8349f37b35345c4a0e662431f5ddf08/users/0e3f80aaeccd4b27b03686dd8fc1c854/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:03:09.051716 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f92ec-a254-472f-bc89-9d1134c23ac2 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:03:09.052075 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f92ec-a254-472f-bc89-9d1134c23ac2 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:03:09.052416 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f92ec-a254-472f-bc89-9d1134c23ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:03:09.082083 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-450f92ec-a254-472f-bc89-9d1134c23ac2 None None] MFA Rules not processed for user `0e3f80aaeccd4b27b03686dd8fc1c854`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:03:09.083287 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-450f92ec-a254-472f-bc89-9d1134c23ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:03:09.153628 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1161/2328] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:03:09 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:03:09.164149 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05d52e-74e5-48d0-839e-a4c5dc2533c6 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:03:09.166449 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-3f05d52e-74e5-48d0-839e-a4c5dc2533c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:03:09.261337 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05d52e-74e5-48d0-839e-a4c5dc2533c6 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:03:09.266789 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a456a-5259-4239-ace2-acca51790fe3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:03:09.267438 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a456a-5259-4239-ace2-acca51790fe3 service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:03:09.267724 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a456a-5259-4239-ace2-acca51790fe3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:03:09.268000 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a456a-5259-4239-ace2-acca51790fe3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:03:09.277727 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a456a-5259-4239-ace2-acca51790fe3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:03:09.279185 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a456a-5259-4239-ace2-acca51790fe3 service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:03:09.288234 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1168/2329] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:03:09 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:03:53.567264 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f92ec-a254-472f-bc89-9d1134c23ac2 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:03:53.568969 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-450f92ec-a254-472f-bc89-9d1134c23ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:03:53.650682 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f92ec-a254-472f-bc89-9d1134c23ac2 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:03:53.655163 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a4192-859b-49b5-9697-afd4e4ebd83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:03:53.656054 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a4192-859b-49b5-9697-afd4e4ebd83a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:03:53.656338 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a4192-859b-49b5-9697-afd4e4ebd83a admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:03:53.656671 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a4192-859b-49b5-9697-afd4e4ebd83a admin admin] PATH_INFO: `/v3/users/fa2aab5929e746dbbc011b42927b8e37` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:03:53.657903 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a4192-859b-49b5-9697-afd4e4ebd83a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa2aab5929e746dbbc011b42927b8e37)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:03:53.659842 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a4192-859b-49b5-9697-afd4e4ebd83a admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:03:53.708498 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-4b8a4192-859b-49b5-9697-afd4e4ebd83a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa2aab5929e746dbbc011b42927b8e37'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:03:53.709181 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-4b8a4192-859b-49b5-9697-afd4e4ebd83a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa2aab5929e746dbbc011b42927b8e37'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:03:53.717090 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-4b8a4192-859b-49b5-9697-afd4e4ebd83a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa2aab5929e746dbbc011b42927b8e37'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:03:53.725134 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-4b8a4192-859b-49b5-9697-afd4e4ebd83a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa2aab5929e746dbbc011b42927b8e37'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:03:53.725843 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-4b8a4192-859b-49b5-9697-afd4e4ebd83a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa2aab5929e746dbbc011b42927b8e37'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:03:53.743312 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1162/2330] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:03:53 2021] DELETE /identity/v3/users/fa2aab5929e746dbbc011b42927b8e37 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:03:53.937185 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a456a-5259-4239-ace2-acca51790fe3 service cinder] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:03:53.950112 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a456a-5259-4239-ace2-acca51790fe3 service cinder] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:03:54.019762 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e7de5-4e8a-4632-9845-f0d3f6a37c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:03:54.020674 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e7de5-4e8a-4632-9845-f0d3f6a37c4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:03:54.020956 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e7de5-4e8a-4632-9845-f0d3f6a37c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:03:54.021232 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e7de5-4e8a-4632-9845-f0d3f6a37c4c admin admin] PATH_INFO: `/v3/projects/1b651e55b1a349a0b9582c526d3b5d67` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:03:54.022679 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e7de5-4e8a-4632-9845-f0d3f6a37c4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b651e55b1a349a0b9582c526d3b5d67)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:03:54.024631 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e7de5-4e8a-4632-9845-f0d3f6a37c4c admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:03:54.074714 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-727e7de5-4e8a-4632-9845-f0d3f6a37c4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b651e55b1a349a0b9582c526d3b5d67', 'request_id': 'req-727e7de5-4e8a-4632-9845-f0d3f6a37c4c'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:03:54.083962 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-727e7de5-4e8a-4632-9845-f0d3f6a37c4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b651e55b1a349a0b9582c526d3b5d67', 'request_id': 'req-727e7de5-4e8a-4632-9845-f0d3f6a37c4c'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:03:54.090741 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-727e7de5-4e8a-4632-9845-f0d3f6a37c4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b651e55b1a349a0b9582c526d3b5d67', 'request_id': 'req-727e7de5-4e8a-4632-9845-f0d3f6a37c4c'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:03:54.102007 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-727e7de5-4e8a-4632-9845-f0d3f6a37c4c admin admin] The token cache is being invalidate because project 1b651e55b1a349a0b9582c526d3b5d67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:03:54.102355 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-727e7de5-4e8a-4632-9845-f0d3f6a37c4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:03:54.102961 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-727e7de5-4e8a-4632-9845-f0d3f6a37c4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:03:54.109899 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1169/2331] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:03:53 2021] DELETE /identity/v3/projects/1b651e55b1a349a0b9582c526d3b5d67 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:03:54.111479 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf6a78-b8b1-452e-aff7-b357b59215c6 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:03:54.111764 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf6a78-b8b1-452e-aff7-b357b59215c6 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:03:54.112043 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf6a78-b8b1-452e-aff7-b357b59215c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:03:54.131103 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-a9bf6a78-b8b1-452e-aff7-b357b59215c6 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:03:54.132378 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-a9bf6a78-b8b1-452e-aff7-b357b59215c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:03:54.203497 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1163/2332] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:03:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 05:03:54.211762 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83586c6-02f3-4641-8802-4ec709082f4b None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:03:54.212580 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83586c6-02f3-4641-8802-4ec709082f4b None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:03:54.212580 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83586c6-02f3-4641-8802-4ec709082f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:03:54.232923 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-c83586c6-02f3-4641-8802-4ec709082f4b None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:03:54.234130 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-c83586c6-02f3-4641-8802-4ec709082f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:03:54.242579 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1170/2333] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:03:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:03:54.247759 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf6a78-b8b1-452e-aff7-b357b59215c6 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:03:54.257937 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf6a78-b8b1-452e-aff7-b357b59215c6 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:03:54.262762 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6570e3d1-3e52-4676-ac3d-515c3e003d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:03:54.263411 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570e3d1-3e52-4676-ac3d-515c3e003d78 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:03:54.263691 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570e3d1-3e52-4676-ac3d-515c3e003d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:03:54.263959 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570e3d1-3e52-4676-ac3d-515c3e003d78 admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:03:54.264763 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6570e3d1-3e52-4676-ac3d-515c3e003d78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 05:03:54.265065 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6570e3d1-3e52-4676-ac3d-515c3e003d78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:03:54.266665 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6570e3d1-3e52-4676-ac3d-515c3e003d78 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:03:54.278723 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1164/2334] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 05:03:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 05:03:54.283167 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83586c6-02f3-4641-8802-4ec709082f4b None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:03:54.293773 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83586c6-02f3-4641-8802-4ec709082f4b None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:03:54.299250 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335793ce-2ad7-48c6-aea2-7895ee06285e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:03:54.299882 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335793ce-2ad7-48c6-aea2-7895ee06285e admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:03:54.300158 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335793ce-2ad7-48c6-aea2-7895ee06285e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:03:54.300426 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335793ce-2ad7-48c6-aea2-7895ee06285e admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:03:54.301165 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335793ce-2ad7-48c6-aea2-7895ee06285e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:03:54.303874 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335793ce-2ad7-48c6-aea2-7895ee06285e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:03:54.338116 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1171/2335] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:03:54 2021] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 05:03:54.339818 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6570e3d1-3e52-4676-ac3d-515c3e003d78 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:03:54.349982 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6570e3d1-3e52-4676-ac3d-515c3e003d78 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:03:54.406139 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2555e6-6f02-43a6-bbbf-f6172b0753b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:03:54.406814 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2555e6-6f02-43a6-bbbf-f6172b0753b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:03:54.407090 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2555e6-6f02-43a6-bbbf-f6172b0753b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:03:54.407362 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2555e6-6f02-43a6-bbbf-f6172b0753b5 admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:03:54.408069 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2555e6-6f02-43a6-bbbf-f6172b0753b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:03:54.410025 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2555e6-6f02-43a6-bbbf-f6172b0753b5 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:03:54.430600 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1165/2336] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:03:54 2021] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:03:54.435352 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335793ce-2ad7-48c6-aea2-7895ee06285e admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:03:54.446415 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335793ce-2ad7-48c6-aea2-7895ee06285e admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:03:54.451689 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663bf7f7-0aae-476f-a05c-fd0f23081b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:03:54.452348 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663bf7f7-0aae-476f-a05c-fd0f23081b74 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:03:54.452647 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663bf7f7-0aae-476f-a05c-fd0f23081b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:03:54.452902 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663bf7f7-0aae-476f-a05c-fd0f23081b74 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:03:54.453649 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663bf7f7-0aae-476f-a05c-fd0f23081b74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:03:54.455257 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663bf7f7-0aae-476f-a05c-fd0f23081b74 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:03:54.467872 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1172/2337] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:03:54 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:03:54.471509 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2555e6-6f02-43a6-bbbf-f6172b0753b5 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:03:54.482150 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2555e6-6f02-43a6-bbbf-f6172b0753b5 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:03:54.488007 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01695e5a-aa29-4b94-ab9e-315a3a176b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:03:54.488731 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01695e5a-aa29-4b94-ab9e-315a3a176b42 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:03:54.489016 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01695e5a-aa29-4b94-ab9e-315a3a176b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:03:54.489288 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01695e5a-aa29-4b94-ab9e-315a3a176b42 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:03:54.490047 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01695e5a-aa29-4b94-ab9e-315a3a176b42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:03:54.491663 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01695e5a-aa29-4b94-ab9e-315a3a176b42 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:03:54.502935 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1166/2338] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:03:54 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:03:54.507111 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663bf7f7-0aae-476f-a05c-fd0f23081b74 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:03:54.517052 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663bf7f7-0aae-476f-a05c-fd0f23081b74 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:03:54.521935 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d85efc-febd-42fb-8969-2b11c341b42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:03:54.522807 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d85efc-febd-42fb-8969-2b11c341b42e admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:03:54.523119 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d85efc-febd-42fb-8969-2b11c341b42e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:03:54.523405 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d85efc-febd-42fb-8969-2b11c341b42e admin admin] PATH_INFO: `/v3/projects/8ddb1ed7045a4c87a30d01df75e67fe4/users/ebb0a28447404fa0aa1b5c38c6555eea/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:03:54.538241 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d85efc-febd-42fb-8969-2b11c341b42e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ddb1ed7045a4c87a30d01df75e67fe4, user_id=ebb0a28447404fa0aa1b5c38c6555eea, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:03:54.540996 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d85efc-febd-42fb-8969-2b11c341b42e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:03:54.556829 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1173/2339] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:03:54 2021] PUT /identity/v3/projects/8ddb1ed7045a4c87a30d01df75e67fe4/users/ebb0a28447404fa0aa1b5c38c6555eea/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 05:03:54.567255 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc53303-6cd9-401e-b334-d5e5d54846df None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:03:54.567528 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc53303-6cd9-401e-b334-d5e5d54846df None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:03:54.568116 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc53303-6cd9-401e-b334-d5e5d54846df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:03:54.596893 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-abc53303-6cd9-401e-b334-d5e5d54846df None None] MFA Rules not processed for user `ebb0a28447404fa0aa1b5c38c6555eea`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:03:54.598057 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-abc53303-6cd9-401e-b334-d5e5d54846df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:03:54.660162 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1167/2340] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:03:54 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:03:54.664812 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d85efc-febd-42fb-8969-2b11c341b42e admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:03:54.729947 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d85efc-febd-42fb-8969-2b11c341b42e admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:03:54.734976 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba5f02-6701-4747-970d-e29f9ab2f447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:03:54.735628 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba5f02-6701-4747-970d-e29f9ab2f447 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:03:54.735896 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba5f02-6701-4747-970d-e29f9ab2f447 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:03:54.736165 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba5f02-6701-4747-970d-e29f9ab2f447 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:03:54.736895 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ba5f02-6701-4747-970d-e29f9ab2f447 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:03:54.738785 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ba5f02-6701-4747-970d-e29f9ab2f447 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:03:54.768328 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1174/2341] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:03:54 2021] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:03:54.772462 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc53303-6cd9-401e-b334-d5e5d54846df None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:03:54.785800 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc53303-6cd9-401e-b334-d5e5d54846df None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:03:54.852801 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f0fc3-8860-4b0b-8c97-49fb22fc0199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:03:54.853706 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f0fc3-8860-4b0b-8c97-49fb22fc0199 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:03:54.854234 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f0fc3-8860-4b0b-8c97-49fb22fc0199 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:03:54.854775 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f0fc3-8860-4b0b-8c97-49fb22fc0199 admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:03:54.855901 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f0fc3-8860-4b0b-8c97-49fb22fc0199 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:03:54.857751 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f0fc3-8860-4b0b-8c97-49fb22fc0199 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:03:54.882187 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1168/2342] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:03:54 2021] POST /identity/v3/users => generated 295 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 05:03:54.886697 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba5f02-6701-4747-970d-e29f9ab2f447 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:03:54.903940 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba5f02-6701-4747-970d-e29f9ab2f447 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:03:54.907662 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa4fba-0d82-478b-9718-048570e0e5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:03:54.908384 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa4fba-0d82-478b-9718-048570e0e5cb admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:03:54.908708 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa4fba-0d82-478b-9718-048570e0e5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:03:54.908989 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa4fba-0d82-478b-9718-048570e0e5cb admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:03:54.909773 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fa4fba-0d82-478b-9718-048570e0e5cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:03:54.911341 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fa4fba-0d82-478b-9718-048570e0e5cb admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:03:54.922190 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1175/2343] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:03:54 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:03:54.926290 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f0fc3-8860-4b0b-8c97-49fb22fc0199 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:03:54.936172 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f0fc3-8860-4b0b-8c97-49fb22fc0199 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:03:54.941055 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355cee09-17c5-440d-b17f-b8ba78e224e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:03:54.942033 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355cee09-17c5-440d-b17f-b8ba78e224e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:03:54.942389 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355cee09-17c5-440d-b17f-b8ba78e224e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:03:54.942765 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355cee09-17c5-440d-b17f-b8ba78e224e5 admin admin] PATH_INFO: `/v3/projects/059ea550185c4d8496de18d643d02f50/users/640027e5867e47078f48dd51636effc9/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:03:54.958535 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355cee09-17c5-440d-b17f-b8ba78e224e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=059ea550185c4d8496de18d643d02f50, user_id=640027e5867e47078f48dd51636effc9, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:03:54.961563 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355cee09-17c5-440d-b17f-b8ba78e224e5 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:03:54.975077 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1169/2344] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:03:54 2021] PUT /identity/v3/projects/059ea550185c4d8496de18d643d02f50/users/640027e5867e47078f48dd51636effc9/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:03:54.979222 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa4fba-0d82-478b-9718-048570e0e5cb admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:03:54.989293 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa4fba-0d82-478b-9718-048570e0e5cb admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:03:55.048337 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e869d9-fdbf-4a10-9229-3e3d25620665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:03:55.049039 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e869d9-fdbf-4a10-9229-3e3d25620665 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:03:55.049316 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e869d9-fdbf-4a10-9229-3e3d25620665 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:03:55.049588 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e869d9-fdbf-4a10-9229-3e3d25620665 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:03:55.050326 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e869d9-fdbf-4a10-9229-3e3d25620665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:03:55.051900 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e869d9-fdbf-4a10-9229-3e3d25620665 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:03:55.061845 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1176/2345] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:03:54 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 24 05:03:55.065760 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355cee09-17c5-440d-b17f-b8ba78e224e5 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:03:55.075932 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355cee09-17c5-440d-b17f-b8ba78e224e5 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:03:55.080779 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c790fae-5a15-44a4-ae87-4f1f25367c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:03:55.081654 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c790fae-5a15-44a4-ae87-4f1f25367c7b admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:03:55.081931 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c790fae-5a15-44a4-ae87-4f1f25367c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:03:55.082200 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c790fae-5a15-44a4-ae87-4f1f25367c7b admin admin] PATH_INFO: `/v3/projects/059ea550185c4d8496de18d643d02f50/users/640027e5867e47078f48dd51636effc9/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:03:55.084153 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c790fae-5a15-44a4-ae87-4f1f25367c7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=059ea550185c4d8496de18d643d02f50, user_id=640027e5867e47078f48dd51636effc9, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:03:55.087121 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c790fae-5a15-44a4-ae87-4f1f25367c7b admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:03:55.097287 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1170/2346] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:03:55 2021] PUT /identity/v3/projects/059ea550185c4d8496de18d643d02f50/users/640027e5867e47078f48dd51636effc9/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:03:55.108575 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea100a7b-7982-4729-9487-d388b44299a7 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:03:55.108736 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea100a7b-7982-4729-9487-d388b44299a7 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:03:55.109040 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea100a7b-7982-4729-9487-d388b44299a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:03:55.136899 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-ea100a7b-7982-4729-9487-d388b44299a7 None None] MFA Rules not processed for user `640027e5867e47078f48dd51636effc9`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:03:55.138097 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-ea100a7b-7982-4729-9487-d388b44299a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:03:55.206304 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1177/2347] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:03:55 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:03:55.221929 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c790fae-5a15-44a4-ae87-4f1f25367c7b admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:03:55.223711 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-8c790fae-5a15-44a4-ae87-4f1f25367c7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:03:55.289372 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c790fae-5a15-44a4-ae87-4f1f25367c7b admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:03:55.293724 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44cb18a-b2b5-4748-ac70-6ca23a3abc12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:03:55.294378 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44cb18a-b2b5-4748-ac70-6ca23a3abc12 service cinder] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:03:55.294654 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44cb18a-b2b5-4748-ac70-6ca23a3abc12 service cinder] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:03:55.294922 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44cb18a-b2b5-4748-ac70-6ca23a3abc12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:03:55.358741 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44cb18a-b2b5-4748-ac70-6ca23a3abc12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:03:55.360050 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44cb18a-b2b5-4748-ac70-6ca23a3abc12 service cinder] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:03:55.370810 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1171/2348] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:03:55 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:04:03.929670 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea100a7b-7982-4729-9487-d388b44299a7 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:03.931248 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-ea100a7b-7982-4729-9487-d388b44299a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:03.999380 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea100a7b-7982-4729-9487-d388b44299a7 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:04.004368 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f7e1e-6949-4e73-8e87-c90f757ee52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:04.005264 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f7e1e-6949-4e73-8e87-c90f757ee52e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:04.005575 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f7e1e-6949-4e73-8e87-c90f757ee52e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:04.005848 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f7e1e-6949-4e73-8e87-c90f757ee52e admin admin] PATH_INFO: `/v3/users/f29f576d3a98449b8077c0df53968f07` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:04.007075 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702f7e1e-6949-4e73-8e87-c90f757ee52e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f29f576d3a98449b8077c0df53968f07)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:04.009049 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702f7e1e-6949-4e73-8e87-c90f757ee52e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:04.059600 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-702f7e1e-6949-4e73-8e87-c90f757ee52e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f29f576d3a98449b8077c0df53968f07'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:04.060246 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-702f7e1e-6949-4e73-8e87-c90f757ee52e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f29f576d3a98449b8077c0df53968f07'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:04.070778 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-702f7e1e-6949-4e73-8e87-c90f757ee52e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f29f576d3a98449b8077c0df53968f07'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:04.078802 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-702f7e1e-6949-4e73-8e87-c90f757ee52e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f29f576d3a98449b8077c0df53968f07'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:04.092196 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-702f7e1e-6949-4e73-8e87-c90f757ee52e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f29f576d3a98449b8077c0df53968f07'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:04.098401 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1178/2349] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:04:03 2021] DELETE /identity/v3/users/f29f576d3a98449b8077c0df53968f07 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:04:04.147323 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44cb18a-b2b5-4748-ac70-6ca23a3abc12 service cinder] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:04.156752 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44cb18a-b2b5-4748-ac70-6ca23a3abc12 service cinder] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:04.215335 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988aaf94-aca4-4e0d-b0eb-31cde3226081 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:04.215990 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988aaf94-aca4-4e0d-b0eb-31cde3226081 service cinder] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:04.216267 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988aaf94-aca4-4e0d-b0eb-31cde3226081 service cinder] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:04.216554 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988aaf94-aca4-4e0d-b0eb-31cde3226081 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:04.218519 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-988aaf94-aca4-4e0d-b0eb-31cde3226081 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:04.273609 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f7e1e-6949-4e73-8e87-c90f757ee52e admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:04.275913 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-702f7e1e-6949-4e73-8e87-c90f757ee52e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:04.290870 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988aaf94-aca4-4e0d-b0eb-31cde3226081 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:04.292484 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988aaf94-aca4-4e0d-b0eb-31cde3226081 service cinder] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:04.309429 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1172/2350] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:04:04 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:04:04.354907 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f7e1e-6949-4e73-8e87-c90f757ee52e admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:04.360068 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ebb44-8d7c-49fb-8470-2dfa8033a783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:04.361203 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ebb44-8d7c-49fb-8470-2dfa8033a783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:04.361641 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ebb44-8d7c-49fb-8470-2dfa8033a783 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:04.362088 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ebb44-8d7c-49fb-8470-2dfa8033a783 admin admin] PATH_INFO: `/v3/projects/8f1c3a94f02049e3a76c4fc01fa7a022` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:04.363491 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951ebb44-8d7c-49fb-8470-2dfa8033a783 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f1c3a94f02049e3a76c4fc01fa7a022)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:04.366048 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951ebb44-8d7c-49fb-8470-2dfa8033a783 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:04.419505 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-951ebb44-8d7c-49fb-8470-2dfa8033a783 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f1c3a94f02049e3a76c4fc01fa7a022', 'request_id': 'req-951ebb44-8d7c-49fb-8470-2dfa8033a783'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:04.429211 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-951ebb44-8d7c-49fb-8470-2dfa8033a783 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f1c3a94f02049e3a76c4fc01fa7a022', 'request_id': 'req-951ebb44-8d7c-49fb-8470-2dfa8033a783'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:04.437482 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-951ebb44-8d7c-49fb-8470-2dfa8033a783 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f1c3a94f02049e3a76c4fc01fa7a022', 'request_id': 'req-951ebb44-8d7c-49fb-8470-2dfa8033a783'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:04.450052 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-951ebb44-8d7c-49fb-8470-2dfa8033a783 admin admin] The token cache is being invalidate because project 8f1c3a94f02049e3a76c4fc01fa7a022 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:04:04.450352 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-951ebb44-8d7c-49fb-8470-2dfa8033a783 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:04.451010 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-951ebb44-8d7c-49fb-8470-2dfa8033a783 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:04.453493 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1179/2351] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:04:04 2021] DELETE /identity/v3/projects/8f1c3a94f02049e3a76c4fc01fa7a022 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:04:04.459701 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3bf4fd-3dec-4bfd-b2bc-026603adc295 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:04.460321 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3bf4fd-3dec-4bfd-b2bc-026603adc295 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:04.460569 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3bf4fd-3dec-4bfd-b2bc-026603adc295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:04.479697 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-2a3bf4fd-3dec-4bfd-b2bc-026603adc295 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:04:04.480930 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-2a3bf4fd-3dec-4bfd-b2bc-026603adc295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:04.542346 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1173/2352] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:04:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:04:04.550147 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af35ac5-ffbd-4148-9e0a-e7d0f5d66157 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:04.550437 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af35ac5-ffbd-4148-9e0a-e7d0f5d66157 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:04.550722 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af35ac5-ffbd-4148-9e0a-e7d0f5d66157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:04.570476 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-6af35ac5-ffbd-4148-9e0a-e7d0f5d66157 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:04:04.571504 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-6af35ac5-ffbd-4148-9e0a-e7d0f5d66157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:04.582609 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1180/2353] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:04:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 05:04:04.587214 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3bf4fd-3dec-4bfd-b2bc-026603adc295 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:04.597854 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3bf4fd-3dec-4bfd-b2bc-026603adc295 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:04.602634 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25965de2-6501-442d-9345-dbff89fc2d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:04.603660 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25965de2-6501-442d-9345-dbff89fc2d1d admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:04.604151 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25965de2-6501-442d-9345-dbff89fc2d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:04.604469 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25965de2-6501-442d-9345-dbff89fc2d1d admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:04.605260 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25965de2-6501-442d-9345-dbff89fc2d1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 05:04:04.605565 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25965de2-6501-442d-9345-dbff89fc2d1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:04.607212 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25965de2-6501-442d-9345-dbff89fc2d1d admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:04.620478 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1174/2354] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 05:04:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 05:04:04.625750 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af35ac5-ffbd-4148-9e0a-e7d0f5d66157 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:04.635592 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af35ac5-ffbd-4148-9e0a-e7d0f5d66157 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:04.640814 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8761fecd-fa23-4dd9-8836-34b643cef2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:04.641483 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761fecd-fa23-4dd9-8836-34b643cef2f1 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:04.641776 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761fecd-fa23-4dd9-8836-34b643cef2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:04.642036 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761fecd-fa23-4dd9-8836-34b643cef2f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:04.642766 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8761fecd-fa23-4dd9-8836-34b643cef2f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:04.645152 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8761fecd-fa23-4dd9-8836-34b643cef2f1 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:04.671751 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1181/2355] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:04:04 2021] POST /identity/v3/projects => generated 405 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:04:04.675846 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25965de2-6501-442d-9345-dbff89fc2d1d admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:04.687091 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25965de2-6501-442d-9345-dbff89fc2d1d admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:04.752697 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221365d-8e90-4244-b1f6-5f4022253c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:04.753370 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221365d-8e90-4244-b1f6-5f4022253c20 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:04.753654 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221365d-8e90-4244-b1f6-5f4022253c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:04.753928 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221365d-8e90-4244-b1f6-5f4022253c20 admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:04.754639 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9221365d-8e90-4244-b1f6-5f4022253c20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:04.756593 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9221365d-8e90-4244-b1f6-5f4022253c20 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:04.779950 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1175/2356] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:04:04 2021] POST /identity/v3/users => generated 303 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:04:04.784889 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8761fecd-fa23-4dd9-8836-34b643cef2f1 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:04.801380 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8761fecd-fa23-4dd9-8836-34b643cef2f1 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:04.809038 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fda6b9-7229-4643-a0a6-3562b83ea73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:04.809692 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fda6b9-7229-4643-a0a6-3562b83ea73d admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:04.809969 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fda6b9-7229-4643-a0a6-3562b83ea73d admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:04.810240 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fda6b9-7229-4643-a0a6-3562b83ea73d admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:04.810982 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fda6b9-7229-4643-a0a6-3562b83ea73d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:04.812605 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fda6b9-7229-4643-a0a6-3562b83ea73d admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:04.823548 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1182/2357] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:04:04 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:04:04.827661 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221365d-8e90-4244-b1f6-5f4022253c20 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:04.838470 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221365d-8e90-4244-b1f6-5f4022253c20 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:04.843525 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607eb4a2-8dab-4c5e-a750-b4d8fa138a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:04.844187 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607eb4a2-8dab-4c5e-a750-b4d8fa138a1c admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:04.844466 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607eb4a2-8dab-4c5e-a750-b4d8fa138a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:04.844769 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607eb4a2-8dab-4c5e-a750-b4d8fa138a1c admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:04.845554 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607eb4a2-8dab-4c5e-a750-b4d8fa138a1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:04.847164 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607eb4a2-8dab-4c5e-a750-b4d8fa138a1c admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:04.857633 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1176/2358] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:04:04 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:04:04.862313 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fda6b9-7229-4643-a0a6-3562b83ea73d admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:04.875924 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fda6b9-7229-4643-a0a6-3562b83ea73d admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:04.881177 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c6bc1a-3587-47c5-b5fc-ebc012cecb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:04.882059 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c6bc1a-3587-47c5-b5fc-ebc012cecb7d admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:04.882340 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c6bc1a-3587-47c5-b5fc-ebc012cecb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:04.882616 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c6bc1a-3587-47c5-b5fc-ebc012cecb7d admin admin] PATH_INFO: `/v3/projects/37f575a6561f4239a86d28a9f2f61ec9/users/918f40d029264b46a5976873a67e6807/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:04.899252 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c6bc1a-3587-47c5-b5fc-ebc012cecb7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=37f575a6561f4239a86d28a9f2f61ec9, user_id=918f40d029264b46a5976873a67e6807, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:04.902089 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c6bc1a-3587-47c5-b5fc-ebc012cecb7d admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:04.921101 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1183/2359] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:04:04 2021] PUT /identity/v3/projects/37f575a6561f4239a86d28a9f2f61ec9/users/918f40d029264b46a5976873a67e6807/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:04:04.931756 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651e2eb-e03d-4bca-a097-47cee9acb9bb None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:04.932050 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651e2eb-e03d-4bca-a097-47cee9acb9bb None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:04.932409 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651e2eb-e03d-4bca-a097-47cee9acb9bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:04.961245 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-6651e2eb-e03d-4bca-a097-47cee9acb9bb None None] MFA Rules not processed for user `918f40d029264b46a5976873a67e6807`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:04:04.962455 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-6651e2eb-e03d-4bca-a097-47cee9acb9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:05.028701 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1177/2360] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:04:04 2021] POST /identity/v3/auth/tokens => generated 3272 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:04:05.033635 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c6bc1a-3587-47c5-b5fc-ebc012cecb7d admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:05.098742 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c6bc1a-3587-47c5-b5fc-ebc012cecb7d admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:05.104578 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461db49-d9e3-40d4-86bb-2185c09c181e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:05.105240 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461db49-d9e3-40d4-86bb-2185c09c181e admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:05.105512 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461db49-d9e3-40d4-86bb-2185c09c181e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:05.105780 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461db49-d9e3-40d4-86bb-2185c09c181e admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:05.106474 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9461db49-d9e3-40d4-86bb-2185c09c181e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:05.108356 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9461db49-d9e3-40d4-86bb-2185c09c181e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:05.136668 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1184/2361] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:04:05 2021] POST /identity/v3/projects => generated 405 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:04:05.140684 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6651e2eb-e03d-4bca-a097-47cee9acb9bb None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:05.151727 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6651e2eb-e03d-4bca-a097-47cee9acb9bb None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:05.217233 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a66a14-c494-4800-a89e-7bcd392c74ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:05.218132 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a66a14-c494-4800-a89e-7bcd392c74ca admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:05.218565 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a66a14-c494-4800-a89e-7bcd392c74ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:05.218867 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a66a14-c494-4800-a89e-7bcd392c74ca admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:05.219869 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a66a14-c494-4800-a89e-7bcd392c74ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:05.222647 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a66a14-c494-4800-a89e-7bcd392c74ca admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:05.245694 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1178/2362] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:04:05 2021] POST /identity/v3/users => generated 309 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 05:04:05.249662 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461db49-d9e3-40d4-86bb-2185c09c181e admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:05.260589 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461db49-d9e3-40d4-86bb-2185c09c181e admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:05.266493 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8897e8-20b8-40b6-b34d-c5d18e256148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:05.267182 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8897e8-20b8-40b6-b34d-c5d18e256148 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:05.267463 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8897e8-20b8-40b6-b34d-c5d18e256148 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:05.267730 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8897e8-20b8-40b6-b34d-c5d18e256148 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:05.268480 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8897e8-20b8-40b6-b34d-c5d18e256148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:05.270117 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8897e8-20b8-40b6-b34d-c5d18e256148 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:05.281097 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1185/2363] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:04:05 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:04:05.285300 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a66a14-c494-4800-a89e-7bcd392c74ca admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:05.295837 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a66a14-c494-4800-a89e-7bcd392c74ca admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:05.302091 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b63a79-a4ef-428c-86ab-dd4e5b93ecbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:05.302971 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b63a79-a4ef-428c-86ab-dd4e5b93ecbb admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:05.303247 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b63a79-a4ef-428c-86ab-dd4e5b93ecbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:05.303513 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b63a79-a4ef-428c-86ab-dd4e5b93ecbb admin admin] PATH_INFO: `/v3/projects/41aa54bab8fb4578acf2f550915fb334/users/2b18812c34304b57a559867ca4b4a7ed/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:05.320260 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b63a79-a4ef-428c-86ab-dd4e5b93ecbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=41aa54bab8fb4578acf2f550915fb334, user_id=2b18812c34304b57a559867ca4b4a7ed, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:05.323425 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b63a79-a4ef-428c-86ab-dd4e5b93ecbb admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:05.338404 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1179/2364] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:04:05 2021] PUT /identity/v3/projects/41aa54bab8fb4578acf2f550915fb334/users/2b18812c34304b57a559867ca4b4a7ed/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:04:05.342414 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8897e8-20b8-40b6-b34d-c5d18e256148 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:05.352920 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8897e8-20b8-40b6-b34d-c5d18e256148 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:05.413418 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b1b69-1bb5-4007-9432-4b13c4bbdd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:05.414388 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b1b69-1bb5-4007-9432-4b13c4bbdd53 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:05.414751 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b1b69-1bb5-4007-9432-4b13c4bbdd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:05.415449 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b1b69-1bb5-4007-9432-4b13c4bbdd53 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:05.417173 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0b1b69-1bb5-4007-9432-4b13c4bbdd53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:05.419293 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0b1b69-1bb5-4007-9432-4b13c4bbdd53 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:05.430004 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1186/2365] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:04:05 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:04:05.435362 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b63a79-a4ef-428c-86ab-dd4e5b93ecbb admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:05.446609 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b63a79-a4ef-428c-86ab-dd4e5b93ecbb admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:05.452398 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e66bc-bc2a-40ae-bfda-29145d8da150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:05.453323 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e66bc-bc2a-40ae-bfda-29145d8da150 admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:05.453601 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e66bc-bc2a-40ae-bfda-29145d8da150 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:05.453884 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e66bc-bc2a-40ae-bfda-29145d8da150 admin admin] PATH_INFO: `/v3/projects/41aa54bab8fb4578acf2f550915fb334/users/2b18812c34304b57a559867ca4b4a7ed/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:05.456067 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52e66bc-bc2a-40ae-bfda-29145d8da150 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41aa54bab8fb4578acf2f550915fb334, user_id=2b18812c34304b57a559867ca4b4a7ed, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:05.458766 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52e66bc-bc2a-40ae-bfda-29145d8da150 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:05.470952 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1180/2366] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:04:05 2021] PUT /identity/v3/projects/41aa54bab8fb4578acf2f550915fb334/users/2b18812c34304b57a559867ca4b4a7ed/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:04:05.482670 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c3d95-2590-4f94-9e94-e9fe80bb7d68 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:05.483097 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c3d95-2590-4f94-9e94-e9fe80bb7d68 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:05.483809 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c3d95-2590-4f94-9e94-e9fe80bb7d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:05.512167 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-d58c3d95-2590-4f94-9e94-e9fe80bb7d68 None None] MFA Rules not processed for user `2b18812c34304b57a559867ca4b4a7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:04:05.513466 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-d58c3d95-2590-4f94-9e94-e9fe80bb7d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:05.596476 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1187/2367] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:04:05 2021] POST /identity/v3/auth/tokens => generated 3339 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:04:05.607549 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e66bc-bc2a-40ae-bfda-29145d8da150 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:05.609515 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-e52e66bc-bc2a-40ae-bfda-29145d8da150 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:05.669275 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e66bc-bc2a-40ae-bfda-29145d8da150 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:05.673151 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e58bdc6-6980-4f8e-a37a-097096640336 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:05.673799 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58bdc6-6980-4f8e-a37a-097096640336 service cinder] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:05.674113 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58bdc6-6980-4f8e-a37a-097096640336 service cinder] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:05.674391 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58bdc6-6980-4f8e-a37a-097096640336 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:05.684611 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e58bdc6-6980-4f8e-a37a-097096640336 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:05.686101 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e58bdc6-6980-4f8e-a37a-097096640336 service cinder] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:05.695486 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1181/2368] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:04:05 2021] GET /identity/v3/auth/tokens => generated 3339 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:04:07.709345 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c3d95-2590-4f94-9e94-e9fe80bb7d68 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:07.772463 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c3d95-2590-4f94-9e94-e9fe80bb7d68 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:07.778123 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f83d70-85ed-4130-ac57-351b4aaefc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:07.778991 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f83d70-85ed-4130-ac57-351b4aaefc08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:07.779271 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f83d70-85ed-4130-ac57-351b4aaefc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:07.779542 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f83d70-85ed-4130-ac57-351b4aaefc08 admin admin] PATH_INFO: `/v3/users/918f40d029264b46a5976873a67e6807` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:07.780828 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f83d70-85ed-4130-ac57-351b4aaefc08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=918f40d029264b46a5976873a67e6807)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:07.782728 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f83d70-85ed-4130-ac57-351b4aaefc08 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:07.835968 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-e3f83d70-85ed-4130-ac57-351b4aaefc08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '918f40d029264b46a5976873a67e6807'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:07.837055 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-e3f83d70-85ed-4130-ac57-351b4aaefc08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '918f40d029264b46a5976873a67e6807'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:07.845727 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-e3f83d70-85ed-4130-ac57-351b4aaefc08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '918f40d029264b46a5976873a67e6807'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:07.853032 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-e3f83d70-85ed-4130-ac57-351b4aaefc08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '918f40d029264b46a5976873a67e6807'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:07.865613 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-e3f83d70-85ed-4130-ac57-351b4aaefc08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '918f40d029264b46a5976873a67e6807'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:07.871822 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1188/2369] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:04:07 2021] DELETE /identity/v3/users/918f40d029264b46a5976873a67e6807 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:04:07.876458 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5fd20-a0cc-40d7-97cd-2aa780d7d1c2 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:07.877041 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5fd20-a0cc-40d7-97cd-2aa780d7d1c2 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:07.877041 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5fd20-a0cc-40d7-97cd-2aa780d7d1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:07.905004 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-b3a5fd20-a0cc-40d7-97cd-2aa780d7d1c2 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:04:07.906198 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-b3a5fd20-a0cc-40d7-97cd-2aa780d7d1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:07.965529 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1182/2370] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:04:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:04:07.975928 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f83d70-85ed-4130-ac57-351b4aaefc08 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:07.978168 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-e3f83d70-85ed-4130-ac57-351b4aaefc08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:08.036990 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f83d70-85ed-4130-ac57-351b4aaefc08 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:08.040901 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7353b1e-6108-409b-949a-15577f6884e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:08.041566 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7353b1e-6108-409b-949a-15577f6884e9 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:08.041848 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7353b1e-6108-409b-949a-15577f6884e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:08.042128 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7353b1e-6108-409b-949a-15577f6884e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:08.051274 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7353b1e-6108-409b-949a-15577f6884e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:08.052737 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7353b1e-6108-409b-949a-15577f6884e9 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:08.062267 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1189/2371] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:04:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:04:08.359739 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a5fd20-a0cc-40d7-97cd-2aa780d7d1c2 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:08.361269 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-b3a5fd20-a0cc-40d7-97cd-2aa780d7d1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:08.373647 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a5fd20-a0cc-40d7-97cd-2aa780d7d1c2 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:08.379175 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f2c95-dea6-4b80-9f7e-2a395ad1e9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:08.380069 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f2c95-dea6-4b80-9f7e-2a395ad1e9ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:08.380347 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f2c95-dea6-4b80-9f7e-2a395ad1e9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:08.380650 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f2c95-dea6-4b80-9f7e-2a395ad1e9ce admin admin] PATH_INFO: `/v3/projects/37f575a6561f4239a86d28a9f2f61ec9` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:08.381897 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3f2c95-dea6-4b80-9f7e-2a395ad1e9ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=37f575a6561f4239a86d28a9f2f61ec9)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:08.383804 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3f2c95-dea6-4b80-9f7e-2a395ad1e9ce admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:08.432500 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-fe3f2c95-dea6-4b80-9f7e-2a395ad1e9ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37f575a6561f4239a86d28a9f2f61ec9', 'request_id': 'req-fe3f2c95-dea6-4b80-9f7e-2a395ad1e9ce'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:08.440766 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-fe3f2c95-dea6-4b80-9f7e-2a395ad1e9ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37f575a6561f4239a86d28a9f2f61ec9', 'request_id': 'req-fe3f2c95-dea6-4b80-9f7e-2a395ad1e9ce'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:08.447251 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-fe3f2c95-dea6-4b80-9f7e-2a395ad1e9ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37f575a6561f4239a86d28a9f2f61ec9', 'request_id': 'req-fe3f2c95-dea6-4b80-9f7e-2a395ad1e9ce'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:08.459061 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-fe3f2c95-dea6-4b80-9f7e-2a395ad1e9ce admin admin] The token cache is being invalidate because project 37f575a6561f4239a86d28a9f2f61ec9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:04:08.459354 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-fe3f2c95-dea6-4b80-9f7e-2a395ad1e9ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:08.460413 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-fe3f2c95-dea6-4b80-9f7e-2a395ad1e9ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:08.462080 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1183/2372] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:04:08 2021] DELETE /identity/v3/projects/37f575a6561f4239a86d28a9f2f61ec9 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:04:08.466688 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7353b1e-6108-409b-949a-15577f6884e9 service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:08.477223 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7353b1e-6108-409b-949a-15577f6884e9 service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:08.536436 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694b14c-104f-49e0-a7e6-1f22deff400f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:08.537386 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694b14c-104f-49e0-a7e6-1f22deff400f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:08.537678 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694b14c-104f-49e0-a7e6-1f22deff400f admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:08.538006 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694b14c-104f-49e0-a7e6-1f22deff400f admin admin] PATH_INFO: `/v3/users/2b18812c34304b57a559867ca4b4a7ed` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:08.539227 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c694b14c-104f-49e0-a7e6-1f22deff400f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b18812c34304b57a559867ca4b4a7ed)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:08.541225 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c694b14c-104f-49e0-a7e6-1f22deff400f admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:08.588079 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-c694b14c-104f-49e0-a7e6-1f22deff400f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b18812c34304b57a559867ca4b4a7ed'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:08.588779 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-c694b14c-104f-49e0-a7e6-1f22deff400f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b18812c34304b57a559867ca4b4a7ed'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:08.596946 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-c694b14c-104f-49e0-a7e6-1f22deff400f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b18812c34304b57a559867ca4b4a7ed'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:08.604327 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-c694b14c-104f-49e0-a7e6-1f22deff400f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b18812c34304b57a559867ca4b4a7ed'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:08.616992 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-c694b14c-104f-49e0-a7e6-1f22deff400f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b18812c34304b57a559867ca4b4a7ed'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:08.623599 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1190/2373] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:04:08 2021] DELETE /identity/v3/users/2b18812c34304b57a559867ca4b4a7ed => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:04:08.889451 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f2c95-dea6-4b80-9f7e-2a395ad1e9ce admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:08.891054 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-fe3f2c95-dea6-4b80-9f7e-2a395ad1e9ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:08.905227 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f2c95-dea6-4b80-9f7e-2a395ad1e9ce admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:08.967026 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9a23d-2b5c-4774-b827-9971026cbfe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:08.967887 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9a23d-2b5c-4774-b827-9971026cbfe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:08.968161 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9a23d-2b5c-4774-b827-9971026cbfe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:08.968432 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9a23d-2b5c-4774-b827-9971026cbfe3 admin admin] PATH_INFO: `/v3/projects/41aa54bab8fb4578acf2f550915fb334` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:08.969689 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f9a23d-2b5c-4774-b827-9971026cbfe3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41aa54bab8fb4578acf2f550915fb334)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:08.971667 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f9a23d-2b5c-4774-b827-9971026cbfe3 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:09.015685 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-76f9a23d-2b5c-4774-b827-9971026cbfe3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41aa54bab8fb4578acf2f550915fb334', 'request_id': 'req-76f9a23d-2b5c-4774-b827-9971026cbfe3'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:09.023220 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-76f9a23d-2b5c-4774-b827-9971026cbfe3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41aa54bab8fb4578acf2f550915fb334', 'request_id': 'req-76f9a23d-2b5c-4774-b827-9971026cbfe3'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:09.029001 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-76f9a23d-2b5c-4774-b827-9971026cbfe3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41aa54bab8fb4578acf2f550915fb334', 'request_id': 'req-76f9a23d-2b5c-4774-b827-9971026cbfe3'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:09.040427 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-76f9a23d-2b5c-4774-b827-9971026cbfe3 admin admin] The token cache is being invalidate because project 41aa54bab8fb4578acf2f550915fb334 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:04:09.040796 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-76f9a23d-2b5c-4774-b827-9971026cbfe3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:09.041446 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-76f9a23d-2b5c-4774-b827-9971026cbfe3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:09.043071 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1184/2374] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:04:08 2021] DELETE /identity/v3/projects/41aa54bab8fb4578acf2f550915fb334 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 05:04:09.049170 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143fbea-e099-4759-8f00-d5df1840ed21 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:09.049679 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143fbea-e099-4759-8f00-d5df1840ed21 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:09.049772 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143fbea-e099-4759-8f00-d5df1840ed21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:09.069345 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9a23d-2b5c-4774-b827-9971026cbfe3 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:09.070873 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-76f9a23d-2b5c-4774-b827-9971026cbfe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:09.072210 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-6143fbea-e099-4759-8f00-d5df1840ed21 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:04:09.073430 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-6143fbea-e099-4759-8f00-d5df1840ed21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:09.129223 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9a23d-2b5c-4774-b827-9971026cbfe3 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:09.130992 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1191/2375] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:04:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:04:09.132891 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5e18e5-2f9a-4a8a-b99a-20311d643ee3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:09.133559 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e18e5-2f9a-4a8a-b99a-20311d643ee3 service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:09.133838 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e18e5-2f9a-4a8a-b99a-20311d643ee3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:09.134113 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e18e5-2f9a-4a8a-b99a-20311d643ee3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:09.136082 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-5f5e18e5-2f9a-4a8a-b99a-20311d643ee3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:09.139020 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b39ace-b8fd-4dfa-9872-529a0ce55f20 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:09.139308 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b39ace-b8fd-4dfa-9872-529a0ce55f20 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:09.139581 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b39ace-b8fd-4dfa-9872-529a0ce55f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:09.157438 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-20b39ace-b8fd-4dfa-9872-529a0ce55f20 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:04:09.158734 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-20b39ace-b8fd-4dfa-9872-529a0ce55f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:09.167207 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1192/2376] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:04:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 05:04:09.171345 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b39ace-b8fd-4dfa-9872-529a0ce55f20 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:09.180431 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b39ace-b8fd-4dfa-9872-529a0ce55f20 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:09.185855 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff0ab56-275c-41b9-8a0b-0fd8a1070373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:09.186440 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0ab56-275c-41b9-8a0b-0fd8a1070373 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:09.186718 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0ab56-275c-41b9-8a0b-0fd8a1070373 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:09.186993 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0ab56-275c-41b9-8a0b-0fd8a1070373 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:09.187784 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff0ab56-275c-41b9-8a0b-0fd8a1070373 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 05:04:09.188023 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff0ab56-275c-41b9-8a0b-0fd8a1070373 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:09.189648 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff0ab56-275c-41b9-8a0b-0fd8a1070373 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:09.201453 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1193/2377] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 05:04:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 05:04:09.205706 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff0ab56-275c-41b9-8a0b-0fd8a1070373 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:09.215618 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff0ab56-275c-41b9-8a0b-0fd8a1070373 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:09.218452 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5e18e5-2f9a-4a8a-b99a-20311d643ee3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:09.219922 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5e18e5-2f9a-4a8a-b99a-20311d643ee3 service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:09.220334 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db9069a-01f9-479d-83e5-c515a8fbc77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:09.220997 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9069a-01f9-479d-83e5-c515a8fbc77e admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:09.221274 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9069a-01f9-479d-83e5-c515a8fbc77e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:09.221544 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9069a-01f9-479d-83e5-c515a8fbc77e admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:09.222281 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db9069a-01f9-479d-83e5-c515a8fbc77e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:09.224222 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db9069a-01f9-479d-83e5-c515a8fbc77e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:09.239872 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1185/2378] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:04:09 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:04:09.254178 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1194/2379] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:04:09 2021] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:04:09.255606 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5e18e5-2f9a-4a8a-b99a-20311d643ee3 service neutron] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:09.266274 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5e18e5-2f9a-4a8a-b99a-20311d643ee3 service neutron] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:09.323316 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296edc3-4f98-4628-b762-450e22f32318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:09.324182 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296edc3-4f98-4628-b762-450e22f32318 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:09.324462 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296edc3-4f98-4628-b762-450e22f32318 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:09.324775 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296edc3-4f98-4628-b762-450e22f32318 admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:09.325501 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c296edc3-4f98-4628-b762-450e22f32318 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:09.327429 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c296edc3-4f98-4628-b762-450e22f32318 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:09.349281 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1186/2380] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:04:09 2021] POST /identity/v3/users => generated 283 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:04:09.353553 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db9069a-01f9-479d-83e5-c515a8fbc77e admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:09.363933 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db9069a-01f9-479d-83e5-c515a8fbc77e admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:09.368545 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b26487-be9a-42b5-8741-50cfc3a02e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:09.369556 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b26487-be9a-42b5-8741-50cfc3a02e12 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:09.369916 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b26487-be9a-42b5-8741-50cfc3a02e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:09.370197 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b26487-be9a-42b5-8741-50cfc3a02e12 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:09.370946 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b26487-be9a-42b5-8741-50cfc3a02e12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:09.372588 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b26487-be9a-42b5-8741-50cfc3a02e12 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:09.382324 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1195/2381] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:04:09 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:04:09.386444 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296edc3-4f98-4628-b762-450e22f32318 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:09.396955 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296edc3-4f98-4628-b762-450e22f32318 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:09.402793 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7033382c-7cdf-4906-8b78-6f630267513f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:09.403452 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033382c-7cdf-4906-8b78-6f630267513f admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:09.403729 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033382c-7cdf-4906-8b78-6f630267513f admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:09.403995 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033382c-7cdf-4906-8b78-6f630267513f admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:09.404736 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7033382c-7cdf-4906-8b78-6f630267513f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:09.406328 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7033382c-7cdf-4906-8b78-6f630267513f admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:09.417575 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1187/2382] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:04:09 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:04:09.421956 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b26487-be9a-42b5-8741-50cfc3a02e12 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:09.432486 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b26487-be9a-42b5-8741-50cfc3a02e12 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:09.439201 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81d5b1a-ff31-45b8-9f24-18b5d187ee9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:09.440354 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d5b1a-ff31-45b8-9f24-18b5d187ee9f admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:09.440882 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d5b1a-ff31-45b8-9f24-18b5d187ee9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:09.441238 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d5b1a-ff31-45b8-9f24-18b5d187ee9f admin admin] PATH_INFO: `/v3/projects/d31a505eabd048e3a011d0f1037efd5b/users/526f05181dae456893821dc11716e0b2/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:09.458492 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81d5b1a-ff31-45b8-9f24-18b5d187ee9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d31a505eabd048e3a011d0f1037efd5b, user_id=526f05181dae456893821dc11716e0b2, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:09.461480 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81d5b1a-ff31-45b8-9f24-18b5d187ee9f admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:09.482222 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1196/2383] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:04:09 2021] PUT /identity/v3/projects/d31a505eabd048e3a011d0f1037efd5b/users/526f05181dae456893821dc11716e0b2/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:04:09.496598 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37bcb37-4509-47f2-bbef-549f02c01003 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:09.496911 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37bcb37-4509-47f2-bbef-549f02c01003 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:09.497174 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37bcb37-4509-47f2-bbef-549f02c01003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:09.524294 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-e37bcb37-4509-47f2-bbef-549f02c01003 None None] MFA Rules not processed for user `526f05181dae456893821dc11716e0b2`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:04:09.525660 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-e37bcb37-4509-47f2-bbef-549f02c01003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:09.591696 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1188/2384] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:04:09 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 05:04:09.596355 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81d5b1a-ff31-45b8-9f24-18b5d187ee9f admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:09.658234 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81d5b1a-ff31-45b8-9f24-18b5d187ee9f admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:09.663350 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4582cc-d98a-4cd1-b5fe-b9c370ad275f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:09.663998 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4582cc-d98a-4cd1-b5fe-b9c370ad275f admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:09.664280 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4582cc-d98a-4cd1-b5fe-b9c370ad275f admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:09.664576 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4582cc-d98a-4cd1-b5fe-b9c370ad275f admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:09.665297 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4582cc-d98a-4cd1-b5fe-b9c370ad275f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:09.667347 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4582cc-d98a-4cd1-b5fe-b9c370ad275f admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:09.699676 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1197/2385] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:04:09 2021] POST /identity/v3/projects => generated 365 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:04:09.703997 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37bcb37-4509-47f2-bbef-549f02c01003 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:09.715587 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37bcb37-4509-47f2-bbef-549f02c01003 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:09.771706 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531263dd-8919-4190-8554-798d648e1ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:09.772490 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531263dd-8919-4190-8554-798d648e1ed8 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:09.772832 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531263dd-8919-4190-8554-798d648e1ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:09.773177 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531263dd-8919-4190-8554-798d648e1ed8 admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:09.773923 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531263dd-8919-4190-8554-798d648e1ed8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:09.776057 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531263dd-8919-4190-8554-798d648e1ed8 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:09.798411 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1189/2386] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:04:09 2021] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:04:09.801695 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4582cc-d98a-4cd1-b5fe-b9c370ad275f admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:09.812488 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4582cc-d98a-4cd1-b5fe-b9c370ad275f admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:09.817700 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2f1c7-27b3-47f6-8cb0-77cd850a3200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:09.818418 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2f1c7-27b3-47f6-8cb0-77cd850a3200 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:09.818700 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2f1c7-27b3-47f6-8cb0-77cd850a3200 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:09.818972 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2f1c7-27b3-47f6-8cb0-77cd850a3200 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:09.819724 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d2f1c7-27b3-47f6-8cb0-77cd850a3200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:09.821363 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d2f1c7-27b3-47f6-8cb0-77cd850a3200 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:09.831964 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1198/2387] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:04:09 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:04:09.836579 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531263dd-8919-4190-8554-798d648e1ed8 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:09.846657 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531263dd-8919-4190-8554-798d648e1ed8 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:09.852345 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d6e22-1054-488c-adba-f0b2428402b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:09.853563 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d6e22-1054-488c-adba-f0b2428402b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:09.853844 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d6e22-1054-488c-adba-f0b2428402b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:09.854150 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d6e22-1054-488c-adba-f0b2428402b1 admin admin] PATH_INFO: `/v3/projects/624e540bb95946ed8794c08584c4835d/users/03ee90e6e698405c8716c00af928c6d0/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:09.870058 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d6e22-1054-488c-adba-f0b2428402b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=624e540bb95946ed8794c08584c4835d, user_id=03ee90e6e698405c8716c00af928c6d0, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:09.872816 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d6e22-1054-488c-adba-f0b2428402b1 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:09.889324 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1190/2388] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:04:09 2021] PUT /identity/v3/projects/624e540bb95946ed8794c08584c4835d/users/03ee90e6e698405c8716c00af928c6d0/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:04:09.893297 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2f1c7-27b3-47f6-8cb0-77cd850a3200 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:09.903968 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2f1c7-27b3-47f6-8cb0-77cd850a3200 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:09.968240 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4609c1a-3627-48ec-ae9c-3620ba358b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:09.968858 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4609c1a-3627-48ec-ae9c-3620ba358b61 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:09.969140 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4609c1a-3627-48ec-ae9c-3620ba358b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:09.969418 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4609c1a-3627-48ec-ae9c-3620ba358b61 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:09.970156 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4609c1a-3627-48ec-ae9c-3620ba358b61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:09.971756 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4609c1a-3627-48ec-ae9c-3620ba358b61 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:09.981480 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1199/2389] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:04:09 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 24 05:04:09.985689 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d6e22-1054-488c-adba-f0b2428402b1 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:09.996569 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d6e22-1054-488c-adba-f0b2428402b1 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:10.001630 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6290b4dc-e53e-4c1b-bc5f-951a00428cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:10.002506 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6290b4dc-e53e-4c1b-bc5f-951a00428cea admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:10.002788 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6290b4dc-e53e-4c1b-bc5f-951a00428cea admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:10.003066 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6290b4dc-e53e-4c1b-bc5f-951a00428cea admin admin] PATH_INFO: `/v3/projects/624e540bb95946ed8794c08584c4835d/users/03ee90e6e698405c8716c00af928c6d0/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:10.005242 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6290b4dc-e53e-4c1b-bc5f-951a00428cea admin admin] RBAC: Authorizing `identity:create_grant(project_id=624e540bb95946ed8794c08584c4835d, user_id=03ee90e6e698405c8716c00af928c6d0, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:10.007919 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6290b4dc-e53e-4c1b-bc5f-951a00428cea admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:10.018714 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1191/2390] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:04:09 2021] PUT /identity/v3/projects/624e540bb95946ed8794c08584c4835d/users/03ee90e6e698405c8716c00af928c6d0/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:04:10.030111 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e74cb-746b-4234-a4e3-b69185c7d022 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:10.030420 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e74cb-746b-4234-a4e3-b69185c7d022 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:10.030693 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e74cb-746b-4234-a4e3-b69185c7d022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:10.059747 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-4d4e74cb-746b-4234-a4e3-b69185c7d022 None None] MFA Rules not processed for user `03ee90e6e698405c8716c00af928c6d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:04:10.061000 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-4d4e74cb-746b-4234-a4e3-b69185c7d022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:10.139814 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1200/2391] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:04:10 2021] POST /identity/v3/auth/tokens => generated 3299 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:04:10.150951 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6290b4dc-e53e-4c1b-bc5f-951a00428cea admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:10.153183 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-6290b4dc-e53e-4c1b-bc5f-951a00428cea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:10.216646 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6290b4dc-e53e-4c1b-bc5f-951a00428cea admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:10.220776 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde263f-1202-4f8d-94a5-d67294eae48a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:10.221340 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde263f-1202-4f8d-94a5-d67294eae48a service cinder] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:10.221615 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde263f-1202-4f8d-94a5-d67294eae48a service cinder] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:10.221885 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde263f-1202-4f8d-94a5-d67294eae48a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:10.231761 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebde263f-1202-4f8d-94a5-d67294eae48a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:10.233242 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebde263f-1202-4f8d-94a5-d67294eae48a service cinder] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:10.242670 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1192/2392] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:04:10 2021] GET /identity/v3/auth/tokens => generated 3299 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:04:10.411421 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4e74cb-746b-4234-a4e3-b69185c7d022 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:10.430419 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde263f-1202-4f8d-94a5-d67294eae48a service cinder] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:10.432176 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-ebde263f-1202-4f8d-94a5-d67294eae48a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:10.475491 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4e74cb-746b-4234-a4e3-b69185c7d022 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:10.480481 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fcf4c8-ee72-4dbe-818c-02959afc0fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:10.481376 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fcf4c8-ee72-4dbe-818c-02959afc0fec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:10.481655 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fcf4c8-ee72-4dbe-818c-02959afc0fec admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:10.481927 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fcf4c8-ee72-4dbe-818c-02959afc0fec admin admin] PATH_INFO: `/v3/users/526f05181dae456893821dc11716e0b2` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:10.483149 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fcf4c8-ee72-4dbe-818c-02959afc0fec admin admin] RBAC: Authorizing `identity:delete_user(user_id=526f05181dae456893821dc11716e0b2)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:10.485104 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fcf4c8-ee72-4dbe-818c-02959afc0fec admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:10.489306 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde263f-1202-4f8d-94a5-d67294eae48a service cinder] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:10.493435 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b3aff-2a51-4c7a-8c44-0131af7cce66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:10.494110 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b3aff-2a51-4c7a-8c44-0131af7cce66 service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:10.494387 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b3aff-2a51-4c7a-8c44-0131af7cce66 service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:10.494657 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b3aff-2a51-4c7a-8c44-0131af7cce66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:10.496545 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-a26b3aff-2a51-4c7a-8c44-0131af7cce66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:10.532944 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-64fcf4c8-ee72-4dbe-818c-02959afc0fec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '526f05181dae456893821dc11716e0b2'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:10.533795 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-64fcf4c8-ee72-4dbe-818c-02959afc0fec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '526f05181dae456893821dc11716e0b2'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:10.541694 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-64fcf4c8-ee72-4dbe-818c-02959afc0fec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '526f05181dae456893821dc11716e0b2'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:10.548854 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-64fcf4c8-ee72-4dbe-818c-02959afc0fec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '526f05181dae456893821dc11716e0b2'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:10.561101 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-64fcf4c8-ee72-4dbe-818c-02959afc0fec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '526f05181dae456893821dc11716e0b2'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:10.567052 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1201/2393] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:04:10 2021] DELETE /identity/v3/users/526f05181dae456893821dc11716e0b2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:04:10.568181 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b3aff-2a51-4c7a-8c44-0131af7cce66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:10.569753 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b3aff-2a51-4c7a-8c44-0131af7cce66 service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:10.571256 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce47035-62a0-4b49-be7a-e4a063056c79 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:10.571544 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce47035-62a0-4b49-be7a-e4a063056c79 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:10.571964 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce47035-62a0-4b49-be7a-e4a063056c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:10.581289 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1193/2394] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:04:10 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:04:10.589601 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-3ce47035-62a0-4b49-be7a-e4a063056c79 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:04:10.590793 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-3ce47035-62a0-4b49-be7a-e4a063056c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:10.651298 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1202/2395] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:04:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:04:10.661121 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b3aff-2a51-4c7a-8c44-0131af7cce66 service neutron] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:10.670077 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b3aff-2a51-4c7a-8c44-0131af7cce66 service neutron] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:10.717280 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20faecf-f735-4e9a-a2b6-cb617bb885af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:10.717922 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20faecf-f735-4e9a-a2b6-cb617bb885af service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:10.718199 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20faecf-f735-4e9a-a2b6-cb617bb885af service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:10.718464 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20faecf-f735-4e9a-a2b6-cb617bb885af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:10.727693 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20faecf-f735-4e9a-a2b6-cb617bb885af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:10.729519 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20faecf-f735-4e9a-a2b6-cb617bb885af service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:10.741628 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1194/2396] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:04:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:04:11.019003 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce47035-62a0-4b49-be7a-e4a063056c79 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:11.020586 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-3ce47035-62a0-4b49-be7a-e4a063056c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:11.033232 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce47035-62a0-4b49-be7a-e4a063056c79 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:11.038638 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80205e18-00cb-4bb0-a5b8-d780c2ef846c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:11.040592 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80205e18-00cb-4bb0-a5b8-d780c2ef846c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:11.041357 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80205e18-00cb-4bb0-a5b8-d780c2ef846c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:11.041686 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80205e18-00cb-4bb0-a5b8-d780c2ef846c admin admin] PATH_INFO: `/v3/projects/d31a505eabd048e3a011d0f1037efd5b` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:11.043198 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80205e18-00cb-4bb0-a5b8-d780c2ef846c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d31a505eabd048e3a011d0f1037efd5b)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:11.045420 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80205e18-00cb-4bb0-a5b8-d780c2ef846c admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:11.093414 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-80205e18-00cb-4bb0-a5b8-d780c2ef846c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd31a505eabd048e3a011d0f1037efd5b', 'request_id': 'req-80205e18-00cb-4bb0-a5b8-d780c2ef846c'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:11.102792 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-80205e18-00cb-4bb0-a5b8-d780c2ef846c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd31a505eabd048e3a011d0f1037efd5b', 'request_id': 'req-80205e18-00cb-4bb0-a5b8-d780c2ef846c'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:11.108584 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-80205e18-00cb-4bb0-a5b8-d780c2ef846c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd31a505eabd048e3a011d0f1037efd5b', 'request_id': 'req-80205e18-00cb-4bb0-a5b8-d780c2ef846c'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:11.119889 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-80205e18-00cb-4bb0-a5b8-d780c2ef846c admin admin] The token cache is being invalidate because project d31a505eabd048e3a011d0f1037efd5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:04:11.120271 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-80205e18-00cb-4bb0-a5b8-d780c2ef846c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:11.120943 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-80205e18-00cb-4bb0-a5b8-d780c2ef846c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:11.122911 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1203/2397] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:04:11 2021] DELETE /identity/v3/projects/d31a505eabd048e3a011d0f1037efd5b => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:04:11.127145 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20faecf-f735-4e9a-a2b6-cb617bb885af service neutron] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:11.137695 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20faecf-f735-4e9a-a2b6-cb617bb885af service neutron] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:11.199875 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b475898b-fe36-419e-807b-ce72da27524f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:11.200773 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475898b-fe36-419e-807b-ce72da27524f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:11.201050 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475898b-fe36-419e-807b-ce72da27524f admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:11.201316 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475898b-fe36-419e-807b-ce72da27524f admin admin] PATH_INFO: `/v3/users/03ee90e6e698405c8716c00af928c6d0` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:11.202614 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b475898b-fe36-419e-807b-ce72da27524f admin admin] RBAC: Authorizing `identity:delete_user(user_id=03ee90e6e698405c8716c00af928c6d0)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:11.204640 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b475898b-fe36-419e-807b-ce72da27524f admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:11.262649 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-b475898b-fe36-419e-807b-ce72da27524f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03ee90e6e698405c8716c00af928c6d0'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:11.263674 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-b475898b-fe36-419e-807b-ce72da27524f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03ee90e6e698405c8716c00af928c6d0'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:11.272022 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-b475898b-fe36-419e-807b-ce72da27524f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03ee90e6e698405c8716c00af928c6d0'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:11.288790 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-b475898b-fe36-419e-807b-ce72da27524f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03ee90e6e698405c8716c00af928c6d0'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:11.290025 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-b475898b-fe36-419e-807b-ce72da27524f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03ee90e6e698405c8716c00af928c6d0'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:11.314713 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1195/2398] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:04:11 2021] DELETE /identity/v3/users/03ee90e6e698405c8716c00af928c6d0 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:04:11.591307 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80205e18-00cb-4bb0-a5b8-d780c2ef846c admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:11.592976 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-80205e18-00cb-4bb0-a5b8-d780c2ef846c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:11.607328 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80205e18-00cb-4bb0-a5b8-d780c2ef846c admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:11.669718 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7269823-3f22-43da-ae41-96329ce7ad48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:11.670574 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7269823-3f22-43da-ae41-96329ce7ad48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:11.670848 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7269823-3f22-43da-ae41-96329ce7ad48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:11.671125 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7269823-3f22-43da-ae41-96329ce7ad48 admin admin] PATH_INFO: `/v3/projects/624e540bb95946ed8794c08584c4835d` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:11.672341 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7269823-3f22-43da-ae41-96329ce7ad48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=624e540bb95946ed8794c08584c4835d)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:11.674309 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7269823-3f22-43da-ae41-96329ce7ad48 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:11.721719 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b7269823-3f22-43da-ae41-96329ce7ad48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '624e540bb95946ed8794c08584c4835d', 'request_id': 'req-b7269823-3f22-43da-ae41-96329ce7ad48'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:11.732333 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b7269823-3f22-43da-ae41-96329ce7ad48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '624e540bb95946ed8794c08584c4835d', 'request_id': 'req-b7269823-3f22-43da-ae41-96329ce7ad48'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:11.736836 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b7269823-3f22-43da-ae41-96329ce7ad48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '624e540bb95946ed8794c08584c4835d', 'request_id': 'req-b7269823-3f22-43da-ae41-96329ce7ad48'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:11.750420 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b7269823-3f22-43da-ae41-96329ce7ad48 admin admin] The token cache is being invalidate because project 624e540bb95946ed8794c08584c4835d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:04:11.751123 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b7269823-3f22-43da-ae41-96329ce7ad48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:11.751390 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b7269823-3f22-43da-ae41-96329ce7ad48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:11.753241 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1204/2399] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:04:11 2021] DELETE /identity/v3/projects/624e540bb95946ed8794c08584c4835d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:04:11.759391 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344d966-8db0-44a3-a741-cf02af50af19 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:11.760230 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344d966-8db0-44a3-a741-cf02af50af19 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:11.761039 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344d966-8db0-44a3-a741-cf02af50af19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:11.786081 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-e344d966-8db0-44a3-a741-cf02af50af19 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:04:11.787195 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-e344d966-8db0-44a3-a741-cf02af50af19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:11.856023 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1196/2400] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:04:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:04:11.863688 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83836002-5cc2-41f6-a27c-a63b2dc07a52 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:11.863977 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83836002-5cc2-41f6-a27c-a63b2dc07a52 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:11.864260 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83836002-5cc2-41f6-a27c-a63b2dc07a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:11.883352 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-83836002-5cc2-41f6-a27c-a63b2dc07a52 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:04:11.884663 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-83836002-5cc2-41f6-a27c-a63b2dc07a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:11.893424 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1205/2401] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:04:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:04:11.897743 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e344d966-8db0-44a3-a741-cf02af50af19 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:11.907505 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e344d966-8db0-44a3-a741-cf02af50af19 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:11.912470 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03690c0d-c375-4998-80f5-62bc4e238871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:11.913152 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03690c0d-c375-4998-80f5-62bc4e238871 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:11.913428 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03690c0d-c375-4998-80f5-62bc4e238871 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:11.913700 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03690c0d-c375-4998-80f5-62bc4e238871 admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:11.914444 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03690c0d-c375-4998-80f5-62bc4e238871 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 05:04:11.914746 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03690c0d-c375-4998-80f5-62bc4e238871 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:11.916547 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03690c0d-c375-4998-80f5-62bc4e238871 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:11.934726 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1197/2402] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 05:04:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 05:04:11.940560 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83836002-5cc2-41f6-a27c-a63b2dc07a52 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:11.950512 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83836002-5cc2-41f6-a27c-a63b2dc07a52 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:11.956164 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d2763-8c5b-42cf-8d74-e5e469694a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:11.956870 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d2763-8c5b-42cf-8d74-e5e469694a68 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:11.957156 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d2763-8c5b-42cf-8d74-e5e469694a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:11.957431 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d2763-8c5b-42cf-8d74-e5e469694a68 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:11.958158 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d2763-8c5b-42cf-8d74-e5e469694a68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:11.960444 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d2763-8c5b-42cf-8d74-e5e469694a68 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:11.991044 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1206/2403] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:04:11 2021] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 05:04:11.995559 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03690c0d-c375-4998-80f5-62bc4e238871 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:12.008255 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03690c0d-c375-4998-80f5-62bc4e238871 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:12.063989 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859de23c-556b-4059-ba48-0970bf3a6ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:12.064680 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859de23c-556b-4059-ba48-0970bf3a6ff0 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:12.064956 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859de23c-556b-4059-ba48-0970bf3a6ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:12.065227 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859de23c-556b-4059-ba48-0970bf3a6ff0 admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:12.065939 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859de23c-556b-4059-ba48-0970bf3a6ff0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:12.067882 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859de23c-556b-4059-ba48-0970bf3a6ff0 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:12.094517 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1198/2404] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:04:11 2021] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:04:12.100331 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d2763-8c5b-42cf-8d74-e5e469694a68 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:12.112174 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d2763-8c5b-42cf-8d74-e5e469694a68 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:12.117133 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b10a03-c6c5-4fce-bb7b-d7ed511c2ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:12.117784 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b10a03-c6c5-4fce-bb7b-d7ed511c2ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:12.118063 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b10a03-c6c5-4fce-bb7b-d7ed511c2ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:12.118334 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b10a03-c6c5-4fce-bb7b-d7ed511c2ff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:12.119286 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b10a03-c6c5-4fce-bb7b-d7ed511c2ff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:12.121021 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b10a03-c6c5-4fce-bb7b-d7ed511c2ff5 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:12.131882 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1207/2405] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:04:12 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:04:12.136195 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859de23c-556b-4059-ba48-0970bf3a6ff0 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:12.149276 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859de23c-556b-4059-ba48-0970bf3a6ff0 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:12.157805 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bbf5cc-3f0b-4d17-8d3d-c0ae9a311678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:12.158854 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bbf5cc-3f0b-4d17-8d3d-c0ae9a311678 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:12.159228 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bbf5cc-3f0b-4d17-8d3d-c0ae9a311678 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:12.159640 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bbf5cc-3f0b-4d17-8d3d-c0ae9a311678 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:12.160883 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bbf5cc-3f0b-4d17-8d3d-c0ae9a311678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:12.163328 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bbf5cc-3f0b-4d17-8d3d-c0ae9a311678 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:12.175427 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1199/2406] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:04:12 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:04:12.181243 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b10a03-c6c5-4fce-bb7b-d7ed511c2ff5 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:12.192299 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b10a03-c6c5-4fce-bb7b-d7ed511c2ff5 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:12.199352 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b87bf-e330-4858-ac94-04325b641cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:12.201030 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b87bf-e330-4858-ac94-04325b641cb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:12.201457 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b87bf-e330-4858-ac94-04325b641cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:12.201847 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b87bf-e330-4858-ac94-04325b641cb5 admin admin] PATH_INFO: `/v3/projects/14dbbfb9f9ff412591de834421fa4027/users/fa76e6b832234161a8ade0a7c31c5cd2/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:12.222892 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b87bf-e330-4858-ac94-04325b641cb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14dbbfb9f9ff412591de834421fa4027, user_id=fa76e6b832234161a8ade0a7c31c5cd2, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:12.225670 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b87bf-e330-4858-ac94-04325b641cb5 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:12.243356 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1208/2407] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:04:12 2021] PUT /identity/v3/projects/14dbbfb9f9ff412591de834421fa4027/users/fa76e6b832234161a8ade0a7c31c5cd2/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:04:12.253690 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83db15-5bc1-45b3-afcc-ce0e90839170 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:12.253960 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83db15-5bc1-45b3-afcc-ce0e90839170 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:12.254236 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83db15-5bc1-45b3-afcc-ce0e90839170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:12.281824 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-ae83db15-5bc1-45b3-afcc-ce0e90839170 None None] MFA Rules not processed for user `fa76e6b832234161a8ade0a7c31c5cd2`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:04:12.283440 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-ae83db15-5bc1-45b3-afcc-ce0e90839170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:12.355113 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1200/2408] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:04:12 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:04:12.359867 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b87bf-e330-4858-ac94-04325b641cb5 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:12.422059 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b87bf-e330-4858-ac94-04325b641cb5 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:12.426952 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2764fb-9bc4-430e-abfa-839df77e9675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:12.427605 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2764fb-9bc4-430e-abfa-839df77e9675 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:12.427885 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2764fb-9bc4-430e-abfa-839df77e9675 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:12.428159 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2764fb-9bc4-430e-abfa-839df77e9675 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:12.428890 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2764fb-9bc4-430e-abfa-839df77e9675 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:12.430804 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2764fb-9bc4-430e-abfa-839df77e9675 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:12.457214 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1209/2409] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:04:12 2021] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:04:12.461801 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae83db15-5bc1-45b3-afcc-ce0e90839170 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:12.473033 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae83db15-5bc1-45b3-afcc-ce0e90839170 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:12.534720 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e939d-0b45-4efa-a6c4-5b120b481305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:12.535573 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e939d-0b45-4efa-a6c4-5b120b481305 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:12.535863 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e939d-0b45-4efa-a6c4-5b120b481305 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:12.536134 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e939d-0b45-4efa-a6c4-5b120b481305 admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:12.536893 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3e939d-0b45-4efa-a6c4-5b120b481305 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:12.538833 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3e939d-0b45-4efa-a6c4-5b120b481305 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:12.563653 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1201/2410] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:04:12 2021] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:04:12.567819 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2764fb-9bc4-430e-abfa-839df77e9675 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:12.579633 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2764fb-9bc4-430e-abfa-839df77e9675 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:12.584874 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97013512-e165-4589-a028-d7f1643c9cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:12.585870 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97013512-e165-4589-a028-d7f1643c9cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:12.586162 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97013512-e165-4589-a028-d7f1643c9cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:12.586419 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97013512-e165-4589-a028-d7f1643c9cb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:12.587156 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97013512-e165-4589-a028-d7f1643c9cb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:12.588898 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97013512-e165-4589-a028-d7f1643c9cb7 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:12.601210 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1210/2411] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:04:12 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:04:12.605429 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e939d-0b45-4efa-a6c4-5b120b481305 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:12.609357 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6c952-7a2d-4316-929c-0a24f778ce53 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:12.609741 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6c952-7a2d-4316-929c-0a24f778ce53 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:12.610091 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6c952-7a2d-4316-929c-0a24f778ce53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:12.616224 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e939d-0b45-4efa-a6c4-5b120b481305 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:12.621249 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37954978-52af-4d7b-b7ab-2b0de9c2d9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:12.621952 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37954978-52af-4d7b-b7ab-2b0de9c2d9e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:12.622194 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37954978-52af-4d7b-b7ab-2b0de9c2d9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:12.622461 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37954978-52af-4d7b-b7ab-2b0de9c2d9e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:12.623227 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37954978-52af-4d7b-b7ab-2b0de9c2d9e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:12.624904 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37954978-52af-4d7b-b7ab-2b0de9c2d9e0 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:12.635761 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1202/2412] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:04:12 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:04:12.639881 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37954978-52af-4d7b-b7ab-2b0de9c2d9e0 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:12.649555 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37954978-52af-4d7b-b7ab-2b0de9c2d9e0 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:12.654304 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68450733-20ea-472a-b606-9e6e5023c7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:12.655179 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68450733-20ea-472a-b606-9e6e5023c7e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:12.655458 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68450733-20ea-472a-b606-9e6e5023c7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:12.655734 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68450733-20ea-472a-b606-9e6e5023c7e7 admin admin] PATH_INFO: `/v3/projects/71d146aaf6b841b58a60f1438af6749d/users/855ae88b7d734e44a26546813c949a9e/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:12.662795 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-a4d6c952-7a2d-4316-929c-0a24f778ce53 None None] MFA Rules not processed for user `3d0ee2c830754741b0f9eedabf6bded8`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:04:12.664049 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-a4d6c952-7a2d-4316-929c-0a24f778ce53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:12.670719 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68450733-20ea-472a-b606-9e6e5023c7e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71d146aaf6b841b58a60f1438af6749d, user_id=855ae88b7d734e44a26546813c949a9e, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:12.673519 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68450733-20ea-472a-b606-9e6e5023c7e7 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:12.687019 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1203/2413] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:04:12 2021] PUT /identity/v3/projects/71d146aaf6b841b58a60f1438af6749d/users/855ae88b7d734e44a26546813c949a9e/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 05:04:12.698397 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c6a0d-584f-4085-9465-30798048fc50 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:12.698688 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c6a0d-584f-4085-9465-30798048fc50 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:12.698965 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c6a0d-584f-4085-9465-30798048fc50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:12.727056 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-b86c6a0d-584f-4085-9465-30798048fc50 None None] MFA Rules not processed for user `855ae88b7d734e44a26546813c949a9e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:04:12.728290 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-b86c6a0d-584f-4085-9465-30798048fc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:12.728804 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1211/2414] 10.222.0.43 () {58 vars in 1009 bytes} [Fri Dec 24 05:04:12 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 05:04:12.777643 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d6c952-7a2d-4316-929c-0a24f778ce53 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:12.779182 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-a4d6c952-7a2d-4316-929c-0a24f778ce53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:12.796687 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1204/2415] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:04:12 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 05:04:12.800926 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c6a0d-584f-4085-9465-30798048fc50 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:12.861758 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c6a0d-584f-4085-9465-30798048fc50 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:12.870893 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d0f6a-7745-49dd-809e-96d04fe5a8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:12.872069 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d0f6a-7745-49dd-809e-96d04fe5a8b0 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:12.872069 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d0f6a-7745-49dd-809e-96d04fe5a8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:12.872290 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d0f6a-7745-49dd-809e-96d04fe5a8b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:12.873054 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925d0f6a-7745-49dd-809e-96d04fe5a8b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:12.874558 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d6c952-7a2d-4316-929c-0a24f778ce53 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:12.874965 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925d0f6a-7745-49dd-809e-96d04fe5a8b0 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:12.908394 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1205/2416] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:04:12 2021] POST /identity/v3/projects => generated 387 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 05:04:12.909308 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d0f6a-7745-49dd-809e-96d04fe5a8b0 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:12.954888 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31657ff-cbdf-407d-8893-76be8bb9309d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218ae7d29b71487d86b11aeb380788ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:12.957198 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31657ff-cbdf-407d-8893-76be8bb9309d service swift] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:12.957547 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31657ff-cbdf-407d-8893-76be8bb9309d service swift] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:12.957886 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31657ff-cbdf-407d-8893-76be8bb9309d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:12.979258 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d0f6a-7745-49dd-809e-96d04fe5a8b0 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:12.988257 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e884343d-6b27-407f-8e57-9ef3afd5cd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:12.988964 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884343d-6b27-407f-8e57-9ef3afd5cd6b admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:12.989256 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884343d-6b27-407f-8e57-9ef3afd5cd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:12.989531 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884343d-6b27-407f-8e57-9ef3afd5cd6b admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:12.990293 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e884343d-6b27-407f-8e57-9ef3afd5cd6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:12.992255 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e884343d-6b27-407f-8e57-9ef3afd5cd6b admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:13.014988 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1206/2417] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:04:12 2021] POST /identity/v3/users => generated 300 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:04:13.018917 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e884343d-6b27-407f-8e57-9ef3afd5cd6b admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:13.021744 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31657ff-cbdf-407d-8893-76be8bb9309d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:13.024046 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31657ff-cbdf-407d-8893-76be8bb9309d service swift] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:13.030723 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e884343d-6b27-407f-8e57-9ef3afd5cd6b admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:13.032868 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1212/2418] 10.222.0.43 () {60 vars in 1384 bytes} [Fri Dec 24 05:04:12 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 24 05:04:13.036313 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a693380-b402-45f1-b668-fa9b1993c12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:13.037125 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a693380-b402-45f1-b668-fa9b1993c12a admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:13.037286 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a693380-b402-45f1-b668-fa9b1993c12a admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:13.037766 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a693380-b402-45f1-b668-fa9b1993c12a admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:13.038353 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a693380-b402-45f1-b668-fa9b1993c12a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:13.040038 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a693380-b402-45f1-b668-fa9b1993c12a admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:13.074913 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1207/2419] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:04:13 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 24 05:04:13.079212 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31657ff-cbdf-407d-8893-76be8bb9309d service swift] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:13.090353 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31657ff-cbdf-407d-8893-76be8bb9309d service swift] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:13.101758 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca1303-6651-4ec6-93de-52de272d247a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:13.103362 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca1303-6651-4ec6-93de-52de272d247a admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:13.103843 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca1303-6651-4ec6-93de-52de272d247a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:13.104258 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca1303-6651-4ec6-93de-52de272d247a admin admin] PATH_INFO: `/v3/projects/8dc46d97433a404fb543419127996385/users/d7d9f8780811442f96bee9668370128b/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:13.121485 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca1303-6651-4ec6-93de-52de272d247a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dc46d97433a404fb543419127996385, user_id=d7d9f8780811442f96bee9668370128b, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:13.124613 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca1303-6651-4ec6-93de-52de272d247a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:13.140555 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1213/2420] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:04:13 2021] PUT /identity/v3/projects/8dc46d97433a404fb543419127996385/users/d7d9f8780811442f96bee9668370128b/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 05:04:13.144778 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a693380-b402-45f1-b668-fa9b1993c12a admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:13.156195 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a693380-b402-45f1-b668-fa9b1993c12a admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:13.224627 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b23783-ea70-4a3b-bf67-abc1efdeed97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:13.225937 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b23783-ea70-4a3b-bf67-abc1efdeed97 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:13.225937 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b23783-ea70-4a3b-bf67-abc1efdeed97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:13.225937 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b23783-ea70-4a3b-bf67-abc1efdeed97 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:13.226636 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b23783-ea70-4a3b-bf67-abc1efdeed97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:13.228391 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b23783-ea70-4a3b-bf67-abc1efdeed97 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:13.246319 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1208/2421] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:04:13 2021] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:04:13.247536 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca1303-6651-4ec6-93de-52de272d247a admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:13.262343 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca1303-6651-4ec6-93de-52de272d247a admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:13.267822 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad9424d-631c-4c3c-a769-b4f202b36145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:13.268974 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9424d-631c-4c3c-a769-b4f202b36145 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:13.269189 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9424d-631c-4c3c-a769-b4f202b36145 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:13.269434 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9424d-631c-4c3c-a769-b4f202b36145 admin admin] PATH_INFO: `/v3/projects/8dc46d97433a404fb543419127996385/users/d7d9f8780811442f96bee9668370128b/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:13.272638 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad9424d-631c-4c3c-a769-b4f202b36145 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dc46d97433a404fb543419127996385, user_id=d7d9f8780811442f96bee9668370128b, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:13.276720 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad9424d-631c-4c3c-a769-b4f202b36145 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:13.296940 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1214/2422] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:04:13 2021] PUT /identity/v3/projects/8dc46d97433a404fb543419127996385/users/d7d9f8780811442f96bee9668370128b/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 05:04:13.298824 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4557e22-fae2-4647-89ed-c01b88bd47f4 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:13.299121 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4557e22-fae2-4647-89ed-c01b88bd47f4 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:13.299407 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4557e22-fae2-4647-89ed-c01b88bd47f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:13.341718 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-f4557e22-fae2-4647-89ed-c01b88bd47f4 None None] MFA Rules not processed for user `d7d9f8780811442f96bee9668370128b`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:04:13.343048 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-f4557e22-fae2-4647-89ed-c01b88bd47f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:13.418734 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1209/2423] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:04:13 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:04:13.430221 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad9424d-631c-4c3c-a769-b4f202b36145 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:13.432381 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-8ad9424d-631c-4c3c-a769-b4f202b36145 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:13.500829 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad9424d-631c-4c3c-a769-b4f202b36145 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:13.504730 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f95c1-e6f6-446c-ad5b-4a80ba9e0423 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:13.505385 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f95c1-e6f6-446c-ad5b-4a80ba9e0423 service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:13.505703 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f95c1-e6f6-446c-ad5b-4a80ba9e0423 service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:13.506018 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f95c1-e6f6-446c-ad5b-4a80ba9e0423 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:13.516154 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f95c1-e6f6-446c-ad5b-4a80ba9e0423 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:13.517699 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f95c1-e6f6-446c-ad5b-4a80ba9e0423 service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:13.527738 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1215/2424] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:04:13 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:04:14.190530 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4557e22-fae2-4647-89ed-c01b88bd47f4 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:14.192064 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-f4557e22-fae2-4647-89ed-c01b88bd47f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:14.226107 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4557e22-fae2-4647-89ed-c01b88bd47f4 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:14.242561 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9761d082-578c-4617-8010-fc3af9a2d1e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:14.243243 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9761d082-578c-4617-8010-fc3af9a2d1e0 service cinder] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:14.243788 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9761d082-578c-4617-8010-fc3af9a2d1e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:14.244367 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9761d082-578c-4617-8010-fc3af9a2d1e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:14.350658 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9761d082-578c-4617-8010-fc3af9a2d1e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:14.352285 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9761d082-578c-4617-8010-fc3af9a2d1e0 service cinder] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:14.362848 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1210/2425] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:04:14 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:04:17.676553 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f95c1-e6f6-446c-ad5b-4a80ba9e0423 service cinder] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:17.678076 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-3d0f95c1-e6f6-446c-ad5b-4a80ba9e0423 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:17.767717 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f95c1-e6f6-446c-ad5b-4a80ba9e0423 service cinder] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:17.775859 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf40b3-ac64-4eee-8eab-013f8a43ad3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f9ad1e8f8f74edcb44aabe17eb59648', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:17.776718 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf40b3-ac64-4eee-8eab-013f8a43ad3c service nova] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:17.777246 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf40b3-ac64-4eee-8eab-013f8a43ad3c service nova] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:17.778942 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf40b3-ac64-4eee-8eab-013f8a43ad3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:17.780899 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-efcf40b3-ac64-4eee-8eab-013f8a43ad3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:17.858585 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcf40b3-ac64-4eee-8eab-013f8a43ad3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:17.860321 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcf40b3-ac64-4eee-8eab-013f8a43ad3c service nova] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:17.873703 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1216/2426] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:04:17 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:04:21.271873 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18472277-6f40-4941-93f0-2084b1f22ea9 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:21.272472 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18472277-6f40-4941-93f0-2084b1f22ea9 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:21.272472 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18472277-6f40-4941-93f0-2084b1f22ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:21.291647 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-18472277-6f40-4941-93f0-2084b1f22ea9 None None] MFA Rules not processed for user `82fc245c775844e6af2acc79a1e637e8`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:04:21.293080 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-18472277-6f40-4941-93f0-2084b1f22ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:21.356578 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1211/2427] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:04:21 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:04:21.811161 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf40b3-ac64-4eee-8eab-013f8a43ad3c service nova] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:21.812964 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-efcf40b3-ac64-4eee-8eab-013f8a43ad3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:21.901683 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf40b3-ac64-4eee-8eab-013f8a43ad3c service nova] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:21.906847 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de200e-c8ca-4788-ae97-23c228e42968 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:21.907758 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de200e-c8ca-4788-ae97-23c228e42968 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:21.908098 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de200e-c8ca-4788-ae97-23c228e42968 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:21.908452 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de200e-c8ca-4788-ae97-23c228e42968 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:21.910497 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-10de200e-c8ca-4788-ae97-23c228e42968 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:21.921305 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10de200e-c8ca-4788-ae97-23c228e42968 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:21.922872 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10de200e-c8ca-4788-ae97-23c228e42968 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:21.932563 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1217/2428] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:04:21 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:04:22.304875 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18472277-6f40-4941-93f0-2084b1f22ea9 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:22.318427 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-18472277-6f40-4941-93f0-2084b1f22ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:22.421794 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18472277-6f40-4941-93f0-2084b1f22ea9 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:22.427110 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f2cf8-9499-45b9-a713-c99b6fa588f7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '430d6177e74c4dbda7fb83d04c75617e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:22.427807 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f2cf8-9499-45b9-a713-c99b6fa588f7 service placement] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:22.428092 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f2cf8-9499-45b9-a713-c99b6fa588f7 service placement] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:22.428372 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f2cf8-9499-45b9-a713-c99b6fa588f7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:22.430400 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-8a6f2cf8-9499-45b9-a713-c99b6fa588f7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:22.446250 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6f2cf8-9499-45b9-a713-c99b6fa588f7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:22.448553 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6f2cf8-9499-45b9-a713-c99b6fa588f7 service placement] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:22.465570 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1212/2429] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:04:22 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:04:26.841628 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de200e-c8ca-4788-ae97-23c228e42968 service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:26.843355 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-10de200e-c8ca-4788-ae97-23c228e42968 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:26.854528 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de200e-c8ca-4788-ae97-23c228e42968 service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:26.859424 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c3fedf-c4c3-4234-bdab-d17a2f8fac7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:26.860074 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3fedf-c4c3-4234-bdab-d17a2f8fac7f service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:26.860364 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3fedf-c4c3-4234-bdab-d17a2f8fac7f service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:26.860672 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3fedf-c4c3-4234-bdab-d17a2f8fac7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:26.862620 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-b8c3fedf-c4c3-4234-bdab-d17a2f8fac7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:26.873582 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c3fedf-c4c3-4234-bdab-d17a2f8fac7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:26.875022 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c3fedf-c4c3-4234-bdab-d17a2f8fac7f service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:26.883714 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1218/2430] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:04:26 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:04:30.287461 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f2cf8-9499-45b9-a713-c99b6fa588f7 service placement] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:30.297828 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f2cf8-9499-45b9-a713-c99b6fa588f7 service placement] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:30.302339 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed346ca1-eb60-432c-99ed-673a0eb5bfaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:30.302988 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed346ca1-eb60-432c-99ed-673a0eb5bfaa service cinder] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:30.303271 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed346ca1-eb60-432c-99ed-673a0eb5bfaa service cinder] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:30.303544 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed346ca1-eb60-432c-99ed-673a0eb5bfaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:30.362239 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed346ca1-eb60-432c-99ed-673a0eb5bfaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:30.363702 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed346ca1-eb60-432c-99ed-673a0eb5bfaa service cinder] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:30.373851 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1213/2431] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:04:30 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:04:36.441040 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c3fedf-c4c3-4234-bdab-d17a2f8fac7f service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:36.449679 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c3fedf-c4c3-4234-bdab-d17a2f8fac7f service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:36.454752 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83324a16-c313-4fd0-9561-3f4ec7c7f836 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:36.454752 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83324a16-c313-4fd0-9561-3f4ec7c7f836 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:36.454752 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83324a16-c313-4fd0-9561-3f4ec7c7f836 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:36.455357 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83324a16-c313-4fd0-9561-3f4ec7c7f836 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:36.457299 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-83324a16-c313-4fd0-9561-3f4ec7c7f836 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:36.468267 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83324a16-c313-4fd0-9561-3f4ec7c7f836 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:36.469727 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83324a16-c313-4fd0-9561-3f4ec7c7f836 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:36.477844 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1219/2432] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:04:36 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:04:36.501154 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed346ca1-eb60-432c-99ed-673a0eb5bfaa service cinder] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:36.566770 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed346ca1-eb60-432c-99ed-673a0eb5bfaa service cinder] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:36.571621 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4679df2-5c97-410c-8109-159573314972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:36.572640 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4679df2-5c97-410c-8109-159573314972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:36.573081 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4679df2-5c97-410c-8109-159573314972 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:36.573363 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4679df2-5c97-410c-8109-159573314972 admin admin] PATH_INFO: `/v3/users/fa76e6b832234161a8ade0a7c31c5cd2` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:36.574776 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4679df2-5c97-410c-8109-159573314972 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa76e6b832234161a8ade0a7c31c5cd2)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:36.577212 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4679df2-5c97-410c-8109-159573314972 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:36.589540 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5d595-de09-49cd-b68b-c1ec2bd028e7 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:36.590156 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5d595-de09-49cd-b68b-c1ec2bd028e7 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:36.590526 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5d595-de09-49cd-b68b-c1ec2bd028e7 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:36.593088 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1220/2433] 10.222.0.43 () {54 vars in 921 bytes} [Fri Dec 24 05:04:36 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 05:04:36.607132 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c195d1-a436-4e65-a56f-9148a4da73bb None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:36.607679 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c195d1-a436-4e65-a56f-9148a4da73bb None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:36.607800 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c195d1-a436-4e65-a56f-9148a4da73bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:36.634210 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-c4679df2-5c97-410c-8109-159573314972 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa76e6b832234161a8ade0a7c31c5cd2'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:36.635034 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-c4679df2-5c97-410c-8109-159573314972 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa76e6b832234161a8ade0a7c31c5cd2'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:36.643082 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-c4679df2-5c97-410c-8109-159573314972 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa76e6b832234161a8ade0a7c31c5cd2'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:36.650709 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-e7c195d1-a436-4e65-a56f-9148a4da73bb None None] MFA Rules not processed for user `6f9ad1e8f8f74edcb44aabe17eb59648`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:04:36.651937 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-e7c195d1-a436-4e65-a56f-9148a4da73bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:36.652233 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-c4679df2-5c97-410c-8109-159573314972 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa76e6b832234161a8ade0a7c31c5cd2'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:36.653205 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-c4679df2-5c97-410c-8109-159573314972 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa76e6b832234161a8ade0a7c31c5cd2'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:36.666294 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1221/2434] 10.222.0.43 () {58 vars in 1018 bytes} [Fri Dec 24 05:04:36 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:04:36.674000 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1214/2435] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:04:36 2021] DELETE /identity/v3/users/fa76e6b832234161a8ade0a7c31c5cd2 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 05:04:36.679208 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4679df2-5c97-410c-8109-159573314972 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:36.680122 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50254fc5-a468-42e1-a537-d7331c754012 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:36.680610 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50254fc5-a468-42e1-a537-d7331c754012 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:36.680823 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-c4679df2-5c97-410c-8109-159573314972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:36.681182 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50254fc5-a468-42e1-a537-d7331c754012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:36.699789 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-50254fc5-a468-42e1-a537-d7331c754012 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:04:36.701389 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-50254fc5-a468-42e1-a537-d7331c754012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:36.761515 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1222/2436] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:04:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:04:36.768769 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4679df2-5c97-410c-8109-159573314972 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:36.772974 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52d1da-761c-4f54-a299-2b45f147ed7a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1782324ce854868bd11b32bd24b435c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:36.773649 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52d1da-761c-4f54-a299-2b45f147ed7a service glance] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:36.774042 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52d1da-761c-4f54-a299-2b45f147ed7a service glance] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:36.774369 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52d1da-761c-4f54-a299-2b45f147ed7a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:36.778946 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50254fc5-a468-42e1-a537-d7331c754012 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:36.781139 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-50254fc5-a468-42e1-a537-d7331c754012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:36.857143 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50254fc5-a468-42e1-a537-d7331c754012 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:36.863858 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb52d1da-761c-4f54-a299-2b45f147ed7a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:36.865148 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e91dd-a4ec-45de-a87c-6999bd8d4053 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:36.865790 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb52d1da-761c-4f54-a299-2b45f147ed7a service glance] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:36.865924 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e91dd-a4ec-45de-a87c-6999bd8d4053 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:36.866223 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e91dd-a4ec-45de-a87c-6999bd8d4053 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:36.866672 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e91dd-a4ec-45de-a87c-6999bd8d4053 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:36.881731 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1215/2437] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:04:36 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:04:36.883884 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606e91dd-a4ec-45de-a87c-6999bd8d4053 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:36.885530 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606e91dd-a4ec-45de-a87c-6999bd8d4053 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:36.898646 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1223/2438] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:04:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:04:36.974916 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570eb51-e952-4481-baef-36682f4447d9 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:36.975205 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570eb51-e952-4481-baef-36682f4447d9 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:36.975560 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570eb51-e952-4481-baef-36682f4447d9 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:36.977696 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1216/2439] 10.222.0.43 () {54 vars in 921 bytes} [Fri Dec 24 05:04:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 05:04:36.984624 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2cf9b-be53-45af-ac5e-48ca4b9e6421 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:36.984922 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2cf9b-be53-45af-ac5e-48ca4b9e6421 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:36.985194 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2cf9b-be53-45af-ac5e-48ca4b9e6421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:37.006161 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-92a2cf9b-be53-45af-ac5e-48ca4b9e6421 None None] MFA Rules not processed for user `b36f253fbce04e9ea028f02ff57fb272`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:04:37.007382 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-92a2cf9b-be53-45af-ac5e-48ca4b9e6421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:37.014866 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1224/2440] 10.222.0.43 () {58 vars in 1018 bytes} [Fri Dec 24 05:04:36 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:04:37.029500 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4570eb51-e952-4481-baef-36682f4447d9 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:37.031296 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-4570eb51-e952-4481-baef-36682f4447d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:37.046513 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4570eb51-e952-4481-baef-36682f4447d9 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:37.051105 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076f683e-a1ff-45ae-a07c-05046a8db43d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:37.051884 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f683e-a1ff-45ae-a07c-05046a8db43d service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:37.052125 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f683e-a1ff-45ae-a07c-05046a8db43d service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:37.052406 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f683e-a1ff-45ae-a07c-05046a8db43d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:37.069457 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076f683e-a1ff-45ae-a07c-05046a8db43d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:37.070939 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076f683e-a1ff-45ae-a07c-05046a8db43d service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:37.082204 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1217/2441] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:04:37 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:04:37.283430 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a2cf9b-be53-45af-ac5e-48ca4b9e6421 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:37.285002 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-92a2cf9b-be53-45af-ac5e-48ca4b9e6421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:37.321182 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a2cf9b-be53-45af-ac5e-48ca4b9e6421 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:37.328010 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de59850f-e8f2-4549-a627-142b2f5f74b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:37.329150 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59850f-e8f2-4549-a627-142b2f5f74b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:37.331754 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59850f-e8f2-4549-a627-142b2f5f74b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:37.335700 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59850f-e8f2-4549-a627-142b2f5f74b5 admin admin] PATH_INFO: `/v3/projects/14dbbfb9f9ff412591de834421fa4027` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:37.338669 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de59850f-e8f2-4549-a627-142b2f5f74b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14dbbfb9f9ff412591de834421fa4027)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:37.340704 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de59850f-e8f2-4549-a627-142b2f5f74b5 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:37.393584 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-de59850f-e8f2-4549-a627-142b2f5f74b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14dbbfb9f9ff412591de834421fa4027', 'request_id': 'req-de59850f-e8f2-4549-a627-142b2f5f74b5'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:37.402693 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-de59850f-e8f2-4549-a627-142b2f5f74b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14dbbfb9f9ff412591de834421fa4027', 'request_id': 'req-de59850f-e8f2-4549-a627-142b2f5f74b5'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:37.410362 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-de59850f-e8f2-4549-a627-142b2f5f74b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14dbbfb9f9ff412591de834421fa4027', 'request_id': 'req-de59850f-e8f2-4549-a627-142b2f5f74b5'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:37.425552 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-de59850f-e8f2-4549-a627-142b2f5f74b5 admin admin] The token cache is being invalidate because project 14dbbfb9f9ff412591de834421fa4027 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:04:37.426113 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-de59850f-e8f2-4549-a627-142b2f5f74b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:37.427076 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-de59850f-e8f2-4549-a627-142b2f5f74b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:37.429231 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1225/2442] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:04:37 2021] DELETE /identity/v3/projects/14dbbfb9f9ff412591de834421fa4027 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:04:37.433157 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076f683e-a1ff-45ae-a07c-05046a8db43d service neutron] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:37.445230 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076f683e-a1ff-45ae-a07c-05046a8db43d service neutron] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:37.501338 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f5ed7e-e60a-4816-8b41-c4b026d7af7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:37.502308 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5ed7e-e60a-4816-8b41-c4b026d7af7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:37.502651 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5ed7e-e60a-4816-8b41-c4b026d7af7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:37.502998 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5ed7e-e60a-4816-8b41-c4b026d7af7a admin admin] PATH_INFO: `/v3/users/855ae88b7d734e44a26546813c949a9e` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:37.504615 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f5ed7e-e60a-4816-8b41-c4b026d7af7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=855ae88b7d734e44a26546813c949a9e)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:37.506610 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f5ed7e-e60a-4816-8b41-c4b026d7af7a admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:37.552676 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-35f5ed7e-e60a-4816-8b41-c4b026d7af7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '855ae88b7d734e44a26546813c949a9e'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:37.553354 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-35f5ed7e-e60a-4816-8b41-c4b026d7af7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '855ae88b7d734e44a26546813c949a9e'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:37.560270 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-35f5ed7e-e60a-4816-8b41-c4b026d7af7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '855ae88b7d734e44a26546813c949a9e'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:37.569686 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-35f5ed7e-e60a-4816-8b41-c4b026d7af7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '855ae88b7d734e44a26546813c949a9e'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:37.571872 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-35f5ed7e-e60a-4816-8b41-c4b026d7af7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '855ae88b7d734e44a26546813c949a9e'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:37.589783 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1218/2443] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:04:37 2021] DELETE /identity/v3/users/855ae88b7d734e44a26546813c949a9e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 05:04:37.934441 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de59850f-e8f2-4549-a627-142b2f5f74b5 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:37.936433 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-de59850f-e8f2-4549-a627-142b2f5f74b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:37.950898 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de59850f-e8f2-4549-a627-142b2f5f74b5 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:38.019690 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fceb50-1181-476d-acd7-b5509d9c2fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:38.020634 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fceb50-1181-476d-acd7-b5509d9c2fea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:38.020914 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fceb50-1181-476d-acd7-b5509d9c2fea admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:38.021189 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fceb50-1181-476d-acd7-b5509d9c2fea admin admin] PATH_INFO: `/v3/projects/71d146aaf6b841b58a60f1438af6749d` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:38.022679 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fceb50-1181-476d-acd7-b5509d9c2fea admin admin] RBAC: Authorizing `identity:delete_project(project_id=71d146aaf6b841b58a60f1438af6749d)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:38.024618 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fceb50-1181-476d-acd7-b5509d9c2fea admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:38.070375 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-14fceb50-1181-476d-acd7-b5509d9c2fea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71d146aaf6b841b58a60f1438af6749d', 'request_id': 'req-14fceb50-1181-476d-acd7-b5509d9c2fea'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:38.077641 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-14fceb50-1181-476d-acd7-b5509d9c2fea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71d146aaf6b841b58a60f1438af6749d', 'request_id': 'req-14fceb50-1181-476d-acd7-b5509d9c2fea'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:38.082753 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-14fceb50-1181-476d-acd7-b5509d9c2fea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71d146aaf6b841b58a60f1438af6749d', 'request_id': 'req-14fceb50-1181-476d-acd7-b5509d9c2fea'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:38.094046 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-14fceb50-1181-476d-acd7-b5509d9c2fea admin admin] The token cache is being invalidate because project 71d146aaf6b841b58a60f1438af6749d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:04:38.094323 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-14fceb50-1181-476d-acd7-b5509d9c2fea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:38.094986 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-14fceb50-1181-476d-acd7-b5509d9c2fea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:38.096564 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1226/2444] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:04:37 2021] DELETE /identity/v3/projects/71d146aaf6b841b58a60f1438af6749d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:04:38.100903 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f5ed7e-e60a-4816-8b41-c4b026d7af7a admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:38.102940 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-35f5ed7e-e60a-4816-8b41-c4b026d7af7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:38.115476 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f5ed7e-e60a-4816-8b41-c4b026d7af7a admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:38.174069 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a2208-1837-42f2-b3a7-6cdfeeaa3f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:38.174955 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a2208-1837-42f2-b3a7-6cdfeeaa3f80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:38.175230 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a2208-1837-42f2-b3a7-6cdfeeaa3f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:38.175497 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a2208-1837-42f2-b3a7-6cdfeeaa3f80 admin admin] PATH_INFO: `/v3/users/d7d9f8780811442f96bee9668370128b` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:38.176857 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a2208-1837-42f2-b3a7-6cdfeeaa3f80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7d9f8780811442f96bee9668370128b)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:38.178792 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a2208-1837-42f2-b3a7-6cdfeeaa3f80 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:38.230654 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-d30a2208-1837-42f2-b3a7-6cdfeeaa3f80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7d9f8780811442f96bee9668370128b'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:38.231249 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-d30a2208-1837-42f2-b3a7-6cdfeeaa3f80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7d9f8780811442f96bee9668370128b'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:38.237854 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-d30a2208-1837-42f2-b3a7-6cdfeeaa3f80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7d9f8780811442f96bee9668370128b'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:38.246283 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-d30a2208-1837-42f2-b3a7-6cdfeeaa3f80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7d9f8780811442f96bee9668370128b'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:38.246904 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-d30a2208-1837-42f2-b3a7-6cdfeeaa3f80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7d9f8780811442f96bee9668370128b'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:38.264595 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1219/2445] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:04:38 2021] DELETE /identity/v3/users/d7d9f8780811442f96bee9668370128b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:04:38.546015 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fceb50-1181-476d-acd7-b5509d9c2fea admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:38.547772 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-14fceb50-1181-476d-acd7-b5509d9c2fea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:38.564715 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fceb50-1181-476d-acd7-b5509d9c2fea admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:38.640380 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd64cab5-e547-4540-9ced-0d9348389cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:38.641378 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64cab5-e547-4540-9ced-0d9348389cbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:38.641724 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64cab5-e547-4540-9ced-0d9348389cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:38.642001 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64cab5-e547-4540-9ced-0d9348389cbd admin admin] PATH_INFO: `/v3/projects/8dc46d97433a404fb543419127996385` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:38.643313 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd64cab5-e547-4540-9ced-0d9348389cbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dc46d97433a404fb543419127996385)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:38.645275 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd64cab5-e547-4540-9ced-0d9348389cbd admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:38.692548 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-fd64cab5-e547-4540-9ced-0d9348389cbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dc46d97433a404fb543419127996385', 'request_id': 'req-fd64cab5-e547-4540-9ced-0d9348389cbd'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:38.700490 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-fd64cab5-e547-4540-9ced-0d9348389cbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dc46d97433a404fb543419127996385', 'request_id': 'req-fd64cab5-e547-4540-9ced-0d9348389cbd'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:38.706310 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-fd64cab5-e547-4540-9ced-0d9348389cbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dc46d97433a404fb543419127996385', 'request_id': 'req-fd64cab5-e547-4540-9ced-0d9348389cbd'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:38.718209 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-fd64cab5-e547-4540-9ced-0d9348389cbd admin admin] The token cache is being invalidate because project 8dc46d97433a404fb543419127996385 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:04:38.718710 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-fd64cab5-e547-4540-9ced-0d9348389cbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:38.719748 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-fd64cab5-e547-4540-9ced-0d9348389cbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:38.722409 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1227/2446] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:04:38 2021] DELETE /identity/v3/projects/8dc46d97433a404fb543419127996385 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:04:38.733454 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e89e0-bf74-4eae-9a11-6557c66ccc48 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:38.734239 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e89e0-bf74-4eae-9a11-6557c66ccc48 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:38.734393 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e89e0-bf74-4eae-9a11-6557c66ccc48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:38.758639 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-f78e89e0-bf74-4eae-9a11-6557c66ccc48 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:04:38.759805 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-f78e89e0-bf74-4eae-9a11-6557c66ccc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:38.831410 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1220/2447] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:04:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:04:38.843532 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc994f8-d438-4d24-bf1e-4b1531e0ff4f None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:38.844115 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc994f8-d438-4d24-bf1e-4b1531e0ff4f None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:38.844865 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc994f8-d438-4d24-bf1e-4b1531e0ff4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:38.873462 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-edc994f8-d438-4d24-bf1e-4b1531e0ff4f None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:04:38.874695 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-edc994f8-d438-4d24-bf1e-4b1531e0ff4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:38.883542 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1228/2448] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:04:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:04:38.890133 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e89e0-bf74-4eae-9a11-6557c66ccc48 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:38.904405 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e89e0-bf74-4eae-9a11-6557c66ccc48 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:38.909844 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdbab4c-dd16-4643-8898-42c2bdc88fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:38.910597 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdbab4c-dd16-4643-8898-42c2bdc88fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:38.910904 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdbab4c-dd16-4643-8898-42c2bdc88fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:38.911148 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdbab4c-dd16-4643-8898-42c2bdc88fa4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:38.911895 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdbab4c-dd16-4643-8898-42c2bdc88fa4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 05:04:38.912193 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdbab4c-dd16-4643-8898-42c2bdc88fa4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:38.913847 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdbab4c-dd16-4643-8898-42c2bdc88fa4 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:38.925265 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1221/2449] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 05:04:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 05:04:38.929633 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc994f8-d438-4d24-bf1e-4b1531e0ff4f None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:38.939333 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc994f8-d438-4d24-bf1e-4b1531e0ff4f None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:38.945599 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd979bb5-c821-4a98-ba14-81c4d06385aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:38.946272 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd979bb5-c821-4a98-ba14-81c4d06385aa admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:38.946554 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd979bb5-c821-4a98-ba14-81c4d06385aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:38.946818 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd979bb5-c821-4a98-ba14-81c4d06385aa admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:38.947538 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd979bb5-c821-4a98-ba14-81c4d06385aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:38.949591 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd979bb5-c821-4a98-ba14-81c4d06385aa admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:38.983879 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1229/2450] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:04:38 2021] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 05:04:38.985884 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdbab4c-dd16-4643-8898-42c2bdc88fa4 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:38.999896 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdbab4c-dd16-4643-8898-42c2bdc88fa4 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:39.060088 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf714a-4779-4815-9d17-15ff83ee93b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:39.060824 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf714a-4779-4815-9d17-15ff83ee93b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:39.061108 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf714a-4779-4815-9d17-15ff83ee93b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:39.061381 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf714a-4779-4815-9d17-15ff83ee93b8 admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:39.062115 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faf714a-4779-4815-9d17-15ff83ee93b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:39.064372 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faf714a-4779-4815-9d17-15ff83ee93b8 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:39.087349 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1222/2451] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:04:38 2021] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:04:39.092581 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd979bb5-c821-4a98-ba14-81c4d06385aa admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:39.104137 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd979bb5-c821-4a98-ba14-81c4d06385aa admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:39.109139 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b544c12-f68e-473b-970a-4653197b2fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:39.109812 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b544c12-f68e-473b-970a-4653197b2fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:39.110090 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b544c12-f68e-473b-970a-4653197b2fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:39.110360 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b544c12-f68e-473b-970a-4653197b2fe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:39.111143 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b544c12-f68e-473b-970a-4653197b2fe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:39.112780 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b544c12-f68e-473b-970a-4653197b2fe1 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:39.123186 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1230/2452] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:04:39 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:04:39.127131 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf714a-4779-4815-9d17-15ff83ee93b8 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:39.137308 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf714a-4779-4815-9d17-15ff83ee93b8 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:39.142068 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c04356-eb2f-4e05-91fa-69dd493aaf7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:39.142733 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c04356-eb2f-4e05-91fa-69dd493aaf7d admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:39.143010 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c04356-eb2f-4e05-91fa-69dd493aaf7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:39.143284 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c04356-eb2f-4e05-91fa-69dd493aaf7d admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:39.144063 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c04356-eb2f-4e05-91fa-69dd493aaf7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:39.145675 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c04356-eb2f-4e05-91fa-69dd493aaf7d admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:39.158665 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1223/2453] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:04:39 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:04:39.162746 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b544c12-f68e-473b-970a-4653197b2fe1 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:39.174056 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b544c12-f68e-473b-970a-4653197b2fe1 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:39.178674 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d4d11-4954-4c83-b6ab-66d5669c0e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:39.179544 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d4d11-4954-4c83-b6ab-66d5669c0e43 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:39.179822 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d4d11-4954-4c83-b6ab-66d5669c0e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:39.180093 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d4d11-4954-4c83-b6ab-66d5669c0e43 admin admin] PATH_INFO: `/v3/projects/94b0efa3b1b943729e07087056f4d018/users/102891de6687480e8239d1cb5fa9ccdf/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:39.195029 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d4d11-4954-4c83-b6ab-66d5669c0e43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94b0efa3b1b943729e07087056f4d018, user_id=102891de6687480e8239d1cb5fa9ccdf, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:39.197738 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d4d11-4954-4c83-b6ab-66d5669c0e43 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:39.212128 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1231/2454] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:04:39 2021] PUT /identity/v3/projects/94b0efa3b1b943729e07087056f4d018/users/102891de6687480e8239d1cb5fa9ccdf/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:04:39.230390 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56782b29-193d-4434-b226-d83c9ff014a0 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:39.230727 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56782b29-193d-4434-b226-d83c9ff014a0 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:39.231071 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56782b29-193d-4434-b226-d83c9ff014a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:39.258414 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-56782b29-193d-4434-b226-d83c9ff014a0 None None] MFA Rules not processed for user `102891de6687480e8239d1cb5fa9ccdf`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:04:39.259622 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-56782b29-193d-4434-b226-d83c9ff014a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:39.338666 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1224/2455] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:04:39 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:04:39.343409 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d4d11-4954-4c83-b6ab-66d5669c0e43 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:39.405687 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d4d11-4954-4c83-b6ab-66d5669c0e43 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:39.411284 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af9fb8-0da1-4c4d-87d5-50468e543d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:39.411936 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af9fb8-0da1-4c4d-87d5-50468e543d80 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:39.412214 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af9fb8-0da1-4c4d-87d5-50468e543d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:39.412495 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af9fb8-0da1-4c4d-87d5-50468e543d80 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:39.413230 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55af9fb8-0da1-4c4d-87d5-50468e543d80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:39.415148 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55af9fb8-0da1-4c4d-87d5-50468e543d80 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:39.443933 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1232/2456] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:04:39 2021] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:04:39.448096 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56782b29-193d-4434-b226-d83c9ff014a0 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:39.459863 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56782b29-193d-4434-b226-d83c9ff014a0 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:39.526280 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca294f-a7ae-4c35-9d8a-d5ef805b781e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:39.526944 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca294f-a7ae-4c35-9d8a-d5ef805b781e admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:39.527236 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca294f-a7ae-4c35-9d8a-d5ef805b781e admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:39.527490 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca294f-a7ae-4c35-9d8a-d5ef805b781e admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:39.528204 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdca294f-a7ae-4c35-9d8a-d5ef805b781e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:39.530235 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdca294f-a7ae-4c35-9d8a-d5ef805b781e admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:39.553475 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1225/2457] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:04:39 2021] POST /identity/v3/users => generated 290 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:04:39.557581 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af9fb8-0da1-4c4d-87d5-50468e543d80 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:39.569569 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af9fb8-0da1-4c4d-87d5-50468e543d80 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:39.575722 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd80f6f8-d112-4e35-9c2b-e2a38a161eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:39.576572 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80f6f8-d112-4e35-9c2b-e2a38a161eb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:39.576865 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80f6f8-d112-4e35-9c2b-e2a38a161eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:39.577134 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80f6f8-d112-4e35-9c2b-e2a38a161eb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:39.577876 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd80f6f8-d112-4e35-9c2b-e2a38a161eb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:39.579458 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd80f6f8-d112-4e35-9c2b-e2a38a161eb5 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:39.592938 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1233/2458] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:04:39 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:04:39.597189 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca294f-a7ae-4c35-9d8a-d5ef805b781e admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:39.607802 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca294f-a7ae-4c35-9d8a-d5ef805b781e admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:39.613632 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af9a6c-00a1-4122-901b-f722aa0d73f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:39.614285 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af9a6c-00a1-4122-901b-f722aa0d73f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:39.614563 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af9a6c-00a1-4122-901b-f722aa0d73f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:39.614840 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af9a6c-00a1-4122-901b-f722aa0d73f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:39.615579 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4af9a6c-00a1-4122-901b-f722aa0d73f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:39.617212 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4af9a6c-00a1-4122-901b-f722aa0d73f0 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:39.627750 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1226/2459] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:04:39 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:04:39.631973 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd80f6f8-d112-4e35-9c2b-e2a38a161eb5 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:39.643982 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd80f6f8-d112-4e35-9c2b-e2a38a161eb5 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:39.650096 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d4f21-0871-47cd-a6be-bbd27d78061d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:39.651001 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d4f21-0871-47cd-a6be-bbd27d78061d admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:39.651274 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d4f21-0871-47cd-a6be-bbd27d78061d admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:39.651541 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d4f21-0871-47cd-a6be-bbd27d78061d admin admin] PATH_INFO: `/v3/projects/cdf88440ef9d48faa4d040ef02c72e80/users/42d2bdb822284c5193891cfcb6a04a36/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:39.668303 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7d4f21-0871-47cd-a6be-bbd27d78061d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdf88440ef9d48faa4d040ef02c72e80, user_id=42d2bdb822284c5193891cfcb6a04a36, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:39.671391 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7d4f21-0871-47cd-a6be-bbd27d78061d admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:39.687143 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1234/2460] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:04:39 2021] PUT /identity/v3/projects/cdf88440ef9d48faa4d040ef02c72e80/users/42d2bdb822284c5193891cfcb6a04a36/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:04:39.697308 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c6216-0bac-48d5-b091-595ba1ad7660 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:39.697599 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c6216-0bac-48d5-b091-595ba1ad7660 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:39.697872 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c6216-0bac-48d5-b091-595ba1ad7660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:39.726642 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-842c6216-0bac-48d5-b091-595ba1ad7660 None None] MFA Rules not processed for user `42d2bdb822284c5193891cfcb6a04a36`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:04:39.727880 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-842c6216-0bac-48d5-b091-595ba1ad7660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:39.792518 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1227/2461] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:04:39 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:04:39.797118 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d4f21-0871-47cd-a6be-bbd27d78061d admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:39.859676 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d4f21-0871-47cd-a6be-bbd27d78061d admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:39.864740 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb77743-99a1-4aab-8855-445f7036214f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:39.865418 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb77743-99a1-4aab-8855-445f7036214f admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:39.865695 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb77743-99a1-4aab-8855-445f7036214f admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:39.865966 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb77743-99a1-4aab-8855-445f7036214f admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:39.866649 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb77743-99a1-4aab-8855-445f7036214f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:39.868757 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb77743-99a1-4aab-8855-445f7036214f admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:39.897483 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1235/2462] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:04:39 2021] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:04:39.901787 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842c6216-0bac-48d5-b091-595ba1ad7660 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:39.913085 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842c6216-0bac-48d5-b091-595ba1ad7660 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:39.972881 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c58d2-05ad-4584-bace-29fc95b9456d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:39.973542 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c58d2-05ad-4584-bace-29fc95b9456d admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:39.973822 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c58d2-05ad-4584-bace-29fc95b9456d admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:39.974094 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c58d2-05ad-4584-bace-29fc95b9456d admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:39.974838 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675c58d2-05ad-4584-bace-29fc95b9456d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:39.976784 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675c58d2-05ad-4584-bace-29fc95b9456d admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:39.999915 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1228/2463] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:04:39 2021] POST /identity/v3/users => generated 295 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:04:40.006487 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb77743-99a1-4aab-8855-445f7036214f admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:40.019620 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb77743-99a1-4aab-8855-445f7036214f admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:40.024627 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e648816-f8aa-4fa8-b419-b8fca03a6b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:40.025287 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e648816-f8aa-4fa8-b419-b8fca03a6b8c admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:40.025564 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e648816-f8aa-4fa8-b419-b8fca03a6b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:40.025834 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e648816-f8aa-4fa8-b419-b8fca03a6b8c admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:40.026576 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e648816-f8aa-4fa8-b419-b8fca03a6b8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:40.028173 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e648816-f8aa-4fa8-b419-b8fca03a6b8c admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:40.038553 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1236/2464] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:04:40 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:04:40.042727 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c58d2-05ad-4584-bace-29fc95b9456d admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:40.053135 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c58d2-05ad-4584-bace-29fc95b9456d admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:40.058152 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e81c0f-603f-4fd0-8415-62f47675fb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:40.059021 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e81c0f-603f-4fd0-8415-62f47675fb9a admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:40.059342 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e81c0f-603f-4fd0-8415-62f47675fb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:40.059593 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e81c0f-603f-4fd0-8415-62f47675fb9a admin admin] PATH_INFO: `/v3/projects/052dff1f296648fd8700c9e2e4077c63/users/21ece98b94004558982154326b3107a9/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:40.075856 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e81c0f-603f-4fd0-8415-62f47675fb9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=052dff1f296648fd8700c9e2e4077c63, user_id=21ece98b94004558982154326b3107a9, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:40.078568 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e81c0f-603f-4fd0-8415-62f47675fb9a admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:40.094050 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1229/2465] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:04:40 2021] PUT /identity/v3/projects/052dff1f296648fd8700c9e2e4077c63/users/21ece98b94004558982154326b3107a9/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:04:40.098138 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e648816-f8aa-4fa8-b419-b8fca03a6b8c admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:40.108608 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e648816-f8aa-4fa8-b419-b8fca03a6b8c admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:40.167317 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e96eb9-e888-4afe-a1cf-6ea97d522760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:40.168346 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e96eb9-e888-4afe-a1cf-6ea97d522760 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:40.168659 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e96eb9-e888-4afe-a1cf-6ea97d522760 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:40.168933 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e96eb9-e888-4afe-a1cf-6ea97d522760 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:40.169671 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e96eb9-e888-4afe-a1cf-6ea97d522760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:40.171775 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e96eb9-e888-4afe-a1cf-6ea97d522760 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:40.182586 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1237/2466] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:04:40 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:04:40.189403 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e81c0f-603f-4fd0-8415-62f47675fb9a admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:40.200086 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e81c0f-603f-4fd0-8415-62f47675fb9a admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:40.205759 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5cd1eb-c18c-4fb1-8e57-635429bd613f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:40.206650 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5cd1eb-c18c-4fb1-8e57-635429bd613f admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:40.206932 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5cd1eb-c18c-4fb1-8e57-635429bd613f admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:40.207205 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5cd1eb-c18c-4fb1-8e57-635429bd613f admin admin] PATH_INFO: `/v3/projects/052dff1f296648fd8700c9e2e4077c63/users/21ece98b94004558982154326b3107a9/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:40.209312 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5cd1eb-c18c-4fb1-8e57-635429bd613f admin admin] RBAC: Authorizing `identity:create_grant(project_id=052dff1f296648fd8700c9e2e4077c63, user_id=21ece98b94004558982154326b3107a9, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:40.212677 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5cd1eb-c18c-4fb1-8e57-635429bd613f admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:40.224327 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1230/2467] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:04:40 2021] PUT /identity/v3/projects/052dff1f296648fd8700c9e2e4077c63/users/21ece98b94004558982154326b3107a9/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:04:40.235275 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77717da-ecd2-4bb2-b328-74a448fa8980 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:40.235565 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77717da-ecd2-4bb2-b328-74a448fa8980 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:40.235843 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77717da-ecd2-4bb2-b328-74a448fa8980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:40.262753 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-d77717da-ecd2-4bb2-b328-74a448fa8980 None None] MFA Rules not processed for user `21ece98b94004558982154326b3107a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:04:40.263399 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-d77717da-ecd2-4bb2-b328-74a448fa8980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:40.338046 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1238/2468] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:04:40 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 05:04:40.349477 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5cd1eb-c18c-4fb1-8e57-635429bd613f admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:40.351381 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-ad5cd1eb-c18c-4fb1-8e57-635429bd613f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:40.407349 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5cd1eb-c18c-4fb1-8e57-635429bd613f admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:40.411287 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4209d6-f128-4052-847e-0d1d0ca485cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:40.411927 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4209d6-f128-4052-847e-0d1d0ca485cf service cinder] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:40.412200 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4209d6-f128-4052-847e-0d1d0ca485cf service cinder] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:40.412444 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4209d6-f128-4052-847e-0d1d0ca485cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:40.422506 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4209d6-f128-4052-847e-0d1d0ca485cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:40.424110 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4209d6-f128-4052-847e-0d1d0ca485cf service cinder] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:40.434452 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1231/2469] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:04:40 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:04:40.477190 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77717da-ecd2-4bb2-b328-74a448fa8980 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:40.478767 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-d77717da-ecd2-4bb2-b328-74a448fa8980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:40.491456 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77717da-ecd2-4bb2-b328-74a448fa8980 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:40.495305 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a9caa-1614-4851-ade7-bde0747aba12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:40.495940 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a9caa-1614-4851-ade7-bde0747aba12 service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:40.496222 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a9caa-1614-4851-ade7-bde0747aba12 service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:40.496497 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a9caa-1614-4851-ade7-bde0747aba12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:40.556316 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a9caa-1614-4851-ade7-bde0747aba12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:40.559045 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a9caa-1614-4851-ade7-bde0747aba12 service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:40.568819 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1239/2470] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:04:40 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 24 05:04:44.341033 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4209d6-f128-4052-847e-0d1d0ca485cf service cinder] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:44.342868 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-ee4209d6-f128-4052-847e-0d1d0ca485cf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:44.439777 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4209d6-f128-4052-847e-0d1d0ca485cf service cinder] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:44.445530 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd34b1-f3d7-407f-8ea5-714aab0e600d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:44.446789 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd34b1-f3d7-407f-8ea5-714aab0e600d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:44.447130 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd34b1-f3d7-407f-8ea5-714aab0e600d admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:44.447600 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd34b1-f3d7-407f-8ea5-714aab0e600d admin admin] PATH_INFO: `/v3/users/0e3f80aaeccd4b27b03686dd8fc1c854` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:44.449292 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcd34b1-f3d7-407f-8ea5-714aab0e600d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e3f80aaeccd4b27b03686dd8fc1c854)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:44.451599 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcd34b1-f3d7-407f-8ea5-714aab0e600d admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:44.510036 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-6fcd34b1-f3d7-407f-8ea5-714aab0e600d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e3f80aaeccd4b27b03686dd8fc1c854'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:44.510676 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-6fcd34b1-f3d7-407f-8ea5-714aab0e600d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e3f80aaeccd4b27b03686dd8fc1c854'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:44.517327 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-6fcd34b1-f3d7-407f-8ea5-714aab0e600d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e3f80aaeccd4b27b03686dd8fc1c854'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:44.526087 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-6fcd34b1-f3d7-407f-8ea5-714aab0e600d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e3f80aaeccd4b27b03686dd8fc1c854'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:44.527040 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-6fcd34b1-f3d7-407f-8ea5-714aab0e600d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e3f80aaeccd4b27b03686dd8fc1c854'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:44.549437 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1232/2471] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:04:44 2021] DELETE /identity/v3/users/0e3f80aaeccd4b27b03686dd8fc1c854 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:04:44.554377 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff210482-f93e-44c4-aa09-97d6f8220245 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:44.554965 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff210482-f93e-44c4-aa09-97d6f8220245 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:44.554965 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff210482-f93e-44c4-aa09-97d6f8220245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:44.572751 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-ff210482-f93e-44c4-aa09-97d6f8220245 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:04:44.573953 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-ff210482-f93e-44c4-aa09-97d6f8220245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:44.645360 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1240/2472] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:04:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:04:44.655765 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd34b1-f3d7-407f-8ea5-714aab0e600d admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:44.657407 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-6fcd34b1-f3d7-407f-8ea5-714aab0e600d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:44.720398 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd34b1-f3d7-407f-8ea5-714aab0e600d admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:44.726052 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac773724-ad18-48b9-a7a7-c6dcaa1d6acc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:44.726797 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac773724-ad18-48b9-a7a7-c6dcaa1d6acc service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:44.727087 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac773724-ad18-48b9-a7a7-c6dcaa1d6acc service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:44.727391 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac773724-ad18-48b9-a7a7-c6dcaa1d6acc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:44.739922 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac773724-ad18-48b9-a7a7-c6dcaa1d6acc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:44.742479 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac773724-ad18-48b9-a7a7-c6dcaa1d6acc service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:44.755376 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1233/2473] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:04:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 24 05:04:45.051186 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff210482-f93e-44c4-aa09-97d6f8220245 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:45.053564 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-ff210482-f93e-44c4-aa09-97d6f8220245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:45.071606 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff210482-f93e-44c4-aa09-97d6f8220245 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:45.076960 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b8a41-7e7c-403c-8377-eaea99b0b611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:45.077892 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b8a41-7e7c-403c-8377-eaea99b0b611 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:45.078456 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b8a41-7e7c-403c-8377-eaea99b0b611 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:45.078850 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b8a41-7e7c-403c-8377-eaea99b0b611 admin admin] PATH_INFO: `/v3/projects/d8349f37b35345c4a0e662431f5ddf08` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:45.080280 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b8a41-7e7c-403c-8377-eaea99b0b611 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8349f37b35345c4a0e662431f5ddf08)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:45.082355 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b8a41-7e7c-403c-8377-eaea99b0b611 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:45.131694 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-bf2b8a41-7e7c-403c-8377-eaea99b0b611 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8349f37b35345c4a0e662431f5ddf08', 'request_id': 'req-bf2b8a41-7e7c-403c-8377-eaea99b0b611'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:45.139879 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-bf2b8a41-7e7c-403c-8377-eaea99b0b611 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8349f37b35345c4a0e662431f5ddf08', 'request_id': 'req-bf2b8a41-7e7c-403c-8377-eaea99b0b611'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:45.145746 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-bf2b8a41-7e7c-403c-8377-eaea99b0b611 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8349f37b35345c4a0e662431f5ddf08', 'request_id': 'req-bf2b8a41-7e7c-403c-8377-eaea99b0b611'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:45.157183 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-bf2b8a41-7e7c-403c-8377-eaea99b0b611 admin admin] The token cache is being invalidate because project d8349f37b35345c4a0e662431f5ddf08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:04:45.157476 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-bf2b8a41-7e7c-403c-8377-eaea99b0b611 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:45.158155 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-bf2b8a41-7e7c-403c-8377-eaea99b0b611 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:45.170460 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1241/2474] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:04:45 2021] DELETE /identity/v3/projects/d8349f37b35345c4a0e662431f5ddf08 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 05:04:45.172005 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc28f2-2220-40e7-9663-3e117aee4132 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:45.172297 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc28f2-2220-40e7-9663-3e117aee4132 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:45.172631 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc28f2-2220-40e7-9663-3e117aee4132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:45.194519 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-d9bc28f2-2220-40e7-9663-3e117aee4132 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:04:45.195731 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-d9bc28f2-2220-40e7-9663-3e117aee4132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:45.258027 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1234/2475] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:04:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:04:45.266270 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c5a02-c230-498e-a314-c86efb969079 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:45.266593 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c5a02-c230-498e-a314-c86efb969079 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:45.266903 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c5a02-c230-498e-a314-c86efb969079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:45.286159 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-6d1c5a02-c230-498e-a314-c86efb969079 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:04:45.287378 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-6d1c5a02-c230-498e-a314-c86efb969079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:45.295382 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1242/2476] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:04:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:04:45.299652 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc28f2-2220-40e7-9663-3e117aee4132 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:45.309408 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc28f2-2220-40e7-9663-3e117aee4132 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:45.314737 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f6046a-631e-41d1-b7aa-2bfd95fd492d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:45.315602 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6046a-631e-41d1-b7aa-2bfd95fd492d admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:45.315888 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6046a-631e-41d1-b7aa-2bfd95fd492d admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:45.316167 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6046a-631e-41d1-b7aa-2bfd95fd492d admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:45.317006 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f6046a-631e-41d1-b7aa-2bfd95fd492d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 05:04:45.317312 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f6046a-631e-41d1-b7aa-2bfd95fd492d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:45.318934 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f6046a-631e-41d1-b7aa-2bfd95fd492d admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:45.331011 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1235/2477] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 05:04:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 05:04:45.335957 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1c5a02-c230-498e-a314-c86efb969079 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:45.345368 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1c5a02-c230-498e-a314-c86efb969079 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:45.350594 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e16667-ca27-46a5-b7a7-aa3fc98a390b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:45.351258 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e16667-ca27-46a5-b7a7-aa3fc98a390b admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:45.351537 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e16667-ca27-46a5-b7a7-aa3fc98a390b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:45.351814 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e16667-ca27-46a5-b7a7-aa3fc98a390b admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:45.352585 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e16667-ca27-46a5-b7a7-aa3fc98a390b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:45.354509 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e16667-ca27-46a5-b7a7-aa3fc98a390b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:45.381698 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1243/2478] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:04:45 2021] POST /identity/v3/projects => generated 399 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:04:45.385474 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f6046a-631e-41d1-b7aa-2bfd95fd492d admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:45.396354 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f6046a-631e-41d1-b7aa-2bfd95fd492d admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:45.453284 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6054d9e-3fe6-4d04-bce6-ca5040225cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:45.454003 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6054d9e-3fe6-4d04-bce6-ca5040225cf4 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:45.454279 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6054d9e-3fe6-4d04-bce6-ca5040225cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:45.454550 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6054d9e-3fe6-4d04-bce6-ca5040225cf4 admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:45.455462 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6054d9e-3fe6-4d04-bce6-ca5040225cf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:45.457470 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6054d9e-3fe6-4d04-bce6-ca5040225cf4 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:45.480181 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1236/2479] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:04:45 2021] POST /identity/v3/users => generated 300 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:04:45.484144 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e16667-ca27-46a5-b7a7-aa3fc98a390b admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:45.494959 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e16667-ca27-46a5-b7a7-aa3fc98a390b admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:45.501370 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21744fc6-d72e-409c-ac37-1bf4b7824493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:45.502733 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21744fc6-d72e-409c-ac37-1bf4b7824493 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:45.503166 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21744fc6-d72e-409c-ac37-1bf4b7824493 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:45.503370 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21744fc6-d72e-409c-ac37-1bf4b7824493 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:45.504858 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21744fc6-d72e-409c-ac37-1bf4b7824493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:45.506570 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21744fc6-d72e-409c-ac37-1bf4b7824493 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:45.518755 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1244/2480] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:04:45 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:04:45.522984 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6054d9e-3fe6-4d04-bce6-ca5040225cf4 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:45.536933 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6054d9e-3fe6-4d04-bce6-ca5040225cf4 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:45.543678 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a3879-88b6-4c90-97e1-81af9e5a6882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:45.544446 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a3879-88b6-4c90-97e1-81af9e5a6882 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:45.545297 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a3879-88b6-4c90-97e1-81af9e5a6882 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:45.545640 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a3879-88b6-4c90-97e1-81af9e5a6882 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:45.546605 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74a3879-88b6-4c90-97e1-81af9e5a6882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:45.548294 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74a3879-88b6-4c90-97e1-81af9e5a6882 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:45.559528 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1237/2481] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:04:45 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:04:45.563665 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21744fc6-d72e-409c-ac37-1bf4b7824493 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:45.574292 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21744fc6-d72e-409c-ac37-1bf4b7824493 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:45.576019 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a3879-88b6-4c90-97e1-81af9e5a6882 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:45.577787 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-f74a3879-88b6-4c90-97e1-81af9e5a6882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:45.579475 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8655c23e-1094-436b-82e7-ec11b9883f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:45.580512 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655c23e-1094-436b-82e7-ec11b9883f3d admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:45.581451 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655c23e-1094-436b-82e7-ec11b9883f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:45.581780 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655c23e-1094-436b-82e7-ec11b9883f3d admin admin] PATH_INFO: `/v3/projects/581598bc4d7e480daf6c17055df54a58/users/5637130adb534eb880791c3be08988d5/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:45.596556 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a3879-88b6-4c90-97e1-81af9e5a6882 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:45.601761 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c7d5a-5ac4-4c84-83c5-a06e0b4ced2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:45.602747 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c7d5a-5ac4-4c84-83c5-a06e0b4ced2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:45.603034 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c7d5a-5ac4-4c84-83c5-a06e0b4ced2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:45.603308 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c7d5a-5ac4-4c84-83c5-a06e0b4ced2b admin admin] PATH_INFO: `/v3/users/102891de6687480e8239d1cb5fa9ccdf` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:45.604569 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0c7d5a-5ac4-4c84-83c5-a06e0b4ced2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=102891de6687480e8239d1cb5fa9ccdf)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:45.606696 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0c7d5a-5ac4-4c84-83c5-a06e0b4ced2b admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:45.623553 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8655c23e-1094-436b-82e7-ec11b9883f3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=581598bc4d7e480daf6c17055df54a58, user_id=5637130adb534eb880791c3be08988d5, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:45.627161 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8655c23e-1094-436b-82e7-ec11b9883f3d admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:45.649056 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1245/2482] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:04:45 2021] PUT /identity/v3/projects/581598bc4d7e480daf6c17055df54a58/users/5637130adb534eb880791c3be08988d5/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:04:45.659464 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-df0c7d5a-5ac4-4c84-83c5-a06e0b4ced2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '102891de6687480e8239d1cb5fa9ccdf'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:45.660131 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-df0c7d5a-5ac4-4c84-83c5-a06e0b4ced2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '102891de6687480e8239d1cb5fa9ccdf'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:45.662044 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366053ae-9db4-41a7-9014-6977f7ab3934 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:45.663579 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366053ae-9db4-41a7-9014-6977f7ab3934 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:45.663964 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366053ae-9db4-41a7-9014-6977f7ab3934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:45.667564 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-df0c7d5a-5ac4-4c84-83c5-a06e0b4ced2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '102891de6687480e8239d1cb5fa9ccdf'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:45.680958 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-df0c7d5a-5ac4-4c84-83c5-a06e0b4ced2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '102891de6687480e8239d1cb5fa9ccdf'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:45.681685 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-df0c7d5a-5ac4-4c84-83c5-a06e0b4ced2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '102891de6687480e8239d1cb5fa9ccdf'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:45.702579 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1238/2483] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:04:45 2021] DELETE /identity/v3/users/102891de6687480e8239d1cb5fa9ccdf => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 05:04:45.705015 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-366053ae-9db4-41a7-9014-6977f7ab3934 None None] MFA Rules not processed for user `5637130adb534eb880791c3be08988d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:04:45.706456 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-366053ae-9db4-41a7-9014-6977f7ab3934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:45.707934 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506ff80-ea35-4956-96cc-7e36bd26b75d None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:45.708364 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506ff80-ea35-4956-96cc-7e36bd26b75d None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:45.708768 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506ff80-ea35-4956-96cc-7e36bd26b75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:45.742365 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-c506ff80-ea35-4956-96cc-7e36bd26b75d None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:04:45.743987 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-c506ff80-ea35-4956-96cc-7e36bd26b75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:45.792273 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1246/2484] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:04:45 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:04:45.802816 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366053ae-9db4-41a7-9014-6977f7ab3934 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:45.803677 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1239/2485] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:04:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:04:45.805107 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-366053ae-9db4-41a7-9014-6977f7ab3934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:45.813437 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c506ff80-ea35-4956-96cc-7e36bd26b75d None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:45.814889 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-c506ff80-ea35-4956-96cc-7e36bd26b75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:45.861903 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366053ae-9db4-41a7-9014-6977f7ab3934 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:45.866838 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8169aa-2e84-4bc2-8f22-b5698e022f40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:45.867758 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8169aa-2e84-4bc2-8f22-b5698e022f40 service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:45.868039 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8169aa-2e84-4bc2-8f22-b5698e022f40 service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:45.868313 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8169aa-2e84-4bc2-8f22-b5698e022f40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:45.874293 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c506ff80-ea35-4956-96cc-7e36bd26b75d None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:45.876956 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8169aa-2e84-4bc2-8f22-b5698e022f40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:45.878287 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097cf383-6c59-41ea-937a-40ca1385b99e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:45.878491 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8169aa-2e84-4bc2-8f22-b5698e022f40 service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:45.878929 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097cf383-6c59-41ea-937a-40ca1385b99e service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:45.879208 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097cf383-6c59-41ea-937a-40ca1385b99e service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:45.879477 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097cf383-6c59-41ea-937a-40ca1385b99e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:45.887164 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1247/2486] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:04:45 2021] GET /identity/v3/auth/tokens => generated 3266 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 24 05:04:45.888617 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097cf383-6c59-41ea-937a-40ca1385b99e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:45.890119 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097cf383-6c59-41ea-937a-40ca1385b99e service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:45.902350 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1240/2487] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:04:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 24 05:04:46.099753 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0afeabe-9dbe-4f86-a3c1-d5b539f96a6e None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:46.100048 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0afeabe-9dbe-4f86-a3c1-d5b539f96a6e None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:46.100322 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0afeabe-9dbe-4f86-a3c1-d5b539f96a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:46.122419 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-b0afeabe-9dbe-4f86-a3c1-d5b539f96a6e None None] MFA Rules not processed for user `3d0ee2c830754741b0f9eedabf6bded8`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:04:46.123659 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-b0afeabe-9dbe-4f86-a3c1-d5b539f96a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:46.183626 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1248/2488] 10.222.0.43 () {58 vars in 1009 bytes} [Fri Dec 24 05:04:46 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:04:46.200556 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097cf383-6c59-41ea-937a-40ca1385b99e service neutron] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:46.202064 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-097cf383-6c59-41ea-937a-40ca1385b99e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:46.281180 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097cf383-6c59-41ea-937a-40ca1385b99e service neutron] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:46.287022 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0afeabe-9dbe-4f86-a3c1-d5b539f96a6e None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:46.288057 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7427f5dc-d5f7-45da-8391-ae7c44742d5b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218ae7d29b71487d86b11aeb380788ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:46.288750 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7427f5dc-d5f7-45da-8391-ae7c44742d5b service swift] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:46.289030 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7427f5dc-d5f7-45da-8391-ae7c44742d5b service swift] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:46.289177 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-b0afeabe-9dbe-4f86-a3c1-d5b539f96a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:46.289316 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7427f5dc-d5f7-45da-8391-ae7c44742d5b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:46.299928 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7427f5dc-d5f7-45da-8391-ae7c44742d5b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:46.301650 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7427f5dc-d5f7-45da-8391-ae7c44742d5b service swift] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:46.310154 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0afeabe-9dbe-4f86-a3c1-d5b539f96a6e None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:46.318685 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1241/2489] 10.222.0.43 () {60 vars in 1384 bytes} [Fri Dec 24 05:04:46 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 24 05:04:46.318839 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4d120-3ba2-49b9-ba69-88936f2c630b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:46.321221 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4d120-3ba2-49b9-ba69-88936f2c630b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:46.322241 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4d120-3ba2-49b9-ba69-88936f2c630b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:46.322600 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4d120-3ba2-49b9-ba69-88936f2c630b admin admin] PATH_INFO: `/v3/projects/94b0efa3b1b943729e07087056f4d018` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:46.324520 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf4d120-3ba2-49b9-ba69-88936f2c630b admin admin] RBAC: Authorizing `identity:delete_project(project_id=94b0efa3b1b943729e07087056f4d018)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:46.327193 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf4d120-3ba2-49b9-ba69-88936f2c630b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:46.501562 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-7bf4d120-3ba2-49b9-ba69-88936f2c630b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94b0efa3b1b943729e07087056f4d018', 'request_id': 'req-7bf4d120-3ba2-49b9-ba69-88936f2c630b'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:46.513392 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-7bf4d120-3ba2-49b9-ba69-88936f2c630b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94b0efa3b1b943729e07087056f4d018', 'request_id': 'req-7bf4d120-3ba2-49b9-ba69-88936f2c630b'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:46.525443 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-7bf4d120-3ba2-49b9-ba69-88936f2c630b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94b0efa3b1b943729e07087056f4d018', 'request_id': 'req-7bf4d120-3ba2-49b9-ba69-88936f2c630b'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:46.544660 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-7bf4d120-3ba2-49b9-ba69-88936f2c630b admin admin] The token cache is being invalidate because project 94b0efa3b1b943729e07087056f4d018 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:04:46.545026 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-7bf4d120-3ba2-49b9-ba69-88936f2c630b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:46.545719 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-7bf4d120-3ba2-49b9-ba69-88936f2c630b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:46.547745 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1249/2490] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:04:46 2021] DELETE /identity/v3/projects/94b0efa3b1b943729e07087056f4d018 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 05:04:46.553118 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7427f5dc-d5f7-45da-8391-ae7c44742d5b service swift] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:46.567609 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7427f5dc-d5f7-45da-8391-ae7c44742d5b service swift] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:46.654221 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837bb2d-ebc7-4453-b43d-ce1f43b663e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:46.655825 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837bb2d-ebc7-4453-b43d-ce1f43b663e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:46.656323 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837bb2d-ebc7-4453-b43d-ce1f43b663e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:46.656820 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837bb2d-ebc7-4453-b43d-ce1f43b663e3 admin admin] PATH_INFO: `/v3/users/42d2bdb822284c5193891cfcb6a04a36` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:46.658806 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5837bb2d-ebc7-4453-b43d-ce1f43b663e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42d2bdb822284c5193891cfcb6a04a36)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:46.661630 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5837bb2d-ebc7-4453-b43d-ce1f43b663e3 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:46.720146 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-5837bb2d-ebc7-4453-b43d-ce1f43b663e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42d2bdb822284c5193891cfcb6a04a36'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:46.721241 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-5837bb2d-ebc7-4453-b43d-ce1f43b663e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42d2bdb822284c5193891cfcb6a04a36'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:46.732215 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-5837bb2d-ebc7-4453-b43d-ce1f43b663e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42d2bdb822284c5193891cfcb6a04a36'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:46.745489 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-5837bb2d-ebc7-4453-b43d-ce1f43b663e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42d2bdb822284c5193891cfcb6a04a36'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:46.746737 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-5837bb2d-ebc7-4453-b43d-ce1f43b663e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42d2bdb822284c5193891cfcb6a04a36'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:46.769806 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1242/2491] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:04:46 2021] DELETE /identity/v3/users/42d2bdb822284c5193891cfcb6a04a36 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:04:47.077248 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4d120-3ba2-49b9-ba69-88936f2c630b admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:47.078755 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-7bf4d120-3ba2-49b9-ba69-88936f2c630b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:47.101564 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4d120-3ba2-49b9-ba69-88936f2c630b admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:47.166503 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0fc20d-17df-4de7-927c-58622142df04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:47.167491 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0fc20d-17df-4de7-927c-58622142df04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:47.167689 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0fc20d-17df-4de7-927c-58622142df04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:47.167965 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0fc20d-17df-4de7-927c-58622142df04 admin admin] PATH_INFO: `/v3/projects/cdf88440ef9d48faa4d040ef02c72e80` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:47.171637 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0fc20d-17df-4de7-927c-58622142df04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdf88440ef9d48faa4d040ef02c72e80)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:47.171637 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0fc20d-17df-4de7-927c-58622142df04 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:47.172732 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837bb2d-ebc7-4453-b43d-ce1f43b663e3 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:47.175073 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-5837bb2d-ebc7-4453-b43d-ce1f43b663e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:47.188818 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837bb2d-ebc7-4453-b43d-ce1f43b663e3 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:47.193426 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab01d3c3-795c-4bfa-9133-9b9b9c596c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:47.194294 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01d3c3-795c-4bfa-9133-9b9b9c596c93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:47.194570 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01d3c3-795c-4bfa-9133-9b9b9c596c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:47.194838 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01d3c3-795c-4bfa-9133-9b9b9c596c93 admin admin] PATH_INFO: `/v3/users/ebb0a28447404fa0aa1b5c38c6555eea` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:47.196058 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab01d3c3-795c-4bfa-9133-9b9b9c596c93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebb0a28447404fa0aa1b5c38c6555eea)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:47.198068 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab01d3c3-795c-4bfa-9133-9b9b9c596c93 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:47.220073 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-1c0fc20d-17df-4de7-927c-58622142df04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdf88440ef9d48faa4d040ef02c72e80', 'request_id': 'req-1c0fc20d-17df-4de7-927c-58622142df04'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:47.227612 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-1c0fc20d-17df-4de7-927c-58622142df04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdf88440ef9d48faa4d040ef02c72e80', 'request_id': 'req-1c0fc20d-17df-4de7-927c-58622142df04'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:47.233291 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-1c0fc20d-17df-4de7-927c-58622142df04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdf88440ef9d48faa4d040ef02c72e80', 'request_id': 'req-1c0fc20d-17df-4de7-927c-58622142df04'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:47.244355 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-1c0fc20d-17df-4de7-927c-58622142df04 admin admin] The token cache is being invalidate because project cdf88440ef9d48faa4d040ef02c72e80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:04:47.244686 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-1c0fc20d-17df-4de7-927c-58622142df04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:47.245335 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-1c0fc20d-17df-4de7-927c-58622142df04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:47.245467 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-ab01d3c3-795c-4bfa-9133-9b9b9c596c93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebb0a28447404fa0aa1b5c38c6555eea'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:47.246109 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-ab01d3c3-795c-4bfa-9133-9b9b9c596c93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebb0a28447404fa0aa1b5c38c6555eea'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:47.246927 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1250/2492] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:04:47 2021] DELETE /identity/v3/projects/cdf88440ef9d48faa4d040ef02c72e80 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:04:47.250861 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0fc20d-17df-4de7-927c-58622142df04 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:47.252363 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-1c0fc20d-17df-4de7-927c-58622142df04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:47.254956 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-ab01d3c3-795c-4bfa-9133-9b9b9c596c93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebb0a28447404fa0aa1b5c38c6555eea'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:47.264327 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-ab01d3c3-795c-4bfa-9133-9b9b9c596c93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebb0a28447404fa0aa1b5c38c6555eea'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:47.264960 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-ab01d3c3-795c-4bfa-9133-9b9b9c596c93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebb0a28447404fa0aa1b5c38c6555eea'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:47.297674 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1243/2493] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:04:47 2021] DELETE /identity/v3/users/ebb0a28447404fa0aa1b5c38c6555eea => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:04:47.302233 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb51a91-6d54-4f34-b4cc-66849a31af84 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:47.302767 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb51a91-6d54-4f34-b4cc-66849a31af84 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:47.303197 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb51a91-6d54-4f34-b4cc-66849a31af84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:47.324227 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-7fb51a91-6d54-4f34-b4cc-66849a31af84 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:04:47.325804 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-7fb51a91-6d54-4f34-b4cc-66849a31af84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:47.343263 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0fc20d-17df-4de7-927c-58622142df04 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:47.384911 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1244/2494] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:04:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:04:47.395150 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb51a91-6d54-4f34-b4cc-66849a31af84 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:47.397363 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-7fb51a91-6d54-4f34-b4cc-66849a31af84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:47.401520 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1701e7b-bf92-46e6-b933-fa64f3457d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:47.408716 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1701e7b-bf92-46e6-b933-fa64f3457d0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:47.408716 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1701e7b-bf92-46e6-b933-fa64f3457d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:47.408716 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1701e7b-bf92-46e6-b933-fa64f3457d0b admin admin] PATH_INFO: `/v3/users/21ece98b94004558982154326b3107a9` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:47.408716 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1701e7b-bf92-46e6-b933-fa64f3457d0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=21ece98b94004558982154326b3107a9)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:47.408716 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1701e7b-bf92-46e6-b933-fa64f3457d0b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:47.480574 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb51a91-6d54-4f34-b4cc-66849a31af84 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:47.483259 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-e1701e7b-bf92-46e6-b933-fa64f3457d0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21ece98b94004558982154326b3107a9'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:47.483952 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-e1701e7b-bf92-46e6-b933-fa64f3457d0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21ece98b94004558982154326b3107a9'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:47.484702 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74825e1-6c19-4a60-b25b-cf15b09bc4fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:47.485338 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74825e1-6c19-4a60-b25b-cf15b09bc4fe service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:47.485629 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74825e1-6c19-4a60-b25b-cf15b09bc4fe service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:47.485904 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74825e1-6c19-4a60-b25b-cf15b09bc4fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:47.488823 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-e74825e1-6c19-4a60-b25b-cf15b09bc4fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:47.492347 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-e1701e7b-bf92-46e6-b933-fa64f3457d0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21ece98b94004558982154326b3107a9'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:47.502332 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-e1701e7b-bf92-46e6-b933-fa64f3457d0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21ece98b94004558982154326b3107a9'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:47.504179 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74825e1-6c19-4a60-b25b-cf15b09bc4fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:47.507220 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74825e1-6c19-4a60-b25b-cf15b09bc4fe service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:47.518756 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-e1701e7b-bf92-46e6-b933-fa64f3457d0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21ece98b94004558982154326b3107a9'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:47.520557 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1245/2495] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:04:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 24 05:04:47.536598 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1251/2496] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:04:47 2021] DELETE /identity/v3/users/21ece98b94004558982154326b3107a9 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 05:04:47.953069 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74825e1-6c19-4a60-b25b-cf15b09bc4fe service neutron] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:47.955428 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-e74825e1-6c19-4a60-b25b-cf15b09bc4fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:47.984472 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1701e7b-bf92-46e6-b933-fa64f3457d0b admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:47.986848 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-e1701e7b-bf92-46e6-b933-fa64f3457d0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:47.988245 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74825e1-6c19-4a60-b25b-cf15b09bc4fe service neutron] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:48.075837 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fce13a-3175-4b61-9f8a-c580683a292f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:48.076852 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fce13a-3175-4b61-9f8a-c580683a292f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:48.077203 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fce13a-3175-4b61-9f8a-c580683a292f admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:48.077549 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fce13a-3175-4b61-9f8a-c580683a292f admin admin] PATH_INFO: `/v3/projects/052dff1f296648fd8700c9e2e4077c63` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:48.078855 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fce13a-3175-4b61-9f8a-c580683a292f admin admin] RBAC: Authorizing `identity:delete_project(project_id=052dff1f296648fd8700c9e2e4077c63)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:48.080993 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fce13a-3175-4b61-9f8a-c580683a292f admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:48.087053 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1701e7b-bf92-46e6-b933-fa64f3457d0b admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:48.092053 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda7635-4eb7-49ea-93df-dd0ba53c34d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:48.093008 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda7635-4eb7-49ea-93df-dd0ba53c34d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:48.093290 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda7635-4eb7-49ea-93df-dd0ba53c34d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:48.093569 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda7635-4eb7-49ea-93df-dd0ba53c34d0 admin admin] PATH_INFO: `/v3/projects/8ddb1ed7045a4c87a30d01df75e67fe4` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:48.094815 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cda7635-4eb7-49ea-93df-dd0ba53c34d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ddb1ed7045a4c87a30d01df75e67fe4)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:48.096932 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cda7635-4eb7-49ea-93df-dd0ba53c34d0 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:48.148992 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-d6fce13a-3175-4b61-9f8a-c580683a292f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '052dff1f296648fd8700c9e2e4077c63', 'request_id': 'req-d6fce13a-3175-4b61-9f8a-c580683a292f'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:48.156454 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-d6fce13a-3175-4b61-9f8a-c580683a292f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '052dff1f296648fd8700c9e2e4077c63', 'request_id': 'req-d6fce13a-3175-4b61-9f8a-c580683a292f'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:48.157076 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-0cda7635-4eb7-49ea-93df-dd0ba53c34d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ddb1ed7045a4c87a30d01df75e67fe4', 'request_id': 'req-0cda7635-4eb7-49ea-93df-dd0ba53c34d0'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:48.162731 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-d6fce13a-3175-4b61-9f8a-c580683a292f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '052dff1f296648fd8700c9e2e4077c63', 'request_id': 'req-d6fce13a-3175-4b61-9f8a-c580683a292f'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:48.165346 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-0cda7635-4eb7-49ea-93df-dd0ba53c34d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ddb1ed7045a4c87a30d01df75e67fe4', 'request_id': 'req-0cda7635-4eb7-49ea-93df-dd0ba53c34d0'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:48.170707 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-0cda7635-4eb7-49ea-93df-dd0ba53c34d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ddb1ed7045a4c87a30d01df75e67fe4', 'request_id': 'req-0cda7635-4eb7-49ea-93df-dd0ba53c34d0'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:48.174521 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-d6fce13a-3175-4b61-9f8a-c580683a292f admin admin] The token cache is being invalidate because project 052dff1f296648fd8700c9e2e4077c63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:04:48.174808 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-d6fce13a-3175-4b61-9f8a-c580683a292f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:48.175452 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-d6fce13a-3175-4b61-9f8a-c580683a292f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:48.177371 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1246/2497] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:04:47 2021] DELETE /identity/v3/projects/052dff1f296648fd8700c9e2e4077c63 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:04:48.182689 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-0cda7635-4eb7-49ea-93df-dd0ba53c34d0 admin admin] The token cache is being invalidate because project 8ddb1ed7045a4c87a30d01df75e67fe4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:04:48.182689 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-0cda7635-4eb7-49ea-93df-dd0ba53c34d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:48.183021 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-0cda7635-4eb7-49ea-93df-dd0ba53c34d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:48.184599 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1252/2498] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:04:47 2021] DELETE /identity/v3/projects/8ddb1ed7045a4c87a30d01df75e67fe4 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:04:48.188136 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f56af-c651-4059-9913-0f90dc2beb50 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:48.188136 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f56af-c651-4059-9913-0f90dc2beb50 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:48.188136 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f56af-c651-4059-9913-0f90dc2beb50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:48.188922 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda7635-4eb7-49ea-93df-dd0ba53c34d0 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:48.190491 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-0cda7635-4eb7-49ea-93df-dd0ba53c34d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:48.205547 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-294f56af-c651-4059-9913-0f90dc2beb50 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:04:48.206830 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-294f56af-c651-4059-9913-0f90dc2beb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:48.252430 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda7635-4eb7-49ea-93df-dd0ba53c34d0 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:48.257115 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7400cced-968f-417f-bd4c-8c660a1f6da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:48.258010 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7400cced-968f-417f-bd4c-8c660a1f6da1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:48.258289 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7400cced-968f-417f-bd4c-8c660a1f6da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:48.258561 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7400cced-968f-417f-bd4c-8c660a1f6da1 admin admin] PATH_INFO: `/v3/users/640027e5867e47078f48dd51636effc9` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:48.259835 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7400cced-968f-417f-bd4c-8c660a1f6da1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=640027e5867e47078f48dd51636effc9)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:48.262299 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7400cced-968f-417f-bd4c-8c660a1f6da1 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:48.266931 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1247/2499] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:04:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 05:04:48.275501 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bde148-5062-4719-b46f-e7eeaa56bfa1 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:48.275886 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bde148-5062-4719-b46f-e7eeaa56bfa1 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:48.279491 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bde148-5062-4719-b46f-e7eeaa56bfa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:48.304203 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-97bde148-5062-4719-b46f-e7eeaa56bfa1 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:04:48.305665 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-97bde148-5062-4719-b46f-e7eeaa56bfa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:48.319975 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1248/2500] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:04:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 05:04:48.323957 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bde148-5062-4719-b46f-e7eeaa56bfa1 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:48.326419 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-7400cced-968f-417f-bd4c-8c660a1f6da1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '640027e5867e47078f48dd51636effc9'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:48.327030 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-7400cced-968f-417f-bd4c-8c660a1f6da1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '640027e5867e47078f48dd51636effc9'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:48.333308 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bde148-5062-4719-b46f-e7eeaa56bfa1 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:48.336152 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-7400cced-968f-417f-bd4c-8c660a1f6da1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '640027e5867e47078f48dd51636effc9'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:48.338378 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b38c352-9b52-4bc1-9209-d439101b7209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:48.339034 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b38c352-9b52-4bc1-9209-d439101b7209 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:48.339314 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b38c352-9b52-4bc1-9209-d439101b7209 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:48.339587 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b38c352-9b52-4bc1-9209-d439101b7209 admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:48.340334 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b38c352-9b52-4bc1-9209-d439101b7209 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 05:04:48.340685 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b38c352-9b52-4bc1-9209-d439101b7209 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:48.342314 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b38c352-9b52-4bc1-9209-d439101b7209 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:48.345374 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-7400cced-968f-417f-bd4c-8c660a1f6da1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '640027e5867e47078f48dd51636effc9'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:48.354688 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1249/2501] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 05:04:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 05:04:48.358808 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b38c352-9b52-4bc1-9209-d439101b7209 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:48.360620 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-2b38c352-9b52-4bc1-9209-d439101b7209 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:48.361676 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-7400cced-968f-417f-bd4c-8c660a1f6da1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '640027e5867e47078f48dd51636effc9'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:48.368409 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1253/2502] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:04:48 2021] DELETE /identity/v3/users/640027e5867e47078f48dd51636effc9 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:04:48.380084 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b38c352-9b52-4bc1-9209-d439101b7209 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:48.476703 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e870f4-c7b8-40e6-ac02-fa7066856da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:48.478166 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e870f4-c7b8-40e6-ac02-fa7066856da6 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:48.478454 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e870f4-c7b8-40e6-ac02-fa7066856da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:48.479041 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e870f4-c7b8-40e6-ac02-fa7066856da6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:48.480618 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e870f4-c7b8-40e6-ac02-fa7066856da6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:48.483664 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e870f4-c7b8-40e6-ac02-fa7066856da6 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:48.514187 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1250/2503] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:04:48 2021] POST /identity/v3/projects => generated 371 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:04:48.518424 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7400cced-968f-417f-bd4c-8c660a1f6da1 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:48.529141 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7400cced-968f-417f-bd4c-8c660a1f6da1 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:48.623729 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f82e5-6e46-408a-ae0f-8609fdb06ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:48.624429 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f82e5-6e46-408a-ae0f-8609fdb06ce9 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:48.624746 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f82e5-6e46-408a-ae0f-8609fdb06ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:48.625163 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f82e5-6e46-408a-ae0f-8609fdb06ce9 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:48.625919 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80f82e5-6e46-408a-ae0f-8609fdb06ce9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:48.628106 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80f82e5-6e46-408a-ae0f-8609fdb06ce9 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:48.667802 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1254/2504] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:04:48 2021] POST /identity/v3/users => generated 286 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 05:04:48.668780 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e870f4-c7b8-40e6-ac02-fa7066856da6 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:48.684423 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e870f4-c7b8-40e6-ac02-fa7066856da6 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:48.697289 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b8795-fc20-42c6-9c59-40b824d1925f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:48.697976 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b8795-fc20-42c6-9c59-40b824d1925f admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:48.698260 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b8795-fc20-42c6-9c59-40b824d1925f admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:48.698535 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b8795-fc20-42c6-9c59-40b824d1925f admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:48.699288 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82b8795-fc20-42c6-9c59-40b824d1925f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:48.701090 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82b8795-fc20-42c6-9c59-40b824d1925f admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:48.726016 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1251/2505] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:04:48 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:04:48.730533 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f82e5-6e46-408a-ae0f-8609fdb06ce9 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:48.743976 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f82e5-6e46-408a-ae0f-8609fdb06ce9 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:48.759593 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d10a5f-826b-451a-9608-4938096ca45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:48.760695 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d10a5f-826b-451a-9608-4938096ca45f admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:48.760968 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d10a5f-826b-451a-9608-4938096ca45f admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:48.761243 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d10a5f-826b-451a-9608-4938096ca45f admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:48.762057 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d10a5f-826b-451a-9608-4938096ca45f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:48.764020 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d10a5f-826b-451a-9608-4938096ca45f admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:48.788481 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1255/2506] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:04:48 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:04:48.789582 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b8795-fc20-42c6-9c59-40b824d1925f admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:48.801973 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b8795-fc20-42c6-9c59-40b824d1925f admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:48.825517 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5605fe-2f47-48d1-89f8-2d38deb36b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:48.826668 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5605fe-2f47-48d1-89f8-2d38deb36b6f admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:48.826997 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5605fe-2f47-48d1-89f8-2d38deb36b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:48.827276 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5605fe-2f47-48d1-89f8-2d38deb36b6f admin admin] PATH_INFO: `/v3/projects/31ca92c4af5e4e50862744de075270b0/users/f4c053d4149b40a68cf3e152c7414849/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:48.845567 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d10a5f-826b-451a-9608-4938096ca45f admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:48.848387 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-99d10a5f-826b-451a-9608-4938096ca45f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:48.890628 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5605fe-2f47-48d1-89f8-2d38deb36b6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=31ca92c4af5e4e50862744de075270b0, user_id=f4c053d4149b40a68cf3e152c7414849, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:48.900311 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d10a5f-826b-451a-9608-4938096ca45f admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:48.901651 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5605fe-2f47-48d1-89f8-2d38deb36b6f admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:48.914458 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa524a-47d7-4f56-8f78-e61d85b4c8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:48.915468 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa524a-47d7-4f56-8f78-e61d85b4c8cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:48.915816 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa524a-47d7-4f56-8f78-e61d85b4c8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:48.916180 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa524a-47d7-4f56-8f78-e61d85b4c8cf admin admin] PATH_INFO: `/v3/projects/059ea550185c4d8496de18d643d02f50` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:48.918142 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effa524a-47d7-4f56-8f78-e61d85b4c8cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=059ea550185c4d8496de18d643d02f50)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:48.920791 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effa524a-47d7-4f56-8f78-e61d85b4c8cf admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:48.940634 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1252/2507] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:04:48 2021] PUT /identity/v3/projects/31ca92c4af5e4e50862744de075270b0/users/f4c053d4149b40a68cf3e152c7414849/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:04:48.952590 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2d721-c634-4d93-88da-46c91234cde3 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:48.952884 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2d721-c634-4d93-88da-46c91234cde3 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:48.953159 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2d721-c634-4d93-88da-46c91234cde3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:49.008147 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-31e2d721-c634-4d93-88da-46c91234cde3 None None] MFA Rules not processed for user `f4c053d4149b40a68cf3e152c7414849`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:04:49.009977 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-31e2d721-c634-4d93-88da-46c91234cde3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:49.037963 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-effa524a-47d7-4f56-8f78-e61d85b4c8cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '059ea550185c4d8496de18d643d02f50', 'request_id': 'req-effa524a-47d7-4f56-8f78-e61d85b4c8cf'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:49.053094 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-effa524a-47d7-4f56-8f78-e61d85b4c8cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '059ea550185c4d8496de18d643d02f50', 'request_id': 'req-effa524a-47d7-4f56-8f78-e61d85b4c8cf'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:49.065449 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-effa524a-47d7-4f56-8f78-e61d85b4c8cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '059ea550185c4d8496de18d643d02f50', 'request_id': 'req-effa524a-47d7-4f56-8f78-e61d85b4c8cf'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:49.091663 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-effa524a-47d7-4f56-8f78-e61d85b4c8cf admin admin] The token cache is being invalidate because project 059ea550185c4d8496de18d643d02f50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:04:49.092916 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-effa524a-47d7-4f56-8f78-e61d85b4c8cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:49.094445 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-effa524a-47d7-4f56-8f78-e61d85b4c8cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:49.099367 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1256/2508] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:04:48 2021] DELETE /identity/v3/projects/059ea550185c4d8496de18d643d02f50 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:04:49.105125 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592b502-1856-4862-8ca1-fb1d6f34223d None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:49.105817 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592b502-1856-4862-8ca1-fb1d6f34223d None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:49.106257 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592b502-1856-4862-8ca1-fb1d6f34223d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:49.137498 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-3592b502-1856-4862-8ca1-fb1d6f34223d None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:04:49.138860 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-3592b502-1856-4862-8ca1-fb1d6f34223d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:49.143556 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1253/2509] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:04:48 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 05:04:49.158249 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e2d721-c634-4d93-88da-46c91234cde3 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:49.161114 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-31e2d721-c634-4d93-88da-46c91234cde3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:49.247467 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e2d721-c634-4d93-88da-46c91234cde3 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:49.253251 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1257/2510] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:04:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:04:49.260498 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4cb697-2a21-4b19-bd97-5e58839f631f None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:49.260817 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4cb697-2a21-4b19-bd97-5e58839f631f None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:49.261097 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4cb697-2a21-4b19-bd97-5e58839f631f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:49.279381 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-7b4cb697-2a21-4b19-bd97-5e58839f631f None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:04:49.280735 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-7b4cb697-2a21-4b19-bd97-5e58839f631f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:49.290868 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1258/2511] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:04:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 05:04:49.294767 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4cb697-2a21-4b19-bd97-5e58839f631f None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:49.298625 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa28e37a-af65-43fd-a98f-b92e12b46d9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:49.299284 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28e37a-af65-43fd-a98f-b92e12b46d9b service cinder] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:49.299560 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28e37a-af65-43fd-a98f-b92e12b46d9b service cinder] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:49.299830 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28e37a-af65-43fd-a98f-b92e12b46d9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:49.304013 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4cb697-2a21-4b19-bd97-5e58839f631f None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:49.309025 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b47a72e-6af6-4121-8495-262ab2632ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:49.309677 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47a72e-6af6-4121-8495-262ab2632ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:49.309960 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47a72e-6af6-4121-8495-262ab2632ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:49.310242 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47a72e-6af6-4121-8495-262ab2632ac0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:49.311016 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b47a72e-6af6-4121-8495-262ab2632ac0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 05:04:49.311377 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b47a72e-6af6-4121-8495-262ab2632ac0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:49.313001 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b47a72e-6af6-4121-8495-262ab2632ac0 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:49.324751 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1259/2512] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 05:04:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 05:04:49.329074 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b47a72e-6af6-4121-8495-262ab2632ac0 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:49.343880 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b47a72e-6af6-4121-8495-262ab2632ac0 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:49.349037 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b413a3d-9b16-410b-a2cb-5f6f8c4eab36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:49.349701 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b413a3d-9b16-410b-a2cb-5f6f8c4eab36 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:49.349980 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b413a3d-9b16-410b-a2cb-5f6f8c4eab36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:49.350254 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b413a3d-9b16-410b-a2cb-5f6f8c4eab36 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:49.350962 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b413a3d-9b16-410b-a2cb-5f6f8c4eab36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:49.353225 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b413a3d-9b16-410b-a2cb-5f6f8c4eab36 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:49.368752 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa28e37a-af65-43fd-a98f-b92e12b46d9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:49.370299 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa28e37a-af65-43fd-a98f-b92e12b46d9b service cinder] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:49.379544 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1254/2513] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:04:49 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:04:49.380091 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1260/2514] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:04:49 2021] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 05:04:49.384221 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa28e37a-af65-43fd-a98f-b92e12b46d9b service cinder] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:49.395455 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa28e37a-af65-43fd-a98f-b92e12b46d9b service cinder] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:49.409005 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b413a3d-9b16-410b-a2cb-5f6f8c4eab36 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:49.410635 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-2b413a3d-9b16-410b-a2cb-5f6f8c4eab36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:49.462553 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b358f11-deb9-4196-ac97-9dfd1c1fdc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:49.463235 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b358f11-deb9-4196-ac97-9dfd1c1fdc5f admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:49.463506 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b358f11-deb9-4196-ac97-9dfd1c1fdc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:49.463776 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b358f11-deb9-4196-ac97-9dfd1c1fdc5f admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:49.464492 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b358f11-deb9-4196-ac97-9dfd1c1fdc5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:49.466555 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b358f11-deb9-4196-ac97-9dfd1c1fdc5f admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:49.474778 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b413a3d-9b16-410b-a2cb-5f6f8c4eab36 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:49.480843 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a6a73-c165-4503-ac79-b4ae22207439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:49.481746 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a6a73-c165-4503-ac79-b4ae22207439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:49.482022 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a6a73-c165-4503-ac79-b4ae22207439 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:49.482302 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a6a73-c165-4503-ac79-b4ae22207439 admin admin] PATH_INFO: `/v3/users/f4c053d4149b40a68cf3e152c7414849` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:49.483628 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6a6a73-c165-4503-ac79-b4ae22207439 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4c053d4149b40a68cf3e152c7414849)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:49.485627 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6a6a73-c165-4503-ac79-b4ae22207439 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:49.488754 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1255/2515] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:04:49 2021] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:04:49.492794 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b358f11-deb9-4196-ac97-9dfd1c1fdc5f admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:49.502476 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b358f11-deb9-4196-ac97-9dfd1c1fdc5f admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:49.507185 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2487ffe6-007f-4522-8500-17ae44a83927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:49.507832 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487ffe6-007f-4522-8500-17ae44a83927 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:49.508115 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487ffe6-007f-4522-8500-17ae44a83927 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:49.508394 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487ffe6-007f-4522-8500-17ae44a83927 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:49.509200 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2487ffe6-007f-4522-8500-17ae44a83927 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:49.510816 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2487ffe6-007f-4522-8500-17ae44a83927 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:49.521627 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1256/2516] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:04:49 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:04:49.525472 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2487ffe6-007f-4522-8500-17ae44a83927 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:49.534187 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-cd6a6a73-c165-4503-ac79-b4ae22207439 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4c053d4149b40a68cf3e152c7414849'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:49.534893 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-cd6a6a73-c165-4503-ac79-b4ae22207439 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4c053d4149b40a68cf3e152c7414849'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:49.535515 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2487ffe6-007f-4522-8500-17ae44a83927 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:49.540190 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef4f4d-f8b9-49fd-afab-692456786fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:49.540911 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef4f4d-f8b9-49fd-afab-692456786fbd admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:49.541260 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef4f4d-f8b9-49fd-afab-692456786fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:49.541539 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef4f4d-f8b9-49fd-afab-692456786fbd admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:49.542317 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ef4f4d-f8b9-49fd-afab-692456786fbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:49.542954 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-cd6a6a73-c165-4503-ac79-b4ae22207439 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4c053d4149b40a68cf3e152c7414849'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:49.544010 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ef4f4d-f8b9-49fd-afab-692456786fbd admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:49.550045 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-cd6a6a73-c165-4503-ac79-b4ae22207439 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4c053d4149b40a68cf3e152c7414849'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:49.554506 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1257/2517] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:04:49 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 24 05:04:49.558617 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef4f4d-f8b9-49fd-afab-692456786fbd admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:49.560331 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-69ef4f4d-f8b9-49fd-afab-692456786fbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:49.562901 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-cd6a6a73-c165-4503-ac79-b4ae22207439 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4c053d4149b40a68cf3e152c7414849'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:49.569042 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1261/2518] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:04:49 2021] DELETE /identity/v3/users/f4c053d4149b40a68cf3e152c7414849 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 05:04:49.572720 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef4f4d-f8b9-49fd-afab-692456786fbd admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:49.573565 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6b66f-a4a9-4516-808f-036561f2c924 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:49.574029 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6b66f-a4a9-4516-808f-036561f2c924 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:49.574378 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6b66f-a4a9-4516-808f-036561f2c924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:49.592431 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-c6a6b66f-a4a9-4516-808f-036561f2c924 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:04:49.593679 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-c6a6b66f-a4a9-4516-808f-036561f2c924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:49.629324 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970283c-0a42-492b-bc1f-30e92ff428db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:49.630345 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970283c-0a42-492b-bc1f-30e92ff428db admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:49.630705 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970283c-0a42-492b-bc1f-30e92ff428db admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:49.630983 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970283c-0a42-492b-bc1f-30e92ff428db admin admin] PATH_INFO: `/v3/projects/480ff26f36fb43d1b248b431968dac6d/users/9e73ac5d81284e298d837ddddd3494fa/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:49.646030 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970283c-0a42-492b-bc1f-30e92ff428db admin admin] RBAC: Authorizing `identity:create_grant(project_id=480ff26f36fb43d1b248b431968dac6d, user_id=9e73ac5d81284e298d837ddddd3494fa, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:49.648722 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970283c-0a42-492b-bc1f-30e92ff428db admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:49.654083 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1262/2519] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:04:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:04:49.662808 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1258/2520] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:04:49 2021] PUT /identity/v3/projects/480ff26f36fb43d1b248b431968dac6d/users/9e73ac5d81284e298d837ddddd3494fa/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 05:04:49.673815 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a6b66f-a4a9-4516-808f-036561f2c924 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:49.675690 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-c6a6b66f-a4a9-4516-808f-036561f2c924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:49.678163 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51985d54-6b6a-4e49-b948-99b62ecb2235 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:49.678617 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51985d54-6b6a-4e49-b948-99b62ecb2235 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:49.679062 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51985d54-6b6a-4e49-b948-99b62ecb2235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:49.709504 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-51985d54-6b6a-4e49-b948-99b62ecb2235 None None] MFA Rules not processed for user `9e73ac5d81284e298d837ddddd3494fa`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:04:49.711232 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-51985d54-6b6a-4e49-b948-99b62ecb2235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:49.735736 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a6b66f-a4a9-4516-808f-036561f2c924 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:49.779216 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1259/2521] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:04:49 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:04:49.785805 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51985d54-6b6a-4e49-b948-99b62ecb2235 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:49.787668 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2dd5c-63c1-47db-9583-181a8c8a9108 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:49.788349 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2dd5c-63c1-47db-9583-181a8c8a9108 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:49.788658 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2dd5c-63c1-47db-9583-181a8c8a9108 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:49.788926 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2dd5c-63c1-47db-9583-181a8c8a9108 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:49.850169 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51985d54-6b6a-4e49-b948-99b62ecb2235 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:49.854695 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef2dd5c-63c1-47db-9583-181a8c8a9108 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:49.855355 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d3438f-6040-4748-8126-0b27a89a0264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:49.856137 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3438f-6040-4748-8126-0b27a89a0264 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:49.856249 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef2dd5c-63c1-47db-9583-181a8c8a9108 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:49.856733 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3438f-6040-4748-8126-0b27a89a0264 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:49.857356 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3438f-6040-4748-8126-0b27a89a0264 admin admin] PATH_INFO: `/v3/projects` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:49.858156 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d3438f-6040-4748-8126-0b27a89a0264 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:49.860175 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d3438f-6040-4748-8126-0b27a89a0264 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:49.867082 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1263/2522] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:04:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:04:49.903362 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1260/2523] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:04:49 2021] POST /identity/v3/projects => generated 387 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 05:04:49.905906 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2dd5c-63c1-47db-9583-181a8c8a9108 service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:49.921171 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2dd5c-63c1-47db-9583-181a8c8a9108 service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:50.059236 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a2430-a05d-41b0-886a-682f339039a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:50.060079 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a2430-a05d-41b0-886a-682f339039a6 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:50.060519 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a2430-a05d-41b0-886a-682f339039a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:50.060928 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a2430-a05d-41b0-886a-682f339039a6 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:50.061786 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1a2430-a05d-41b0-886a-682f339039a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:50.063916 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1a2430-a05d-41b0-886a-682f339039a6 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:50.091960 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1264/2524] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:04:49 2021] POST /identity/v3/users => generated 300 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:04:50.096363 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d3438f-6040-4748-8126-0b27a89a0264 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:50.118531 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d3438f-6040-4748-8126-0b27a89a0264 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:50.129157 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7f915-7e65-4563-9e90-57f278d9050e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:50.129928 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7f915-7e65-4563-9e90-57f278d9050e admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:50.130212 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7f915-7e65-4563-9e90-57f278d9050e admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:50.130507 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7f915-7e65-4563-9e90-57f278d9050e admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:50.131464 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc7f915-7e65-4563-9e90-57f278d9050e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:50.133128 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc7f915-7e65-4563-9e90-57f278d9050e admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:50.145056 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1261/2525] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:04:50 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:04:50.149322 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a2430-a05d-41b0-886a-682f339039a6 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:50.160818 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a2430-a05d-41b0-886a-682f339039a6 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:50.190731 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295bd49-837a-4dc6-86c1-f82bcad2e600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:50.191977 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295bd49-837a-4dc6-86c1-f82bcad2e600 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:50.197035 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295bd49-837a-4dc6-86c1-f82bcad2e600 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:50.197654 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295bd49-837a-4dc6-86c1-f82bcad2e600 admin admin] PATH_INFO: `/v3/projects/62dee193b02046ae99be1b2435f49125/users/78de6d545b9c44bda732956d7366568e/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:50.227083 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4295bd49-837a-4dc6-86c1-f82bcad2e600 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62dee193b02046ae99be1b2435f49125, user_id=78de6d545b9c44bda732956d7366568e, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:50.231006 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4295bd49-837a-4dc6-86c1-f82bcad2e600 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:50.248915 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1265/2526] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:04:50 2021] PUT /identity/v3/projects/62dee193b02046ae99be1b2435f49125/users/78de6d545b9c44bda732956d7366568e/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:04:50.253313 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7f915-7e65-4563-9e90-57f278d9050e admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:50.275364 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7f915-7e65-4563-9e90-57f278d9050e admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:50.352483 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295bd49-837a-4dc6-86c1-f82bcad2e600 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:50.355278 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-4295bd49-837a-4dc6-86c1-f82bcad2e600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:50.381905 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef193dde-c247-4d3f-8350-3b726a230198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:50.382596 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef193dde-c247-4d3f-8350-3b726a230198 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:50.382880 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef193dde-c247-4d3f-8350-3b726a230198 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:50.383170 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef193dde-c247-4d3f-8350-3b726a230198 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:50.383923 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef193dde-c247-4d3f-8350-3b726a230198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:50.385699 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef193dde-c247-4d3f-8350-3b726a230198 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:50.401325 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1262/2527] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:04:50 2021] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:04:50.406539 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef193dde-c247-4d3f-8350-3b726a230198 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:50.432408 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef193dde-c247-4d3f-8350-3b726a230198 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:50.438586 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c676b4-fe06-4c1b-86c4-4b302f88e5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:50.440149 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c676b4-fe06-4c1b-86c4-4b302f88e5aa admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:50.440882 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c676b4-fe06-4c1b-86c4-4b302f88e5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:50.441323 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c676b4-fe06-4c1b-86c4-4b302f88e5aa admin admin] PATH_INFO: `/v3/projects/62dee193b02046ae99be1b2435f49125/users/78de6d545b9c44bda732956d7366568e/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:50.443761 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c676b4-fe06-4c1b-86c4-4b302f88e5aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=62dee193b02046ae99be1b2435f49125, user_id=78de6d545b9c44bda732956d7366568e, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:50.446332 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c676b4-fe06-4c1b-86c4-4b302f88e5aa admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:50.458709 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295bd49-837a-4dc6-86c1-f82bcad2e600 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:50.460945 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1263/2528] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:04:50 2021] PUT /identity/v3/projects/62dee193b02046ae99be1b2435f49125/users/78de6d545b9c44bda732956d7366568e/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 05:04:50.474376 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283a6f2-ed27-4a63-8169-8c79d71f332d None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:50.474795 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283a6f2-ed27-4a63-8169-8c79d71f332d None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:50.475145 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283a6f2-ed27-4a63-8169-8c79d71f332d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:50.515946 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-8283a6f2-ed27-4a63-8169-8c79d71f332d None None] MFA Rules not processed for user `78de6d545b9c44bda732956d7366568e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:04:50.517370 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-8283a6f2-ed27-4a63-8169-8c79d71f332d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:50.553629 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9649a7-0a89-49a1-a5ac-afaaa9cdce1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:50.554563 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9649a7-0a89-49a1-a5ac-afaaa9cdce1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:50.554908 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9649a7-0a89-49a1-a5ac-afaaa9cdce1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:50.555180 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9649a7-0a89-49a1-a5ac-afaaa9cdce1b admin admin] PATH_INFO: `/v3/projects/31ca92c4af5e4e50862744de075270b0` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:50.560640 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9649a7-0a89-49a1-a5ac-afaaa9cdce1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=31ca92c4af5e4e50862744de075270b0)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:50.560640 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9649a7-0a89-49a1-a5ac-afaaa9cdce1b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:50.605768 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1264/2529] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:04:50 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:04:50.617768 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8283a6f2-ed27-4a63-8169-8c79d71f332d None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:50.620652 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-8283a6f2-ed27-4a63-8169-8c79d71f332d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:50.636761 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-2f9649a7-0a89-49a1-a5ac-afaaa9cdce1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31ca92c4af5e4e50862744de075270b0', 'request_id': 'req-2f9649a7-0a89-49a1-a5ac-afaaa9cdce1b'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:50.645416 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-2f9649a7-0a89-49a1-a5ac-afaaa9cdce1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31ca92c4af5e4e50862744de075270b0', 'request_id': 'req-2f9649a7-0a89-49a1-a5ac-afaaa9cdce1b'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:50.652036 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-2f9649a7-0a89-49a1-a5ac-afaaa9cdce1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31ca92c4af5e4e50862744de075270b0', 'request_id': 'req-2f9649a7-0a89-49a1-a5ac-afaaa9cdce1b'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:50.672813 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-2f9649a7-0a89-49a1-a5ac-afaaa9cdce1b admin admin] The token cache is being invalidate because project 31ca92c4af5e4e50862744de075270b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:04:50.673190 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-2f9649a7-0a89-49a1-a5ac-afaaa9cdce1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:50.673925 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-2f9649a7-0a89-49a1-a5ac-afaaa9cdce1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:50.677342 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1266/2530] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:04:50 2021] DELETE /identity/v3/projects/31ca92c4af5e4e50862744de075270b0 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:04:50.711745 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8283a6f2-ed27-4a63-8169-8c79d71f332d None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:50.773233 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce0bd0-3293-46b1-93aa-9e11f80526ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:50.773901 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce0bd0-3293-46b1-93aa-9e11f80526ea service cinder] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:50.774177 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce0bd0-3293-46b1-93aa-9e11f80526ea service cinder] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:50.774442 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce0bd0-3293-46b1-93aa-9e11f80526ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:50.776966 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-f0ce0bd0-3293-46b1-93aa-9e11f80526ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:50.861664 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ce0bd0-3293-46b1-93aa-9e11f80526ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:50.863466 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ce0bd0-3293-46b1-93aa-9e11f80526ea service cinder] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:50.874858 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1265/2531] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:04:50 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 24 05:04:50.918211 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9649a7-0a89-49a1-a5ac-afaaa9cdce1b admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:50.920010 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-2f9649a7-0a89-49a1-a5ac-afaaa9cdce1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:51.003086 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9649a7-0a89-49a1-a5ac-afaaa9cdce1b admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:51.008371 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1580df1a-c648-4fa7-ac84-7e39f5b8437d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:51.009306 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580df1a-c648-4fa7-ac84-7e39f5b8437d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:51.009668 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580df1a-c648-4fa7-ac84-7e39f5b8437d admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:51.009948 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580df1a-c648-4fa7-ac84-7e39f5b8437d admin admin] PATH_INFO: `/v3/users/9e73ac5d81284e298d837ddddd3494fa` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:51.011455 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1580df1a-c648-4fa7-ac84-7e39f5b8437d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e73ac5d81284e298d837ddddd3494fa)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:51.013445 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1580df1a-c648-4fa7-ac84-7e39f5b8437d admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:51.087809 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-1580df1a-c648-4fa7-ac84-7e39f5b8437d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e73ac5d81284e298d837ddddd3494fa'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:51.088488 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-1580df1a-c648-4fa7-ac84-7e39f5b8437d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e73ac5d81284e298d837ddddd3494fa'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:51.098572 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-1580df1a-c648-4fa7-ac84-7e39f5b8437d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e73ac5d81284e298d837ddddd3494fa'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:51.113619 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-1580df1a-c648-4fa7-ac84-7e39f5b8437d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e73ac5d81284e298d837ddddd3494fa'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:51.130827 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-1580df1a-c648-4fa7-ac84-7e39f5b8437d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e73ac5d81284e298d837ddddd3494fa'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:51.137379 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1267/2532] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:04:50 2021] DELETE /identity/v3/users/9e73ac5d81284e298d837ddddd3494fa => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:04:51.143114 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917ae8c-7069-475d-acfc-a41417c0f9e5 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:51.143926 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917ae8c-7069-475d-acfc-a41417c0f9e5 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:51.143926 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917ae8c-7069-475d-acfc-a41417c0f9e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:51.171404 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-3917ae8c-7069-475d-acfc-a41417c0f9e5 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:04:51.172832 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-3917ae8c-7069-475d-acfc-a41417c0f9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:51.247210 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1266/2533] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:04:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:04:51.258362 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1580df1a-c648-4fa7-ac84-7e39f5b8437d admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:51.259881 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-1580df1a-c648-4fa7-ac84-7e39f5b8437d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:51.331292 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1580df1a-c648-4fa7-ac84-7e39f5b8437d admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:51.335554 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fc526-7ccf-41df-a13a-61fd43e03068 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:51.336199 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fc526-7ccf-41df-a13a-61fd43e03068 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:51.336481 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fc526-7ccf-41df-a13a-61fd43e03068 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:51.336787 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fc526-7ccf-41df-a13a-61fd43e03068 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:51.347291 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11fc526-7ccf-41df-a13a-61fd43e03068 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:51.348753 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11fc526-7ccf-41df-a13a-61fd43e03068 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:51.358645 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1268/2534] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:04:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:04:51.717197 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3917ae8c-7069-475d-acfc-a41417c0f9e5 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:51.718651 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-3917ae8c-7069-475d-acfc-a41417c0f9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:51.733008 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3917ae8c-7069-475d-acfc-a41417c0f9e5 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:51.744962 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33cbc00-511e-4d20-8d68-6613821a580b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:51.745851 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33cbc00-511e-4d20-8d68-6613821a580b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:51.746128 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33cbc00-511e-4d20-8d68-6613821a580b admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:51.746400 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33cbc00-511e-4d20-8d68-6613821a580b admin admin] PATH_INFO: `/v3/projects/480ff26f36fb43d1b248b431968dac6d` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:51.747824 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33cbc00-511e-4d20-8d68-6613821a580b admin admin] RBAC: Authorizing `identity:delete_project(project_id=480ff26f36fb43d1b248b431968dac6d)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:51.749810 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33cbc00-511e-4d20-8d68-6613821a580b admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:51.804883 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-b33cbc00-511e-4d20-8d68-6613821a580b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '480ff26f36fb43d1b248b431968dac6d', 'request_id': 'req-b33cbc00-511e-4d20-8d68-6613821a580b'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:51.814455 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-b33cbc00-511e-4d20-8d68-6613821a580b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '480ff26f36fb43d1b248b431968dac6d', 'request_id': 'req-b33cbc00-511e-4d20-8d68-6613821a580b'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:51.820869 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-b33cbc00-511e-4d20-8d68-6613821a580b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '480ff26f36fb43d1b248b431968dac6d', 'request_id': 'req-b33cbc00-511e-4d20-8d68-6613821a580b'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:51.833831 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-b33cbc00-511e-4d20-8d68-6613821a580b admin admin] The token cache is being invalidate because project 480ff26f36fb43d1b248b431968dac6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:04:51.834279 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-b33cbc00-511e-4d20-8d68-6613821a580b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:51.835401 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-b33cbc00-511e-4d20-8d68-6613821a580b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:51.837332 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1267/2535] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:04:51 2021] DELETE /identity/v3/projects/480ff26f36fb43d1b248b431968dac6d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:04:51.841610 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fc526-7ccf-41df-a13a-61fd43e03068 service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:51.852641 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fc526-7ccf-41df-a13a-61fd43e03068 service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:51.908063 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3692e8c-d89d-41f9-b171-107daff59573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:51.909295 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3692e8c-d89d-41f9-b171-107daff59573 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:51.909593 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3692e8c-d89d-41f9-b171-107daff59573 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:51.909892 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3692e8c-d89d-41f9-b171-107daff59573 admin admin] PATH_INFO: `/v3/users/78de6d545b9c44bda732956d7366568e` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:51.911342 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3692e8c-d89d-41f9-b171-107daff59573 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78de6d545b9c44bda732956d7366568e)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:51.913305 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3692e8c-d89d-41f9-b171-107daff59573 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:51.964197 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-c3692e8c-d89d-41f9-b171-107daff59573 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78de6d545b9c44bda732956d7366568e'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:51.965064 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-c3692e8c-d89d-41f9-b171-107daff59573 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78de6d545b9c44bda732956d7366568e'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:51.974276 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-c3692e8c-d89d-41f9-b171-107daff59573 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78de6d545b9c44bda732956d7366568e'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:51.981715 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-c3692e8c-d89d-41f9-b171-107daff59573 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78de6d545b9c44bda732956d7366568e'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:51.994649 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-c3692e8c-d89d-41f9-b171-107daff59573 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78de6d545b9c44bda732956d7366568e'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:52.001384 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1269/2536] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:04:51 2021] DELETE /identity/v3/users/78de6d545b9c44bda732956d7366568e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:04:52.275504 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33cbc00-511e-4d20-8d68-6613821a580b admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:52.277099 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-b33cbc00-511e-4d20-8d68-6613821a580b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:52.293040 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33cbc00-511e-4d20-8d68-6613821a580b admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:52.360760 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757ae08-060e-48bb-b676-dc87b3337a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:52.361913 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757ae08-060e-48bb-b676-dc87b3337a91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:52.362305 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757ae08-060e-48bb-b676-dc87b3337a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:52.362612 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757ae08-060e-48bb-b676-dc87b3337a91 admin admin] PATH_INFO: `/v3/projects/62dee193b02046ae99be1b2435f49125` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:52.363822 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f757ae08-060e-48bb-b676-dc87b3337a91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62dee193b02046ae99be1b2435f49125)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:52.365777 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f757ae08-060e-48bb-b676-dc87b3337a91 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:52.412734 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-f757ae08-060e-48bb-b676-dc87b3337a91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62dee193b02046ae99be1b2435f49125', 'request_id': 'req-f757ae08-060e-48bb-b676-dc87b3337a91'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:52.423049 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-f757ae08-060e-48bb-b676-dc87b3337a91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62dee193b02046ae99be1b2435f49125', 'request_id': 'req-f757ae08-060e-48bb-b676-dc87b3337a91'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:52.429910 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-f757ae08-060e-48bb-b676-dc87b3337a91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62dee193b02046ae99be1b2435f49125', 'request_id': 'req-f757ae08-060e-48bb-b676-dc87b3337a91'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:52.442232 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-f757ae08-060e-48bb-b676-dc87b3337a91 admin admin] The token cache is being invalidate because project 62dee193b02046ae99be1b2435f49125 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:04:52.442606 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-f757ae08-060e-48bb-b676-dc87b3337a91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:52.443322 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-f757ae08-060e-48bb-b676-dc87b3337a91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:52.444974 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1268/2537] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:04:52 2021] DELETE /identity/v3/projects/62dee193b02046ae99be1b2435f49125 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 05:04:52.450842 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d7ea0-52e8-4f94-9369-d3039807a65f None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:52.451353 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d7ea0-52e8-4f94-9369-d3039807a65f None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:52.451498 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d7ea0-52e8-4f94-9369-d3039807a65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:52.469776 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-533d7ea0-52e8-4f94-9369-d3039807a65f None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:04:52.471285 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-533d7ea0-52e8-4f94-9369-d3039807a65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:52.535822 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1270/2538] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:04:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:04:52.544250 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5c264-515a-4a98-9b74-3d79a7336ba8 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:52.544615 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5c264-515a-4a98-9b74-3d79a7336ba8 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:52.544889 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5c264-515a-4a98-9b74-3d79a7336ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:52.566040 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-a8a5c264-515a-4a98-9b74-3d79a7336ba8 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:04:52.567410 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-a8a5c264-515a-4a98-9b74-3d79a7336ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:52.577853 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1269/2539] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:04:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:04:52.582198 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d7ea0-52e8-4f94-9369-d3039807a65f None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:52.593116 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d7ea0-52e8-4f94-9369-d3039807a65f None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:52.598059 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e060e02-927c-409b-bce1-352a0474f851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:52.598727 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e060e02-927c-409b-bce1-352a0474f851 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:52.598997 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e060e02-927c-409b-bce1-352a0474f851 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:52.599271 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e060e02-927c-409b-bce1-352a0474f851 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:52.600093 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e060e02-927c-409b-bce1-352a0474f851 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 05:04:52.600567 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e060e02-927c-409b-bce1-352a0474f851 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:52.602242 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e060e02-927c-409b-bce1-352a0474f851 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:52.618768 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1271/2540] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 05:04:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 05:04:52.623506 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a5c264-515a-4a98-9b74-3d79a7336ba8 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:52.634232 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a5c264-515a-4a98-9b74-3d79a7336ba8 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:52.640160 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a93959a-1f08-42da-be25-88a7ab1be76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:52.641304 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a93959a-1f08-42da-be25-88a7ab1be76b admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:52.641662 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a93959a-1f08-42da-be25-88a7ab1be76b admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:52.642518 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a93959a-1f08-42da-be25-88a7ab1be76b admin admin] PATH_INFO: `/v3/projects` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:52.644475 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a93959a-1f08-42da-be25-88a7ab1be76b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:52.647107 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a93959a-1f08-42da-be25-88a7ab1be76b admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:52.686301 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1270/2541] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:04:52 2021] POST /identity/v3/projects => generated 369 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:04:52.691105 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e060e02-927c-409b-bce1-352a0474f851 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:52.701703 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e060e02-927c-409b-bce1-352a0474f851 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:52.773405 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f224a7-1f66-4d28-bf30-8359cd297a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:52.774224 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f224a7-1f66-4d28-bf30-8359cd297a3b admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:52.774534 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f224a7-1f66-4d28-bf30-8359cd297a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:52.774809 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f224a7-1f66-4d28-bf30-8359cd297a3b admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:52.775554 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f224a7-1f66-4d28-bf30-8359cd297a3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:52.777535 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f224a7-1f66-4d28-bf30-8359cd297a3b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:52.802096 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1272/2542] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:04:52 2021] POST /identity/v3/users => generated 285 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:04:52.806427 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a93959a-1f08-42da-be25-88a7ab1be76b admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:52.819721 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a93959a-1f08-42da-be25-88a7ab1be76b admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:52.824803 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c4fc2-9874-4eff-b7c5-cc1b53f6dc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:52.825523 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c4fc2-9874-4eff-b7c5-cc1b53f6dc84 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:52.825798 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c4fc2-9874-4eff-b7c5-cc1b53f6dc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:52.826067 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c4fc2-9874-4eff-b7c5-cc1b53f6dc84 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:52.826823 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35c4fc2-9874-4eff-b7c5-cc1b53f6dc84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:52.828474 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35c4fc2-9874-4eff-b7c5-cc1b53f6dc84 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:52.840564 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1271/2543] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:04:52 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:04:52.844498 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f224a7-1f66-4d28-bf30-8359cd297a3b admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:52.856204 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f224a7-1f66-4d28-bf30-8359cd297a3b admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:52.861924 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a867e878-6e28-4e0a-9d3e-8fa26f85a3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:52.862336 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867e878-6e28-4e0a-9d3e-8fa26f85a3ba admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:52.862626 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867e878-6e28-4e0a-9d3e-8fa26f85a3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:52.862906 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867e878-6e28-4e0a-9d3e-8fa26f85a3ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:52.863680 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a867e878-6e28-4e0a-9d3e-8fa26f85a3ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:52.865478 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a867e878-6e28-4e0a-9d3e-8fa26f85a3ba admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:52.876138 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1273/2544] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:04:52 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:04:52.880594 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c4fc2-9874-4eff-b7c5-cc1b53f6dc84 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:52.891863 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c4fc2-9874-4eff-b7c5-cc1b53f6dc84 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:52.897686 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed66793-82ca-41f0-88c2-cd91fe6a0a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:52.898596 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed66793-82ca-41f0-88c2-cd91fe6a0a2b admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:52.898877 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed66793-82ca-41f0-88c2-cd91fe6a0a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:52.899152 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed66793-82ca-41f0-88c2-cd91fe6a0a2b admin admin] PATH_INFO: `/v3/projects/a5968fe3a7c34a8683d72c203e5f9ee8/users/916e2292171a414f801ee83af9cb9caa/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:52.914406 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed66793-82ca-41f0-88c2-cd91fe6a0a2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5968fe3a7c34a8683d72c203e5f9ee8, user_id=916e2292171a414f801ee83af9cb9caa, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:52.917574 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed66793-82ca-41f0-88c2-cd91fe6a0a2b admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:52.932497 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1272/2545] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:04:52 2021] PUT /identity/v3/projects/a5968fe3a7c34a8683d72c203e5f9ee8/users/916e2292171a414f801ee83af9cb9caa/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:04:52.937725 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3bc710-1bbc-4705-845a-a743000d8a60 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:52.938040 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3bc710-1bbc-4705-845a-a743000d8a60 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:52.938318 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3bc710-1bbc-4705-845a-a743000d8a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:52.956821 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-1f3bc710-1bbc-4705-845a-a743000d8a60 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:04:52.958045 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-1f3bc710-1bbc-4705-845a-a743000d8a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:53.021214 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1274/2546] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:04:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:04:53.031219 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed66793-82ca-41f0-88c2-cd91fe6a0a2b admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:53.033441 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-4ed66793-82ca-41f0-88c2-cd91fe6a0a2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:53.096849 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed66793-82ca-41f0-88c2-cd91fe6a0a2b admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:53.100792 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478342a2-51c8-4d76-ada1-b325889fa453 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:53.101434 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478342a2-51c8-4d76-ada1-b325889fa453 service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:53.101715 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478342a2-51c8-4d76-ada1-b325889fa453 service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:53.101992 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478342a2-51c8-4d76-ada1-b325889fa453 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:53.111660 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478342a2-51c8-4d76-ada1-b325889fa453 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:53.113191 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478342a2-51c8-4d76-ada1-b325889fa453 service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:53.123448 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1273/2547] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:04:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:04:53.814019 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65674c50-9f2c-4925-8f46-e055f40bdf22 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:53.815000 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65674c50-9f2c-4925-8f46-e055f40bdf22 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:53.815557 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65674c50-9f2c-4925-8f46-e055f40bdf22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:53.873700 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-65674c50-9f2c-4925-8f46-e055f40bdf22 None None] MFA Rules not processed for user `916e2292171a414f801ee83af9cb9caa`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:04:53.875642 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-65674c50-9f2c-4925-8f46-e055f40bdf22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:53.999990 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1275/2548] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:04:53 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:04:54.004257 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478342a2-51c8-4d76-ada1-b325889fa453 service neutron] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:54.015209 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478342a2-51c8-4d76-ada1-b325889fa453 service neutron] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:54.020425 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdf8625-8c8f-4ca7-94d8-9faa1a048fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:54.021129 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf8625-8c8f-4ca7-94d8-9faa1a048fde admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:54.021407 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf8625-8c8f-4ca7-94d8-9faa1a048fde admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:54.021678 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf8625-8c8f-4ca7-94d8-9faa1a048fde admin admin] PATH_INFO: `/v3/projects` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:54.022406 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdf8625-8c8f-4ca7-94d8-9faa1a048fde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:54.024343 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdf8625-8c8f-4ca7-94d8-9faa1a048fde admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:54.063582 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1274/2549] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:04:54 2021] POST /identity/v3/projects => generated 371 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:04:54.069748 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65674c50-9f2c-4925-8f46-e055f40bdf22 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:54.116587 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65674c50-9f2c-4925-8f46-e055f40bdf22 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:54.209729 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c798b6-b41c-4631-8469-f16cc39e87f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:54.210895 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c798b6-b41c-4631-8469-f16cc39e87f6 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:54.211262 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c798b6-b41c-4631-8469-f16cc39e87f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:54.211527 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c798b6-b41c-4631-8469-f16cc39e87f6 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:54.212244 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c798b6-b41c-4631-8469-f16cc39e87f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:54.214258 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c798b6-b41c-4631-8469-f16cc39e87f6 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:54.235068 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1276/2550] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:04:54 2021] POST /identity/v3/users => generated 292 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:04:54.239181 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdf8625-8c8f-4ca7-94d8-9faa1a048fde admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:54.249531 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdf8625-8c8f-4ca7-94d8-9faa1a048fde admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:54.254042 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b94e9ad-632b-400a-b92d-e0be3251ffcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:54.254677 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94e9ad-632b-400a-b92d-e0be3251ffcf admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:54.254954 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94e9ad-632b-400a-b92d-e0be3251ffcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:54.255221 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94e9ad-632b-400a-b92d-e0be3251ffcf admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:54.255983 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b94e9ad-632b-400a-b92d-e0be3251ffcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:54.257625 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b94e9ad-632b-400a-b92d-e0be3251ffcf admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:54.268283 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1275/2551] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:04:54 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:04:54.273076 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c798b6-b41c-4631-8469-f16cc39e87f6 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:54.288419 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c798b6-b41c-4631-8469-f16cc39e87f6 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:54.296984 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66739c34-5a50-45da-bedf-6e1b5dd177ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:54.298257 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66739c34-5a50-45da-bedf-6e1b5dd177ae admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:54.298656 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66739c34-5a50-45da-bedf-6e1b5dd177ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:54.299009 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66739c34-5a50-45da-bedf-6e1b5dd177ae admin admin] PATH_INFO: `/v3/projects/82613f7722894bd39bc3541c53541933/users/4c42f64d470642c494e7c30f2287a123/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:54.315488 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66739c34-5a50-45da-bedf-6e1b5dd177ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=82613f7722894bd39bc3541c53541933, user_id=4c42f64d470642c494e7c30f2287a123, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:54.318115 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66739c34-5a50-45da-bedf-6e1b5dd177ae admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:54.333008 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1277/2552] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:04:54 2021] PUT /identity/v3/projects/82613f7722894bd39bc3541c53541933/users/4c42f64d470642c494e7c30f2287a123/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:04:54.337281 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b94e9ad-632b-400a-b92d-e0be3251ffcf admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:54.347479 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b94e9ad-632b-400a-b92d-e0be3251ffcf admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:54.402859 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a7be71-f5d2-412b-bcd9-c4cb277519b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:54.403511 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7be71-f5d2-412b-bcd9-c4cb277519b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:54.403799 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7be71-f5d2-412b-bcd9-c4cb277519b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:54.404060 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7be71-f5d2-412b-bcd9-c4cb277519b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:54.404826 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a7be71-f5d2-412b-bcd9-c4cb277519b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:54.406582 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a7be71-f5d2-412b-bcd9-c4cb277519b9 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:54.417458 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1276/2553] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:04:54 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:04:54.422343 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66739c34-5a50-45da-bedf-6e1b5dd177ae admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:54.438134 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66739c34-5a50-45da-bedf-6e1b5dd177ae admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:54.443900 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f554c-dfce-4564-b5fe-054b12919c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:54.444811 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f554c-dfce-4564-b5fe-054b12919c3b admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:54.445090 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f554c-dfce-4564-b5fe-054b12919c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:54.445362 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f554c-dfce-4564-b5fe-054b12919c3b admin admin] PATH_INFO: `/v3/projects/82613f7722894bd39bc3541c53541933/users/4c42f64d470642c494e7c30f2287a123/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:54.447445 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30f554c-dfce-4564-b5fe-054b12919c3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=82613f7722894bd39bc3541c53541933, user_id=4c42f64d470642c494e7c30f2287a123, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:54.450137 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30f554c-dfce-4564-b5fe-054b12919c3b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:54.461631 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1278/2554] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:04:54 2021] PUT /identity/v3/projects/82613f7722894bd39bc3541c53541933/users/4c42f64d470642c494e7c30f2287a123/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:04:55.124050 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1e431-6d6b-49ca-abc8-0b3948418666 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:55.124966 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1e431-6d6b-49ca-abc8-0b3948418666 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:55.125263 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1e431-6d6b-49ca-abc8-0b3948418666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:55.153573 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-e8d1e431-6d6b-49ca-abc8-0b3948418666 None None] MFA Rules not processed for user `4c42f64d470642c494e7c30f2287a123`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:04:55.154846 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-e8d1e431-6d6b-49ca-abc8-0b3948418666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:55.254141 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1277/2555] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:04:55 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:04:55.264546 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f554c-dfce-4564-b5fe-054b12919c3b admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:55.266262 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-f30f554c-dfce-4564-b5fe-054b12919c3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:55.351200 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f554c-dfce-4564-b5fe-054b12919c3b admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:55.355132 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b234113c-2bb0-4290-a9d9-0cd68041da02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:55.355900 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234113c-2bb0-4290-a9d9-0cd68041da02 service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:55.356266 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234113c-2bb0-4290-a9d9-0cd68041da02 service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:55.356592 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234113c-2bb0-4290-a9d9-0cd68041da02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:55.417403 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b234113c-2bb0-4290-a9d9-0cd68041da02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:55.419194 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b234113c-2bb0-4290-a9d9-0cd68041da02 service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:55.429743 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1279/2556] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:04:55 2021] GET /identity/v3/auth/tokens => generated 3236 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:04:57.841929 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d1e431-6d6b-49ca-abc8-0b3948418666 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:57.844433 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-e8d1e431-6d6b-49ca-abc8-0b3948418666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:57.863784 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d1e431-6d6b-49ca-abc8-0b3948418666 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:57.868349 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a62a876-3144-4caf-bd1e-3a27ad87a2cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:57.869033 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62a876-3144-4caf-bd1e-3a27ad87a2cb service cinder] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:57.869314 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62a876-3144-4caf-bd1e-3a27ad87a2cb service cinder] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:57.869587 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62a876-3144-4caf-bd1e-3a27ad87a2cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:57.880771 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a62a876-3144-4caf-bd1e-3a27ad87a2cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:57.882701 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a62a876-3144-4caf-bd1e-3a27ad87a2cb service cinder] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:57.892697 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1278/2557] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:04:57 2021] GET /identity/v3/auth/tokens => generated 3305 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:04:59.580556 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b234113c-2bb0-4290-a9d9-0cd68041da02 service cinder] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:59.582311 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-b234113c-2bb0-4290-a9d9-0cd68041da02 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:59.654820 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b234113c-2bb0-4290-a9d9-0cd68041da02 service cinder] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:59.661122 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d1c476-0081-4199-bcbb-952e730fee14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:59.662065 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1c476-0081-4199-bcbb-952e730fee14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:59.662342 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1c476-0081-4199-bcbb-952e730fee14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:59.662614 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1c476-0081-4199-bcbb-952e730fee14 admin admin] PATH_INFO: `/v3/users/5637130adb534eb880791c3be08988d5` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:59.663908 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d1c476-0081-4199-bcbb-952e730fee14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5637130adb534eb880791c3be08988d5)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:59.665920 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d1c476-0081-4199-bcbb-952e730fee14 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:59.717549 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-60d1c476-0081-4199-bcbb-952e730fee14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5637130adb534eb880791c3be08988d5'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:59.718316 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-60d1c476-0081-4199-bcbb-952e730fee14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5637130adb534eb880791c3be08988d5'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:59.726685 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-60d1c476-0081-4199-bcbb-952e730fee14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5637130adb534eb880791c3be08988d5'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:59.733725 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-60d1c476-0081-4199-bcbb-952e730fee14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5637130adb534eb880791c3be08988d5'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:59.744772 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-60d1c476-0081-4199-bcbb-952e730fee14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5637130adb534eb880791c3be08988d5'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:04:59.750527 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1280/2558] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:04:59 2021] DELETE /identity/v3/users/5637130adb534eb880791c3be08988d5 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:04:59.755443 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f4827-c1ef-4994-af2a-123f4df0a146 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:59.756001 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f4827-c1ef-4994-af2a-123f4df0a146 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:59.756001 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f4827-c1ef-4994-af2a-123f4df0a146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:59.776866 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-c39f4827-c1ef-4994-af2a-123f4df0a146 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:04:59.778241 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-c39f4827-c1ef-4994-af2a-123f4df0a146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:59.845793 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1279/2559] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:04:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:04:59.856395 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d1c476-0081-4199-bcbb-952e730fee14 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:04:59.858000 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-60d1c476-0081-4199-bcbb-952e730fee14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:04:59.927519 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d1c476-0081-4199-bcbb-952e730fee14 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:04:59.931330 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e37a93-118a-4b08-93db-ce0f0b8bc273 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:04:59.931980 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e37a93-118a-4b08-93db-ce0f0b8bc273 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:04:59.932260 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e37a93-118a-4b08-93db-ce0f0b8bc273 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:04:59.932553 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e37a93-118a-4b08-93db-ce0f0b8bc273 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:04:59.942292 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e37a93-118a-4b08-93db-ce0f0b8bc273 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:04:59.943745 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e37a93-118a-4b08-93db-ce0f0b8bc273 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:04:59.953108 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1281/2560] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:04:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:05:00.246524 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f4827-c1ef-4994-af2a-123f4df0a146 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:05:00.248660 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-c39f4827-c1ef-4994-af2a-123f4df0a146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:05:00.264734 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f4827-c1ef-4994-af2a-123f4df0a146 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:05:00.269542 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe78f7e-645c-4ac5-8445-24ba1156460e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:05:00.270633 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe78f7e-645c-4ac5-8445-24ba1156460e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:05:00.270901 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe78f7e-645c-4ac5-8445-24ba1156460e admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:05:00.271350 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe78f7e-645c-4ac5-8445-24ba1156460e admin admin] PATH_INFO: `/v3/projects/581598bc4d7e480daf6c17055df54a58` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:05:00.273702 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe78f7e-645c-4ac5-8445-24ba1156460e admin admin] RBAC: Authorizing `identity:delete_project(project_id=581598bc4d7e480daf6c17055df54a58)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:05:00.276007 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe78f7e-645c-4ac5-8445-24ba1156460e admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:05:00.329849 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-0fe78f7e-645c-4ac5-8445-24ba1156460e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '581598bc4d7e480daf6c17055df54a58', 'request_id': 'req-0fe78f7e-645c-4ac5-8445-24ba1156460e'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:05:00.338893 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-0fe78f7e-645c-4ac5-8445-24ba1156460e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '581598bc4d7e480daf6c17055df54a58', 'request_id': 'req-0fe78f7e-645c-4ac5-8445-24ba1156460e'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:05:00.347227 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-0fe78f7e-645c-4ac5-8445-24ba1156460e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '581598bc4d7e480daf6c17055df54a58', 'request_id': 'req-0fe78f7e-645c-4ac5-8445-24ba1156460e'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:05:00.358497 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-0fe78f7e-645c-4ac5-8445-24ba1156460e admin admin] The token cache is being invalidate because project 581598bc4d7e480daf6c17055df54a58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:05:00.358797 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-0fe78f7e-645c-4ac5-8445-24ba1156460e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:05:00.359418 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-0fe78f7e-645c-4ac5-8445-24ba1156460e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:05:00.361224 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1280/2561] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:05:00 2021] DELETE /identity/v3/projects/581598bc4d7e480daf6c17055df54a58 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 05:05:11.228505 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e37a93-118a-4b08-93db-ce0f0b8bc273 service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:05:11.230164 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-c6e37a93-118a-4b08-93db-ce0f0b8bc273 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:05:11.244457 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e37a93-118a-4b08-93db-ce0f0b8bc273 service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:05:11.303920 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd9333-117a-4c96-8bf4-c682b211dde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:05:11.304759 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd9333-117a-4c96-8bf4-c682b211dde0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:05:11.305040 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd9333-117a-4c96-8bf4-c682b211dde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:05:11.305315 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd9333-117a-4c96-8bf4-c682b211dde0 admin admin] PATH_INFO: `/v3/users/916e2292171a414f801ee83af9cb9caa` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:05:11.306555 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bd9333-117a-4c96-8bf4-c682b211dde0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=916e2292171a414f801ee83af9cb9caa)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:05:11.308476 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bd9333-117a-4c96-8bf4-c682b211dde0 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:05:11.360033 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-d4bd9333-117a-4c96-8bf4-c682b211dde0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '916e2292171a414f801ee83af9cb9caa'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:05:11.360725 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-d4bd9333-117a-4c96-8bf4-c682b211dde0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '916e2292171a414f801ee83af9cb9caa'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:05:11.369959 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-d4bd9333-117a-4c96-8bf4-c682b211dde0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '916e2292171a414f801ee83af9cb9caa'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:05:11.377439 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-d4bd9333-117a-4c96-8bf4-c682b211dde0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '916e2292171a414f801ee83af9cb9caa'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:05:11.389518 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-d4bd9333-117a-4c96-8bf4-c682b211dde0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '916e2292171a414f801ee83af9cb9caa'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:05:11.395421 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1282/2562] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:05:11 2021] DELETE /identity/v3/users/916e2292171a414f801ee83af9cb9caa => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:05:11.582622 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe78f7e-645c-4ac5-8445-24ba1156460e admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:05:11.584374 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-0fe78f7e-645c-4ac5-8445-24ba1156460e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:05:11.599483 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe78f7e-645c-4ac5-8445-24ba1156460e admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:05:11.663852 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2f316-d394-47b2-bdb8-2d824cc3376b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:05:11.664738 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2f316-d394-47b2-bdb8-2d824cc3376b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:05:11.665009 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2f316-d394-47b2-bdb8-2d824cc3376b admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:05:11.665281 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2f316-d394-47b2-bdb8-2d824cc3376b admin admin] PATH_INFO: `/v3/projects/a5968fe3a7c34a8683d72c203e5f9ee8` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:05:11.666776 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba2f316-d394-47b2-bdb8-2d824cc3376b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5968fe3a7c34a8683d72c203e5f9ee8)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:05:11.668932 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba2f316-d394-47b2-bdb8-2d824cc3376b admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:05:11.719941 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-bba2f316-d394-47b2-bdb8-2d824cc3376b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5968fe3a7c34a8683d72c203e5f9ee8', 'request_id': 'req-bba2f316-d394-47b2-bdb8-2d824cc3376b'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:05:11.727789 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-bba2f316-d394-47b2-bdb8-2d824cc3376b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5968fe3a7c34a8683d72c203e5f9ee8', 'request_id': 'req-bba2f316-d394-47b2-bdb8-2d824cc3376b'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:05:11.734370 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-bba2f316-d394-47b2-bdb8-2d824cc3376b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5968fe3a7c34a8683d72c203e5f9ee8', 'request_id': 'req-bba2f316-d394-47b2-bdb8-2d824cc3376b'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:05:11.748028 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-bba2f316-d394-47b2-bdb8-2d824cc3376b admin admin] The token cache is being invalidate because project a5968fe3a7c34a8683d72c203e5f9ee8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:05:11.748339 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-bba2f316-d394-47b2-bdb8-2d824cc3376b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:05:11.748981 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-bba2f316-d394-47b2-bdb8-2d824cc3376b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:05:11.750549 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1281/2563] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:05:11 2021] DELETE /identity/v3/projects/a5968fe3a7c34a8683d72c203e5f9ee8 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:05:11.754509 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd9333-117a-4c96-8bf4-c682b211dde0 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:05:11.755967 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-d4bd9333-117a-4c96-8bf4-c682b211dde0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:05:11.768857 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd9333-117a-4c96-8bf4-c682b211dde0 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:05:11.825848 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a828410-2f3a-450f-a877-c54a92673ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:05:11.826634 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a828410-2f3a-450f-a877-c54a92673ea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:05:11.826911 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a828410-2f3a-450f-a877-c54a92673ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:05:11.827183 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a828410-2f3a-450f-a877-c54a92673ea9 admin admin] PATH_INFO: `/v3/users/4c42f64d470642c494e7c30f2287a123` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:05:11.828379 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a828410-2f3a-450f-a877-c54a92673ea9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c42f64d470642c494e7c30f2287a123)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:05:11.830406 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a828410-2f3a-450f-a877-c54a92673ea9 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:05:11.882171 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-4a828410-2f3a-450f-a877-c54a92673ea9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c42f64d470642c494e7c30f2287a123'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:05:11.882836 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-4a828410-2f3a-450f-a877-c54a92673ea9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c42f64d470642c494e7c30f2287a123'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:05:11.892818 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-4a828410-2f3a-450f-a877-c54a92673ea9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c42f64d470642c494e7c30f2287a123'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:05:11.901329 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-4a828410-2f3a-450f-a877-c54a92673ea9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c42f64d470642c494e7c30f2287a123'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:05:11.913695 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-4a828410-2f3a-450f-a877-c54a92673ea9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c42f64d470642c494e7c30f2287a123'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:05:11.920129 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1283/2564] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:05:11 2021] DELETE /identity/v3/users/4c42f64d470642c494e7c30f2287a123 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:05:12.282829 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2f316-d394-47b2-bdb8-2d824cc3376b admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:05:12.284487 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-bba2f316-d394-47b2-bdb8-2d824cc3376b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:05:12.301691 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2f316-d394-47b2-bdb8-2d824cc3376b admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:05:12.359085 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4099c8-200b-4503-a194-2b12b4c0dd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:05:12.359946 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4099c8-200b-4503-a194-2b12b4c0dd8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:05:12.360227 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4099c8-200b-4503-a194-2b12b4c0dd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:05:12.360503 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4099c8-200b-4503-a194-2b12b4c0dd8f admin admin] PATH_INFO: `/v3/projects/82613f7722894bd39bc3541c53541933` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:05:12.361721 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4099c8-200b-4503-a194-2b12b4c0dd8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=82613f7722894bd39bc3541c53541933)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:05:12.363642 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4099c8-200b-4503-a194-2b12b4c0dd8f admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:05:12.410684 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-0d4099c8-200b-4503-a194-2b12b4c0dd8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82613f7722894bd39bc3541c53541933', 'request_id': 'req-0d4099c8-200b-4503-a194-2b12b4c0dd8f'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:05:12.417940 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-0d4099c8-200b-4503-a194-2b12b4c0dd8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82613f7722894bd39bc3541c53541933', 'request_id': 'req-0d4099c8-200b-4503-a194-2b12b4c0dd8f'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:05:12.423594 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-0d4099c8-200b-4503-a194-2b12b4c0dd8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82613f7722894bd39bc3541c53541933', 'request_id': 'req-0d4099c8-200b-4503-a194-2b12b4c0dd8f'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:05:12.434386 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-0d4099c8-200b-4503-a194-2b12b4c0dd8f admin admin] The token cache is being invalidate because project 82613f7722894bd39bc3541c53541933 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:05:12.434670 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-0d4099c8-200b-4503-a194-2b12b4c0dd8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:05:12.435313 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-0d4099c8-200b-4503-a194-2b12b4c0dd8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:05:12.436917 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1282/2565] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:05:12 2021] DELETE /identity/v3/projects/82613f7722894bd39bc3541c53541933 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:05:12.442941 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6ca14-48f5-47a6-94f5-a1c1b7e02bee None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:05:12.443647 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6ca14-48f5-47a6-94f5-a1c1b7e02bee None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:05:12.443647 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6ca14-48f5-47a6-94f5-a1c1b7e02bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:05:12.464127 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-a6f6ca14-48f5-47a6-94f5-a1c1b7e02bee None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:05:12.465364 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-a6f6ca14-48f5-47a6-94f5-a1c1b7e02bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:05:12.522877 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1284/2566] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:05:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 05:05:12.535831 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01145a6-3071-446d-8fab-fec7e06dbcd7 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:05:12.536011 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01145a6-3071-446d-8fab-fec7e06dbcd7 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:05:12.536298 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01145a6-3071-446d-8fab-fec7e06dbcd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:05:12.558762 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-c01145a6-3071-446d-8fab-fec7e06dbcd7 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:05:12.560312 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-c01145a6-3071-446d-8fab-fec7e06dbcd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:05:12.568940 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1283/2567] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:05:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:05:12.573766 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f6ca14-48f5-47a6-94f5-a1c1b7e02bee None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:05:12.583474 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f6ca14-48f5-47a6-94f5-a1c1b7e02bee None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:05:12.589074 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99b0ce-5517-41f5-bae1-327984e704b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:05:12.589729 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99b0ce-5517-41f5-bae1-327984e704b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:05:12.590004 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99b0ce-5517-41f5-bae1-327984e704b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:05:12.590271 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99b0ce-5517-41f5-bae1-327984e704b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:05:12.591003 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb99b0ce-5517-41f5-bae1-327984e704b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 05:05:12.591345 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb99b0ce-5517-41f5-bae1-327984e704b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:05:12.592969 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb99b0ce-5517-41f5-bae1-327984e704b6 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:05:12.605125 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1285/2568] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 05:05:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 05:05:12.609620 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01145a6-3071-446d-8fab-fec7e06dbcd7 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:05:12.619632 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01145a6-3071-446d-8fab-fec7e06dbcd7 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:05:12.624827 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8beae4-a714-4581-9ca8-a7ff388a3744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:05:12.625550 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8beae4-a714-4581-9ca8-a7ff388a3744 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:05:12.625784 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8beae4-a714-4581-9ca8-a7ff388a3744 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:05:12.626043 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8beae4-a714-4581-9ca8-a7ff388a3744 admin admin] PATH_INFO: `/v3/projects` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:05:12.626755 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8beae4-a714-4581-9ca8-a7ff388a3744 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:05:12.628684 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8beae4-a714-4581-9ca8-a7ff388a3744 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:05:12.656000 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1284/2569] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:05:12 2021] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 05:05:12.660162 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99b0ce-5517-41f5-bae1-327984e704b6 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:05:12.670183 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99b0ce-5517-41f5-bae1-327984e704b6 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:05:12.728014 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967e7f0-42de-47e2-abc6-21712d2929ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:05:12.728777 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967e7f0-42de-47e2-abc6-21712d2929ca admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:05:12.729107 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967e7f0-42de-47e2-abc6-21712d2929ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:05:12.729381 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967e7f0-42de-47e2-abc6-21712d2929ca admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:05:12.730107 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d967e7f0-42de-47e2-abc6-21712d2929ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:05:12.732269 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d967e7f0-42de-47e2-abc6-21712d2929ca admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:05:12.754069 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1286/2570] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:05:12 2021] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:05:12.758236 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8beae4-a714-4581-9ca8-a7ff388a3744 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:05:12.770852 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8beae4-a714-4581-9ca8-a7ff388a3744 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:05:12.777079 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c89165-39fc-49f6-9bb2-2555b846c22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:05:12.777786 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c89165-39fc-49f6-9bb2-2555b846c22c admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:05:12.778050 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c89165-39fc-49f6-9bb2-2555b846c22c admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:05:12.778323 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c89165-39fc-49f6-9bb2-2555b846c22c admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:05:12.779129 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c89165-39fc-49f6-9bb2-2555b846c22c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:05:12.780778 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c89165-39fc-49f6-9bb2-2555b846c22c admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:05:12.792230 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1285/2571] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:05:12 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:05:12.796368 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967e7f0-42de-47e2-abc6-21712d2929ca admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:05:12.806856 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967e7f0-42de-47e2-abc6-21712d2929ca admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:05:12.812101 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c457a83-38f4-4250-bc9b-9996dfb91297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:05:12.812783 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c457a83-38f4-4250-bc9b-9996dfb91297 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:05:12.813060 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c457a83-38f4-4250-bc9b-9996dfb91297 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:05:12.813330 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c457a83-38f4-4250-bc9b-9996dfb91297 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:05:12.814045 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c457a83-38f4-4250-bc9b-9996dfb91297 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:05:12.815620 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c457a83-38f4-4250-bc9b-9996dfb91297 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:05:12.827362 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1287/2572] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:05:12 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:05:12.830189 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c89165-39fc-49f6-9bb2-2555b846c22c admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:05:12.840943 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c89165-39fc-49f6-9bb2-2555b846c22c admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:05:12.846066 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845787a4-5f10-4d11-8c85-a9ec9dd33de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:05:12.847041 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845787a4-5f10-4d11-8c85-a9ec9dd33de8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:05:12.847386 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845787a4-5f10-4d11-8c85-a9ec9dd33de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:05:12.847662 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845787a4-5f10-4d11-8c85-a9ec9dd33de8 admin admin] PATH_INFO: `/v3/projects/0c2e4d26df6942dc8eb2702d706f7230/users/7963b2337e7d4972a1fa689faa5f4d27/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:05:12.862693 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845787a4-5f10-4d11-8c85-a9ec9dd33de8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c2e4d26df6942dc8eb2702d706f7230, user_id=7963b2337e7d4972a1fa689faa5f4d27, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:05:12.865405 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845787a4-5f10-4d11-8c85-a9ec9dd33de8 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:05:12.879196 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1286/2573] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:05:12 2021] PUT /identity/v3/projects/0c2e4d26df6942dc8eb2702d706f7230/users/7963b2337e7d4972a1fa689faa5f4d27/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:05:12.889694 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5491e-5e41-4064-82ea-106ef16bf3cf None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:05:12.890111 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5491e-5e41-4064-82ea-106ef16bf3cf None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:05:12.890473 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5491e-5e41-4064-82ea-106ef16bf3cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:05:12.919259 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-33e5491e-5e41-4064-82ea-106ef16bf3cf None None] MFA Rules not processed for user `7963b2337e7d4972a1fa689faa5f4d27`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:05:12.920454 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-33e5491e-5e41-4064-82ea-106ef16bf3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:05:12.995327 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1288/2574] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:05:12 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:05:13.008805 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845787a4-5f10-4d11-8c85-a9ec9dd33de8 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:05:13.010661 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-845787a4-5f10-4d11-8c85-a9ec9dd33de8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:05:13.069617 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845787a4-5f10-4d11-8c85-a9ec9dd33de8 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:05:13.074120 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea833db0-86d8-4078-af30-ce339f0cd344 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1782324ce854868bd11b32bd24b435c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:05:13.074755 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea833db0-86d8-4078-af30-ce339f0cd344 service glance] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:05:13.075089 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea833db0-86d8-4078-af30-ce339f0cd344 service glance] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:05:13.075331 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea833db0-86d8-4078-af30-ce339f0cd344 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:05:13.084439 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea833db0-86d8-4078-af30-ce339f0cd344 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:05:13.086224 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea833db0-86d8-4078-af30-ce339f0cd344 service glance] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:05:13.095251 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1287/2575] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:05:13 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:05:24.590283 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5491e-5e41-4064-82ea-106ef16bf3cf None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:05:24.591925 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-33e5491e-5e41-4064-82ea-106ef16bf3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:05:24.671278 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5491e-5e41-4064-82ea-106ef16bf3cf None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:05:24.677030 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c2e9d-23f3-4150-8e93-e94506ba30c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f9ad1e8f8f74edcb44aabe17eb59648', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:05:24.677693 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c2e9d-23f3-4150-8e93-e94506ba30c5 service nova] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:05:24.677980 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c2e9d-23f3-4150-8e93-e94506ba30c5 service nova] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:05:24.678262 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c2e9d-23f3-4150-8e93-e94506ba30c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:05:24.680249 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-ae2c2e9d-23f3-4150-8e93-e94506ba30c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:05:24.693137 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2c2e9d-23f3-4150-8e93-e94506ba30c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:05:24.694735 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2c2e9d-23f3-4150-8e93-e94506ba30c5 service nova] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:05:24.706132 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1289/2576] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:05:24 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:05:27.058491 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ae32a-b937-48e7-8dc2-758b25c8800d None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:05:27.058986 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ae32a-b937-48e7-8dc2-758b25c8800d None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:05:27.059092 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ae32a-b937-48e7-8dc2-758b25c8800d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:05:27.077474 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-804ae32a-b937-48e7-8dc2-758b25c8800d None None] MFA Rules not processed for user `3d0ee2c830754741b0f9eedabf6bded8`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:05:27.078722 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-804ae32a-b937-48e7-8dc2-758b25c8800d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:05:27.147974 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1288/2577] 10.222.0.43 () {58 vars in 967 bytes} [Fri Dec 24 05:05:27 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:05:27.171690 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c2e9d-23f3-4150-8e93-e94506ba30c5 service nova] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:05:27.173174 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-ae2c2e9d-23f3-4150-8e93-e94506ba30c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:05:27.258484 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c2e9d-23f3-4150-8e93-e94506ba30c5 service nova] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:05:27.264277 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f45dd27-47a5-4977-8f8d-f3713a732106 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218ae7d29b71487d86b11aeb380788ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:05:27.265066 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f45dd27-47a5-4977-8f8d-f3713a732106 service swift] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:05:27.265431 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f45dd27-47a5-4977-8f8d-f3713a732106 service swift] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:05:27.265704 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f45dd27-47a5-4977-8f8d-f3713a732106 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:05:27.275224 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f45dd27-47a5-4977-8f8d-f3713a732106 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:05:27.276964 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f45dd27-47a5-4977-8f8d-f3713a732106 service swift] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:05:27.286033 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1290/2578] 10.222.0.43 () {60 vars in 1384 bytes} [Fri Dec 24 05:05:27 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 24 05:05:31.230590 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ae32a-b937-48e7-8dc2-758b25c8800d None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:05:31.244262 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ae32a-b937-48e7-8dc2-758b25c8800d None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:05:31.250908 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ea79d-e8d9-4b42-8aa7-682dedffe47f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f9ad1e8f8f74edcb44aabe17eb59648', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:05:31.251701 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ea79d-e8d9-4b42-8aa7-682dedffe47f service nova] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:05:31.252082 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ea79d-e8d9-4b42-8aa7-682dedffe47f service nova] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:05:31.252432 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ea79d-e8d9-4b42-8aa7-682dedffe47f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:05:31.254388 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-345ea79d-e8d9-4b42-8aa7-682dedffe47f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:05:31.269707 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345ea79d-e8d9-4b42-8aa7-682dedffe47f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:05:31.271417 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345ea79d-e8d9-4b42-8aa7-682dedffe47f service nova] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:05:31.282847 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1289/2579] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:05:31 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:05:53.983704 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f45dd27-47a5-4977-8f8d-f3713a732106 service swift] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:05:54.057363 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f45dd27-47a5-4977-8f8d-f3713a732106 service swift] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:05:54.063180 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a7afb-409b-48e9-86f0-5737dc197c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:05:54.064089 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a7afb-409b-48e9-86f0-5737dc197c7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:05:54.064463 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a7afb-409b-48e9-86f0-5737dc197c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:05:54.064776 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a7afb-409b-48e9-86f0-5737dc197c7e admin admin] PATH_INFO: `/v3/users/7963b2337e7d4972a1fa689faa5f4d27` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:05:54.066130 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991a7afb-409b-48e9-86f0-5737dc197c7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7963b2337e7d4972a1fa689faa5f4d27)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:05:54.068175 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991a7afb-409b-48e9-86f0-5737dc197c7e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:05:54.126223 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-991a7afb-409b-48e9-86f0-5737dc197c7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7963b2337e7d4972a1fa689faa5f4d27'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:05:54.127203 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-991a7afb-409b-48e9-86f0-5737dc197c7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7963b2337e7d4972a1fa689faa5f4d27'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:05:54.136763 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-991a7afb-409b-48e9-86f0-5737dc197c7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7963b2337e7d4972a1fa689faa5f4d27'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:05:54.146757 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-991a7afb-409b-48e9-86f0-5737dc197c7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7963b2337e7d4972a1fa689faa5f4d27'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:05:54.163809 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-991a7afb-409b-48e9-86f0-5737dc197c7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7963b2337e7d4972a1fa689faa5f4d27'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:05:54.169851 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1291/2580] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:05:53 2021] DELETE /identity/v3/users/7963b2337e7d4972a1fa689faa5f4d27 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:05:54.174690 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d333a5-3f1d-491b-b66e-1d58c25e872a None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:05:54.175181 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d333a5-3f1d-491b-b66e-1d58c25e872a None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:05:54.175292 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d333a5-3f1d-491b-b66e-1d58c25e872a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:05:54.193882 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-92d333a5-3f1d-491b-b66e-1d58c25e872a None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:05:54.195108 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-92d333a5-3f1d-491b-b66e-1d58c25e872a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:05:54.254600 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1290/2581] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:05:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:05:54.265264 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a7afb-409b-48e9-86f0-5737dc197c7e admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:05:54.266805 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-991a7afb-409b-48e9-86f0-5737dc197c7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:05:54.327985 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a7afb-409b-48e9-86f0-5737dc197c7e admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:05:54.332740 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a00062-3814-4641-a174-da620b264e93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:05:54.333394 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a00062-3814-4641-a174-da620b264e93 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:05:54.333674 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a00062-3814-4641-a174-da620b264e93 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:05:54.333935 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a00062-3814-4641-a174-da620b264e93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:05:54.344307 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a00062-3814-4641-a174-da620b264e93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:05:54.345878 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a00062-3814-4641-a174-da620b264e93 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:05:54.355488 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1292/2582] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:05:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:05:54.617922 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d333a5-3f1d-491b-b66e-1d58c25e872a None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:05:54.619454 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-92d333a5-3f1d-491b-b66e-1d58c25e872a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:05:54.632173 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d333a5-3f1d-491b-b66e-1d58c25e872a None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:05:54.638144 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc99ca9-9bc8-49d2-ad5f-d7e9ae857796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:05:54.640084 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc99ca9-9bc8-49d2-ad5f-d7e9ae857796 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:05:54.640371 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc99ca9-9bc8-49d2-ad5f-d7e9ae857796 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:05:54.640644 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc99ca9-9bc8-49d2-ad5f-d7e9ae857796 admin admin] PATH_INFO: `/v3/projects/0c2e4d26df6942dc8eb2702d706f7230` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:05:54.641991 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc99ca9-9bc8-49d2-ad5f-d7e9ae857796 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c2e4d26df6942dc8eb2702d706f7230)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:05:54.643907 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc99ca9-9bc8-49d2-ad5f-d7e9ae857796 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:05:54.693305 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-dcc99ca9-9bc8-49d2-ad5f-d7e9ae857796 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c2e4d26df6942dc8eb2702d706f7230', 'request_id': 'req-dcc99ca9-9bc8-49d2-ad5f-d7e9ae857796'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:05:54.702799 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-dcc99ca9-9bc8-49d2-ad5f-d7e9ae857796 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c2e4d26df6942dc8eb2702d706f7230', 'request_id': 'req-dcc99ca9-9bc8-49d2-ad5f-d7e9ae857796'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:05:54.710812 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-dcc99ca9-9bc8-49d2-ad5f-d7e9ae857796 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c2e4d26df6942dc8eb2702d706f7230', 'request_id': 'req-dcc99ca9-9bc8-49d2-ad5f-d7e9ae857796'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:05:54.721840 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-dcc99ca9-9bc8-49d2-ad5f-d7e9ae857796 admin admin] The token cache is being invalidate because project 0c2e4d26df6942dc8eb2702d706f7230 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:05:54.722142 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-dcc99ca9-9bc8-49d2-ad5f-d7e9ae857796 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:05:54.722975 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-dcc99ca9-9bc8-49d2-ad5f-d7e9ae857796 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:05:54.724746 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1291/2583] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:05:54 2021] DELETE /identity/v3/projects/0c2e4d26df6942dc8eb2702d706f7230 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:05:54.730895 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23b0a4-c1a3-4d37-9d02-dcf49a70e76f None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:05:54.731181 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23b0a4-c1a3-4d37-9d02-dcf49a70e76f None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:05:54.731452 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23b0a4-c1a3-4d37-9d02-dcf49a70e76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:05:54.749589 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-2d23b0a4-c1a3-4d37-9d02-dcf49a70e76f None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:05:54.750806 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-2d23b0a4-c1a3-4d37-9d02-dcf49a70e76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:05:54.819272 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1293/2584] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:05:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:05:54.828217 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e8776-648b-47e9-9fca-783b379b760a None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:05:54.828504 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e8776-648b-47e9-9fca-783b379b760a None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:05:54.828816 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e8776-648b-47e9-9fca-783b379b760a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:05:54.848342 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-be8e8776-648b-47e9-9fca-783b379b760a None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:05:54.849573 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-be8e8776-648b-47e9-9fca-783b379b760a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:05:54.858435 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1292/2585] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:05:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:05:54.863213 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23b0a4-c1a3-4d37-9d02-dcf49a70e76f None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:05:54.878155 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23b0a4-c1a3-4d37-9d02-dcf49a70e76f None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:05:54.886548 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f2414-8765-4322-a24c-00d77a5a8055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:05:54.887191 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f2414-8765-4322-a24c-00d77a5a8055 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:05:54.887467 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f2414-8765-4322-a24c-00d77a5a8055 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:05:54.887734 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f2414-8765-4322-a24c-00d77a5a8055 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:05:54.888506 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f2414-8765-4322-a24c-00d77a5a8055 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 05:05:54.888821 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f2414-8765-4322-a24c-00d77a5a8055 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:05:54.890420 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f2414-8765-4322-a24c-00d77a5a8055 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:05:54.902487 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1294/2586] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 05:05:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 05:05:54.906949 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e8776-648b-47e9-9fca-783b379b760a None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:05:54.916292 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e8776-648b-47e9-9fca-783b379b760a None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:05:54.922619 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb5c2f-8992-42c1-8a8d-495fbc70a2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:05:54.923266 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb5c2f-8992-42c1-8a8d-495fbc70a2a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:05:54.923545 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb5c2f-8992-42c1-8a8d-495fbc70a2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:05:54.923809 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb5c2f-8992-42c1-8a8d-495fbc70a2a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:05:54.924559 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fb5c2f-8992-42c1-8a8d-495fbc70a2a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:05:54.926520 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fb5c2f-8992-42c1-8a8d-495fbc70a2a8 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:05:54.965498 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1293/2587] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:05:54 2021] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:05:54.969489 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f2414-8765-4322-a24c-00d77a5a8055 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:05:54.979696 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f2414-8765-4322-a24c-00d77a5a8055 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:05:55.040667 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d22833f-e6c4-4fbd-b94e-cb742aa649ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:05:55.041338 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22833f-e6c4-4fbd-b94e-cb742aa649ba admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:05:55.041615 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22833f-e6c4-4fbd-b94e-cb742aa649ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:05:55.041878 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22833f-e6c4-4fbd-b94e-cb742aa649ba admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:05:55.042760 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d22833f-e6c4-4fbd-b94e-cb742aa649ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:05:55.044709 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d22833f-e6c4-4fbd-b94e-cb742aa649ba admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:05:55.065099 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1295/2588] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:05:54 2021] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 05:05:55.070800 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb5c2f-8992-42c1-8a8d-495fbc70a2a8 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:05:55.082872 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb5c2f-8992-42c1-8a8d-495fbc70a2a8 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:05:55.090554 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae750f3a-7daf-4a47-a020-15992fb1a12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:05:55.091239 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae750f3a-7daf-4a47-a020-15992fb1a12c admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:05:55.091503 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae750f3a-7daf-4a47-a020-15992fb1a12c admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:05:55.091772 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae750f3a-7daf-4a47-a020-15992fb1a12c admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:05:55.092557 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae750f3a-7daf-4a47-a020-15992fb1a12c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:05:55.094218 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae750f3a-7daf-4a47-a020-15992fb1a12c admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:05:55.104472 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1294/2589] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:05:55 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:05:55.108761 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d22833f-e6c4-4fbd-b94e-cb742aa649ba admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:05:55.119159 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d22833f-e6c4-4fbd-b94e-cb742aa649ba admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:05:55.124498 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c131d-387d-4303-a287-59262fd50424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:05:55.125182 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c131d-387d-4303-a287-59262fd50424 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:05:55.125472 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c131d-387d-4303-a287-59262fd50424 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:05:55.125732 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c131d-387d-4303-a287-59262fd50424 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:05:55.126469 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501c131d-387d-4303-a287-59262fd50424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:05:55.128063 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501c131d-387d-4303-a287-59262fd50424 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:05:55.138150 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1296/2590] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:05:55 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:05:55.142144 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae750f3a-7daf-4a47-a020-15992fb1a12c admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:05:55.152001 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae750f3a-7daf-4a47-a020-15992fb1a12c admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:05:55.157580 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6bfae-720e-45cb-b634-d9b2c77046e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:05:55.158695 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6bfae-720e-45cb-b634-d9b2c77046e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:05:55.158974 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6bfae-720e-45cb-b634-d9b2c77046e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:05:55.159271 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6bfae-720e-45cb-b634-d9b2c77046e7 admin admin] PATH_INFO: `/v3/projects/706321d3719a489391056adcf33a1953/users/dcb16a1e2c3f43c0818f148040fe0afd/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:05:55.174559 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d6bfae-720e-45cb-b634-d9b2c77046e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=706321d3719a489391056adcf33a1953, user_id=dcb16a1e2c3f43c0818f148040fe0afd, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:05:55.177250 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d6bfae-720e-45cb-b634-d9b2c77046e7 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:05:55.196460 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1295/2591] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:05:55 2021] PUT /identity/v3/projects/706321d3719a489391056adcf33a1953/users/dcb16a1e2c3f43c0818f148040fe0afd/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 05:05:55.212932 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62c543-d4ed-4c65-b460-ec7afac78736 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:05:55.213331 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62c543-d4ed-4c65-b460-ec7afac78736 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:05:55.213603 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62c543-d4ed-4c65-b460-ec7afac78736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:05:55.241945 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-3e62c543-d4ed-4c65-b460-ec7afac78736 None None] MFA Rules not processed for user `dcb16a1e2c3f43c0818f148040fe0afd`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:05:55.243210 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-3e62c543-d4ed-4c65-b460-ec7afac78736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:05:55.313957 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1297/2592] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:05:55 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:05:55.318668 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6bfae-720e-45cb-b634-d9b2c77046e7 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:05:55.385488 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6bfae-720e-45cb-b634-d9b2c77046e7 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:05:55.391009 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7f85c-76d2-4e67-ba8b-dbf2b4560b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:05:55.391659 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7f85c-76d2-4e67-ba8b-dbf2b4560b1a admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:05:55.391934 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7f85c-76d2-4e67-ba8b-dbf2b4560b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:05:55.392207 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7f85c-76d2-4e67-ba8b-dbf2b4560b1a admin admin] PATH_INFO: `/v3/projects` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:05:55.392962 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c7f85c-76d2-4e67-ba8b-dbf2b4560b1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:05:55.394863 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c7f85c-76d2-4e67-ba8b-dbf2b4560b1a admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:05:55.426447 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1296/2593] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:05:55 2021] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:05:55.432182 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e62c543-d4ed-4c65-b460-ec7afac78736 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:05:55.443594 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e62c543-d4ed-4c65-b460-ec7afac78736 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:05:55.509016 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50422220-edef-45d9-8a56-9fe9011f6f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:05:55.509690 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50422220-edef-45d9-8a56-9fe9011f6f59 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:05:55.509969 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50422220-edef-45d9-8a56-9fe9011f6f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:05:55.510269 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50422220-edef-45d9-8a56-9fe9011f6f59 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:05:55.511235 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50422220-edef-45d9-8a56-9fe9011f6f59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:05:55.513845 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50422220-edef-45d9-8a56-9fe9011f6f59 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:05:55.537019 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1298/2594] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:05:55 2021] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 05:05:55.538767 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7f85c-76d2-4e67-ba8b-dbf2b4560b1a admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:05:55.549833 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7f85c-76d2-4e67-ba8b-dbf2b4560b1a admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:05:55.555852 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be782b-7c02-4fa7-bc54-8fc48759843e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:05:55.556584 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be782b-7c02-4fa7-bc54-8fc48759843e admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:05:55.556901 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be782b-7c02-4fa7-bc54-8fc48759843e admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:05:55.557169 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be782b-7c02-4fa7-bc54-8fc48759843e admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:05:55.558175 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61be782b-7c02-4fa7-bc54-8fc48759843e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:05:55.560140 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61be782b-7c02-4fa7-bc54-8fc48759843e admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:05:55.571023 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1297/2595] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:05:55 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 24 05:05:55.575405 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50422220-edef-45d9-8a56-9fe9011f6f59 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:05:55.587353 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50422220-edef-45d9-8a56-9fe9011f6f59 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:05:55.593084 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ce4d2-90bd-433d-9322-8b99173800bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:05:55.593748 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ce4d2-90bd-433d-9322-8b99173800bf admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:05:55.594031 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ce4d2-90bd-433d-9322-8b99173800bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:05:55.594305 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ce4d2-90bd-433d-9322-8b99173800bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:05:55.595045 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110ce4d2-90bd-433d-9322-8b99173800bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:05:55.596681 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110ce4d2-90bd-433d-9322-8b99173800bf admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:05:55.606947 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1299/2596] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:05:55 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 24 05:05:55.613225 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be782b-7c02-4fa7-bc54-8fc48759843e admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:05:55.628943 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be782b-7c02-4fa7-bc54-8fc48759843e admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:05:55.636912 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff5bee8-7c12-4fc3-bc9c-26b21b400c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:05:55.637791 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5bee8-7c12-4fc3-bc9c-26b21b400c68 admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:05:55.638080 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5bee8-7c12-4fc3-bc9c-26b21b400c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:05:55.638355 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5bee8-7c12-4fc3-bc9c-26b21b400c68 admin admin] PATH_INFO: `/v3/projects/7f903a397bba4a76959a12440840513a/users/114ced3dd9064e9093cd17d720dba771/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:05:55.653848 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff5bee8-7c12-4fc3-bc9c-26b21b400c68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f903a397bba4a76959a12440840513a, user_id=114ced3dd9064e9093cd17d720dba771, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:05:55.656514 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff5bee8-7c12-4fc3-bc9c-26b21b400c68 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:05:55.672631 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1298/2597] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:05:55 2021] PUT /identity/v3/projects/7f903a397bba4a76959a12440840513a/users/114ced3dd9064e9093cd17d720dba771/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:05:55.683885 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f33138-e016-4ea2-bd61-3df710628182 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:05:55.684189 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f33138-e016-4ea2-bd61-3df710628182 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:05:55.684633 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f33138-e016-4ea2-bd61-3df710628182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:05:55.721924 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-34f33138-e016-4ea2-bd61-3df710628182 None None] MFA Rules not processed for user `114ced3dd9064e9093cd17d720dba771`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:05:55.723121 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-34f33138-e016-4ea2-bd61-3df710628182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:05:55.796904 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1300/2598] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:05:55 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 05:05:55.802117 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff5bee8-7c12-4fc3-bc9c-26b21b400c68 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:05:55.865656 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff5bee8-7c12-4fc3-bc9c-26b21b400c68 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:05:55.870667 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5472c6f2-4311-411d-bacc-745f7a5365f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:05:55.871313 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472c6f2-4311-411d-bacc-745f7a5365f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:05:55.871599 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472c6f2-4311-411d-bacc-745f7a5365f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:05:55.871873 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472c6f2-4311-411d-bacc-745f7a5365f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:05:55.872609 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5472c6f2-4311-411d-bacc-745f7a5365f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:05:55.874568 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5472c6f2-4311-411d-bacc-745f7a5365f8 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:05:55.902361 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1299/2599] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:05:55 2021] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:05:55.907867 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f33138-e016-4ea2-bd61-3df710628182 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:05:55.918864 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f33138-e016-4ea2-bd61-3df710628182 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:05:55.979452 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27160874-fb9e-44d2-b3bb-31108b2a80f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:05:55.980201 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27160874-fb9e-44d2-b3bb-31108b2a80f0 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:05:55.980601 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27160874-fb9e-44d2-b3bb-31108b2a80f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:05:55.980879 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27160874-fb9e-44d2-b3bb-31108b2a80f0 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:05:55.981964 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27160874-fb9e-44d2-b3bb-31108b2a80f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:05:55.985097 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27160874-fb9e-44d2-b3bb-31108b2a80f0 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:05:56.009473 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1301/2600] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:05:55 2021] POST /identity/v3/users => generated 294 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:05:56.013851 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5472c6f2-4311-411d-bacc-745f7a5365f8 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:05:56.024336 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5472c6f2-4311-411d-bacc-745f7a5365f8 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:05:56.030771 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11244ba-11ff-4f9d-b2af-fb33394d45a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:05:56.031422 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11244ba-11ff-4f9d-b2af-fb33394d45a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:05:56.031708 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11244ba-11ff-4f9d-b2af-fb33394d45a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:05:56.031978 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11244ba-11ff-4f9d-b2af-fb33394d45a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:05:56.032776 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11244ba-11ff-4f9d-b2af-fb33394d45a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:05:56.034399 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11244ba-11ff-4f9d-b2af-fb33394d45a6 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:05:56.045886 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1300/2601] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:05:56 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 24 05:05:56.050215 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27160874-fb9e-44d2-b3bb-31108b2a80f0 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:05:56.063958 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27160874-fb9e-44d2-b3bb-31108b2a80f0 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:05:56.069395 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d0c604-84c9-455a-aa8f-a88e5b68d801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:05:56.070304 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0c604-84c9-455a-aa8f-a88e5b68d801 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:05:56.070574 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0c604-84c9-455a-aa8f-a88e5b68d801 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:05:56.070870 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0c604-84c9-455a-aa8f-a88e5b68d801 admin admin] PATH_INFO: `/v3/projects/015aa8b2f1884bcf8407634c4a01cc22/users/2be6c9c067a04006861d7518faeba4c2/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:05:56.086590 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d0c604-84c9-455a-aa8f-a88e5b68d801 admin admin] RBAC: Authorizing `identity:create_grant(project_id=015aa8b2f1884bcf8407634c4a01cc22, user_id=2be6c9c067a04006861d7518faeba4c2, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:05:56.089524 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d0c604-84c9-455a-aa8f-a88e5b68d801 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:05:56.105084 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1302/2602] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:05:56 2021] PUT /identity/v3/projects/015aa8b2f1884bcf8407634c4a01cc22/users/2be6c9c067a04006861d7518faeba4c2/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:05:56.109672 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11244ba-11ff-4f9d-b2af-fb33394d45a6 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:05:56.127231 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11244ba-11ff-4f9d-b2af-fb33394d45a6 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:05:56.186412 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc493c7-ab68-48e9-94db-2636a4655013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:05:56.187099 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc493c7-ab68-48e9-94db-2636a4655013 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:05:56.187313 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc493c7-ab68-48e9-94db-2636a4655013 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:05:56.187584 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc493c7-ab68-48e9-94db-2636a4655013 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:05:56.188356 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc493c7-ab68-48e9-94db-2636a4655013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:05:56.190067 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc493c7-ab68-48e9-94db-2636a4655013 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:05:56.200591 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1301/2603] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:05:56 2021] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:05:56.207129 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d0c604-84c9-455a-aa8f-a88e5b68d801 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:05:56.223625 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d0c604-84c9-455a-aa8f-a88e5b68d801 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:05:56.230729 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe315388-c68b-4c43-ab02-218e32d278fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:05:56.231574 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe315388-c68b-4c43-ab02-218e32d278fc admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:05:56.231849 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe315388-c68b-4c43-ab02-218e32d278fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:05:56.232115 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe315388-c68b-4c43-ab02-218e32d278fc admin admin] PATH_INFO: `/v3/projects/015aa8b2f1884bcf8407634c4a01cc22/users/2be6c9c067a04006861d7518faeba4c2/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:05:56.234198 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe315388-c68b-4c43-ab02-218e32d278fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=015aa8b2f1884bcf8407634c4a01cc22, user_id=2be6c9c067a04006861d7518faeba4c2, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:05:56.236851 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe315388-c68b-4c43-ab02-218e32d278fc admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:05:56.248044 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1303/2604] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:05:56 2021] PUT /identity/v3/projects/015aa8b2f1884bcf8407634c4a01cc22/users/2be6c9c067a04006861d7518faeba4c2/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:05:56.259858 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c637c03-9da0-4652-aac9-dcd7bbb129ce None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:05:56.260208 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c637c03-9da0-4652-aac9-dcd7bbb129ce None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:05:56.260604 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c637c03-9da0-4652-aac9-dcd7bbb129ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:05:56.300940 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-2c637c03-9da0-4652-aac9-dcd7bbb129ce None None] MFA Rules not processed for user `2be6c9c067a04006861d7518faeba4c2`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:05:56.302163 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-2c637c03-9da0-4652-aac9-dcd7bbb129ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:05:56.377259 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1302/2605] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:05:56 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:05:56.389082 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe315388-c68b-4c43-ab02-218e32d278fc admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:05:56.391069 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-fe315388-c68b-4c43-ab02-218e32d278fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:05:56.452615 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe315388-c68b-4c43-ab02-218e32d278fc admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:05:56.456638 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f462692-a6b5-4996-a5f4-a74a93fe82d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:05:56.457293 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f462692-a6b5-4996-a5f4-a74a93fe82d0 service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:05:56.457571 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f462692-a6b5-4996-a5f4-a74a93fe82d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:05:56.457838 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f462692-a6b5-4996-a5f4-a74a93fe82d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:05:56.518518 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f462692-a6b5-4996-a5f4-a74a93fe82d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:05:56.519982 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f462692-a6b5-4996-a5f4-a74a93fe82d0 service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:05:56.529450 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1304/2606] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:05:56 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:05:58.034725 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c637c03-9da0-4652-aac9-dcd7bbb129ce None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:05:58.036297 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-2c637c03-9da0-4652-aac9-dcd7bbb129ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:05:58.049012 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c637c03-9da0-4652-aac9-dcd7bbb129ce None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:05:58.053644 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55999a06-ecd1-45b3-a831-5d8bdf530024 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:05:58.054302 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55999a06-ecd1-45b3-a831-5d8bdf530024 service cinder] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:05:58.054583 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55999a06-ecd1-45b3-a831-5d8bdf530024 service cinder] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:05:58.054854 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55999a06-ecd1-45b3-a831-5d8bdf530024 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:05:58.113136 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55999a06-ecd1-45b3-a831-5d8bdf530024 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:05:58.114539 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55999a06-ecd1-45b3-a831-5d8bdf530024 service cinder] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:05:58.123345 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1303/2607] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:05:58 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:05:58.657602 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f462692-a6b5-4996-a5f4-a74a93fe82d0 service cinder] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:05:58.665903 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f462692-a6b5-4996-a5f4-a74a93fe82d0 service cinder] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:05:58.670220 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7f781-62ae-46d1-9a5b-ef78b3431414 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:05:58.670884 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7f781-62ae-46d1-9a5b-ef78b3431414 service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:05:58.671159 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7f781-62ae-46d1-9a5b-ef78b3431414 service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:05:58.671440 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7f781-62ae-46d1-9a5b-ef78b3431414 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:05:58.681108 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c7f781-62ae-46d1-9a5b-ef78b3431414 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:05:58.682575 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c7f781-62ae-46d1-9a5b-ef78b3431414 service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:05:58.692805 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1305/2608] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:05:58 2021] GET /identity/v3/auth/tokens => generated 3309 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:06:00.082581 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55999a06-ecd1-45b3-a831-5d8bdf530024 service cinder] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:06:00.084515 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-55999a06-ecd1-45b3-a831-5d8bdf530024 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:06:00.160396 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55999a06-ecd1-45b3-a831-5d8bdf530024 service cinder] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:06:00.165864 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c9afb0-7b30-4653-bf8b-1661051a69bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:06:00.166742 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9afb0-7b30-4653-bf8b-1661051a69bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:00.167026 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9afb0-7b30-4653-bf8b-1661051a69bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:00.167302 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9afb0-7b30-4653-bf8b-1661051a69bf admin admin] PATH_INFO: `/v3/users/82fc245c775844e6af2acc79a1e637e8` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:00.168643 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c9afb0-7b30-4653-bf8b-1661051a69bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=82fc245c775844e6af2acc79a1e637e8)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:06:00.170600 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c9afb0-7b30-4653-bf8b-1661051a69bf admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:06:00.220396 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-b0c9afb0-7b30-4653-bf8b-1661051a69bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82fc245c775844e6af2acc79a1e637e8'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:06:00.221182 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-b0c9afb0-7b30-4653-bf8b-1661051a69bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82fc245c775844e6af2acc79a1e637e8'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:06:00.228287 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-b0c9afb0-7b30-4653-bf8b-1661051a69bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82fc245c775844e6af2acc79a1e637e8'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:06:00.236576 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-b0c9afb0-7b30-4653-bf8b-1661051a69bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82fc245c775844e6af2acc79a1e637e8'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:06:00.237202 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-b0c9afb0-7b30-4653-bf8b-1661051a69bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82fc245c775844e6af2acc79a1e637e8'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:06:00.254682 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1304/2609] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:06:00 2021] DELETE /identity/v3/users/82fc245c775844e6af2acc79a1e637e8 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:06:00.442455 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7f781-62ae-46d1-9a5b-ef78b3431414 service cinder] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:06:00.455701 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7f781-62ae-46d1-9a5b-ef78b3431414 service cinder] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:06:00.522744 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca4650e-2315-423b-91f2-88adb2233d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:06:00.523601 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4650e-2315-423b-91f2-88adb2233d1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:00.523874 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4650e-2315-423b-91f2-88adb2233d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:00.524150 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4650e-2315-423b-91f2-88adb2233d1e admin admin] PATH_INFO: `/v3/projects/122a6a1d32d648c6938f0b159bb3641c` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:00.525414 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca4650e-2315-423b-91f2-88adb2233d1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=122a6a1d32d648c6938f0b159bb3641c)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:06:00.527359 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca4650e-2315-423b-91f2-88adb2233d1e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:06:00.576396 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-eca4650e-2315-423b-91f2-88adb2233d1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '122a6a1d32d648c6938f0b159bb3641c', 'request_id': 'req-eca4650e-2315-423b-91f2-88adb2233d1e'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:06:00.586137 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-eca4650e-2315-423b-91f2-88adb2233d1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '122a6a1d32d648c6938f0b159bb3641c', 'request_id': 'req-eca4650e-2315-423b-91f2-88adb2233d1e'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:06:00.591914 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-eca4650e-2315-423b-91f2-88adb2233d1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '122a6a1d32d648c6938f0b159bb3641c', 'request_id': 'req-eca4650e-2315-423b-91f2-88adb2233d1e'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:06:00.602775 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-eca4650e-2315-423b-91f2-88adb2233d1e admin admin] The token cache is being invalidate because project 122a6a1d32d648c6938f0b159bb3641c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:06:00.603067 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-eca4650e-2315-423b-91f2-88adb2233d1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:06:00.603785 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-eca4650e-2315-423b-91f2-88adb2233d1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:06:00.605431 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1306/2610] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:06:00 2021] DELETE /identity/v3/projects/122a6a1d32d648c6938f0b159bb3641c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:06:00.611450 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490d2c4-fd36-4142-a4de-3c08ad1c87cb None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:00.611668 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490d2c4-fd36-4142-a4de-3c08ad1c87cb None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:00.611944 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490d2c4-fd36-4142-a4de-3c08ad1c87cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:00.629681 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-e490d2c4-fd36-4142-a4de-3c08ad1c87cb None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:06:00.630874 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-e490d2c4-fd36-4142-a4de-3c08ad1c87cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:06:00.699823 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1305/2611] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:06:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:06:00.708321 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34be598-61b5-458c-9901-9e2622b60f4f None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:00.708644 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34be598-61b5-458c-9901-9e2622b60f4f None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:00.708926 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34be598-61b5-458c-9901-9e2622b60f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:00.729480 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-f34be598-61b5-458c-9901-9e2622b60f4f None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:06:00.730700 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-f34be598-61b5-458c-9901-9e2622b60f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:06:00.739782 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1307/2612] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:06:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:06:00.744197 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490d2c4-fd36-4142-a4de-3c08ad1c87cb None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:06:00.754403 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490d2c4-fd36-4142-a4de-3c08ad1c87cb None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:06:00.759881 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c7d86-d548-41df-939d-d805d24ecfc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:06:00.760681 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c7d86-d548-41df-939d-d805d24ecfc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:00.760956 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c7d86-d548-41df-939d-d805d24ecfc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:00.761250 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c7d86-d548-41df-939d-d805d24ecfc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:00.762015 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c7d86-d548-41df-939d-d805d24ecfc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 05:06:00.762373 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c7d86-d548-41df-939d-d805d24ecfc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:06:00.764005 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c7d86-d548-41df-939d-d805d24ecfc3 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:06:00.776194 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1306/2613] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 05:06:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 05:06:00.780857 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34be598-61b5-458c-9901-9e2622b60f4f None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:06:00.790814 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34be598-61b5-458c-9901-9e2622b60f4f None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:06:00.795840 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975504b-5d82-4503-bd97-e623f4f890ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:06:00.796495 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975504b-5d82-4503-bd97-e623f4f890ed admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:00.796803 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975504b-5d82-4503-bd97-e623f4f890ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:00.797077 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975504b-5d82-4503-bd97-e623f4f890ed admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:00.798011 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7975504b-5d82-4503-bd97-e623f4f890ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:06:00.799915 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7975504b-5d82-4503-bd97-e623f4f890ed admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:06:00.826389 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1308/2614] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:06:00 2021] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:06:00.832265 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c7d86-d548-41df-939d-d805d24ecfc3 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:06:00.843546 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c7d86-d548-41df-939d-d805d24ecfc3 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:06:00.908805 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b5d01d-d4ad-44a9-8202-e36cb78e67de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:06:00.909415 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5d01d-d4ad-44a9-8202-e36cb78e67de admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:00.909695 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5d01d-d4ad-44a9-8202-e36cb78e67de admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:00.909965 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5d01d-d4ad-44a9-8202-e36cb78e67de admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:00.910664 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b5d01d-d4ad-44a9-8202-e36cb78e67de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:06:00.912615 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b5d01d-d4ad-44a9-8202-e36cb78e67de admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:06:00.934709 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1307/2615] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:06:00 2021] POST /identity/v3/users => generated 291 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 05:06:00.939002 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975504b-5d82-4503-bd97-e623f4f890ed admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:06:00.950173 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975504b-5d82-4503-bd97-e623f4f890ed admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:06:00.955800 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3341b72-a1d2-41ec-a584-1b1e98906255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:06:00.956497 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3341b72-a1d2-41ec-a584-1b1e98906255 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:00.956809 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3341b72-a1d2-41ec-a584-1b1e98906255 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:00.957085 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3341b72-a1d2-41ec-a584-1b1e98906255 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:00.957833 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3341b72-a1d2-41ec-a584-1b1e98906255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:06:00.959433 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3341b72-a1d2-41ec-a584-1b1e98906255 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:06:00.971123 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1309/2616] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:06:00 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:06:00.975249 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b5d01d-d4ad-44a9-8202-e36cb78e67de admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:06:00.985394 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b5d01d-d4ad-44a9-8202-e36cb78e67de admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:06:00.990949 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683a5cd5-bb05-4e87-928e-06bd7af54ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:06:00.991617 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a5cd5-bb05-4e87-928e-06bd7af54ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:00.991894 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a5cd5-bb05-4e87-928e-06bd7af54ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:00.992161 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a5cd5-bb05-4e87-928e-06bd7af54ec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:00.992922 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683a5cd5-bb05-4e87-928e-06bd7af54ec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:06:00.994504 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683a5cd5-bb05-4e87-928e-06bd7af54ec1 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:06:01.004810 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1308/2617] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:06:00 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:06:01.009082 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3341b72-a1d2-41ec-a584-1b1e98906255 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:06:01.019576 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3341b72-a1d2-41ec-a584-1b1e98906255 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:06:01.024940 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c641f-239b-421f-a097-b146e204ebaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:06:01.025838 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c641f-239b-421f-a097-b146e204ebaa admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:01.026117 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c641f-239b-421f-a097-b146e204ebaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:01.027034 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c641f-239b-421f-a097-b146e204ebaa admin admin] PATH_INFO: `/v3/projects/f081e71a66b74c3bb12e1bec9d9a5cd1/users/8bd940f9211f415987d3443601acabc4/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:01.041842 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3c641f-239b-421f-a097-b146e204ebaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f081e71a66b74c3bb12e1bec9d9a5cd1, user_id=8bd940f9211f415987d3443601acabc4, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:06:01.044559 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3c641f-239b-421f-a097-b146e204ebaa admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:06:01.059180 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1310/2618] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:06:01 2021] PUT /identity/v3/projects/f081e71a66b74c3bb12e1bec9d9a5cd1/users/8bd940f9211f415987d3443601acabc4/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:06:01.064598 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a50cba-4d8a-41e5-97ef-03bf57dd5756 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:01.064919 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a50cba-4d8a-41e5-97ef-03bf57dd5756 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:01.065190 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a50cba-4d8a-41e5-97ef-03bf57dd5756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:01.084817 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-87a50cba-4d8a-41e5-97ef-03bf57dd5756 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:06:01.086409 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-87a50cba-4d8a-41e5-97ef-03bf57dd5756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:06:01.146843 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1309/2619] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:06:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 05:06:01.157608 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c641f-239b-421f-a097-b146e204ebaa admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:06:01.159619 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-cd3c641f-239b-421f-a097-b146e204ebaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:06:01.216796 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c641f-239b-421f-a097-b146e204ebaa admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:06:01.221081 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c563e6-57d8-4305-9562-6e9e15933e3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:06:01.221727 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c563e6-57d8-4305-9562-6e9e15933e3a service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:01.222010 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c563e6-57d8-4305-9562-6e9e15933e3a service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:01.222281 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c563e6-57d8-4305-9562-6e9e15933e3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:01.231697 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c563e6-57d8-4305-9562-6e9e15933e3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:06:01.233203 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c563e6-57d8-4305-9562-6e9e15933e3a service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:06:01.243387 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1311/2620] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:06:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:06:02.530405 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a50cba-4d8a-41e5-97ef-03bf57dd5756 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:06:02.532931 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-87a50cba-4d8a-41e5-97ef-03bf57dd5756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:06:02.547357 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a50cba-4d8a-41e5-97ef-03bf57dd5756 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:06:02.556487 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951838ea-b623-4e45-ab2e-728d6c8ed46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:06:02.557437 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951838ea-b623-4e45-ab2e-728d6c8ed46f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:02.557720 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951838ea-b623-4e45-ab2e-728d6c8ed46f admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:02.557995 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951838ea-b623-4e45-ab2e-728d6c8ed46f admin admin] PATH_INFO: `/v3/users/dcb16a1e2c3f43c0818f148040fe0afd` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:02.559245 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951838ea-b623-4e45-ab2e-728d6c8ed46f admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcb16a1e2c3f43c0818f148040fe0afd)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:06:02.561260 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951838ea-b623-4e45-ab2e-728d6c8ed46f admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:06:02.627308 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-951838ea-b623-4e45-ab2e-728d6c8ed46f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcb16a1e2c3f43c0818f148040fe0afd'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:06:02.627945 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-951838ea-b623-4e45-ab2e-728d6c8ed46f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcb16a1e2c3f43c0818f148040fe0afd'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:06:02.636022 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-951838ea-b623-4e45-ab2e-728d6c8ed46f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcb16a1e2c3f43c0818f148040fe0afd'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:06:02.649783 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-951838ea-b623-4e45-ab2e-728d6c8ed46f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcb16a1e2c3f43c0818f148040fe0afd'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:06:02.650527 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-951838ea-b623-4e45-ab2e-728d6c8ed46f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcb16a1e2c3f43c0818f148040fe0afd'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:06:02.671181 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1310/2621] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:06:02 2021] DELETE /identity/v3/users/dcb16a1e2c3f43c0818f148040fe0afd => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:06:02.677633 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5a34f-4595-4344-9494-70ec4078beed None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:02.678116 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5a34f-4595-4344-9494-70ec4078beed None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:02.678229 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5a34f-4595-4344-9494-70ec4078beed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:02.703007 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-fee5a34f-4595-4344-9494-70ec4078beed None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:06:02.704654 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-fee5a34f-4595-4344-9494-70ec4078beed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:06:02.786389 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1312/2622] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:06:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:06:02.795921 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951838ea-b623-4e45-ab2e-728d6c8ed46f admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:06:02.798158 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-951838ea-b623-4e45-ab2e-728d6c8ed46f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:06:02.866162 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951838ea-b623-4e45-ab2e-728d6c8ed46f admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:06:02.869906 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45831784-0a00-4675-9337-54ec10b81c19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:06:02.870575 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45831784-0a00-4675-9337-54ec10b81c19 service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:02.870862 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45831784-0a00-4675-9337-54ec10b81c19 service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:02.871137 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45831784-0a00-4675-9337-54ec10b81c19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:02.881016 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45831784-0a00-4675-9337-54ec10b81c19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:06:02.882502 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45831784-0a00-4675-9337-54ec10b81c19 service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:06:02.892505 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1311/2623] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:06:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 24 05:06:03.604553 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee5a34f-4595-4344-9494-70ec4078beed None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:06:03.606600 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-fee5a34f-4595-4344-9494-70ec4078beed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:06:03.626062 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee5a34f-4595-4344-9494-70ec4078beed None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:06:03.633994 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452d75b-9486-4d79-b68d-da8d4f8a1fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:06:03.634962 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452d75b-9486-4d79-b68d-da8d4f8a1fc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:03.635241 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452d75b-9486-4d79-b68d-da8d4f8a1fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:03.635513 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452d75b-9486-4d79-b68d-da8d4f8a1fc8 admin admin] PATH_INFO: `/v3/projects/706321d3719a489391056adcf33a1953` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:03.636909 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4452d75b-9486-4d79-b68d-da8d4f8a1fc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=706321d3719a489391056adcf33a1953)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:06:03.638876 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4452d75b-9486-4d79-b68d-da8d4f8a1fc8 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:06:03.692921 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-4452d75b-9486-4d79-b68d-da8d4f8a1fc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '706321d3719a489391056adcf33a1953', 'request_id': 'req-4452d75b-9486-4d79-b68d-da8d4f8a1fc8'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:06:03.702579 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-4452d75b-9486-4d79-b68d-da8d4f8a1fc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '706321d3719a489391056adcf33a1953', 'request_id': 'req-4452d75b-9486-4d79-b68d-da8d4f8a1fc8'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:06:03.709997 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-4452d75b-9486-4d79-b68d-da8d4f8a1fc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '706321d3719a489391056adcf33a1953', 'request_id': 'req-4452d75b-9486-4d79-b68d-da8d4f8a1fc8'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:06:03.724906 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-4452d75b-9486-4d79-b68d-da8d4f8a1fc8 admin admin] The token cache is being invalidate because project 706321d3719a489391056adcf33a1953 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:06:03.725477 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-4452d75b-9486-4d79-b68d-da8d4f8a1fc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:06:03.726291 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-4452d75b-9486-4d79-b68d-da8d4f8a1fc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:06:03.732466 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1313/2624] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:06:03 2021] DELETE /identity/v3/projects/706321d3719a489391056adcf33a1953 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:06:03.733386 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45831784-0a00-4675-9337-54ec10b81c19 service neutron] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:06:03.746421 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45831784-0a00-4675-9337-54ec10b81c19 service neutron] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:06:03.850651 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c188e-885d-43c9-bbc8-9e816f55a00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:06:03.851880 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c188e-885d-43c9-bbc8-9e816f55a00f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:03.852163 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c188e-885d-43c9-bbc8-9e816f55a00f admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:03.852437 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c188e-885d-43c9-bbc8-9e816f55a00f admin admin] PATH_INFO: `/v3/users/114ced3dd9064e9093cd17d720dba771` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:03.854049 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2c188e-885d-43c9-bbc8-9e816f55a00f admin admin] RBAC: Authorizing `identity:delete_user(user_id=114ced3dd9064e9093cd17d720dba771)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:06:03.856816 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2c188e-885d-43c9-bbc8-9e816f55a00f admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:06:03.927691 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-bf2c188e-885d-43c9-bbc8-9e816f55a00f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '114ced3dd9064e9093cd17d720dba771'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:06:03.928680 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-bf2c188e-885d-43c9-bbc8-9e816f55a00f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '114ced3dd9064e9093cd17d720dba771'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:06:03.937319 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-bf2c188e-885d-43c9-bbc8-9e816f55a00f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '114ced3dd9064e9093cd17d720dba771'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:06:03.946042 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-bf2c188e-885d-43c9-bbc8-9e816f55a00f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '114ced3dd9064e9093cd17d720dba771'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:06:03.947054 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-bf2c188e-885d-43c9-bbc8-9e816f55a00f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '114ced3dd9064e9093cd17d720dba771'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:06:03.971104 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1312/2625] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:06:03 2021] DELETE /identity/v3/users/114ced3dd9064e9093cd17d720dba771 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 05:06:04.271761 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452d75b-9486-4d79-b68d-da8d4f8a1fc8 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:06:04.273303 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-4452d75b-9486-4d79-b68d-da8d4f8a1fc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:06:04.292325 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452d75b-9486-4d79-b68d-da8d4f8a1fc8 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:06:04.361064 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea86e07-1d48-45b2-97bb-8f9cf0130a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:06:04.361973 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea86e07-1d48-45b2-97bb-8f9cf0130a72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:04.362263 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea86e07-1d48-45b2-97bb-8f9cf0130a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:04.362539 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea86e07-1d48-45b2-97bb-8f9cf0130a72 admin admin] PATH_INFO: `/v3/projects/7f903a397bba4a76959a12440840513a` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:04.363811 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea86e07-1d48-45b2-97bb-8f9cf0130a72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f903a397bba4a76959a12440840513a)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:06:04.366005 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea86e07-1d48-45b2-97bb-8f9cf0130a72 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:06:04.417163 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-5ea86e07-1d48-45b2-97bb-8f9cf0130a72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f903a397bba4a76959a12440840513a', 'request_id': 'req-5ea86e07-1d48-45b2-97bb-8f9cf0130a72'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:06:04.428251 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-5ea86e07-1d48-45b2-97bb-8f9cf0130a72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f903a397bba4a76959a12440840513a', 'request_id': 'req-5ea86e07-1d48-45b2-97bb-8f9cf0130a72'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:06:04.435262 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-5ea86e07-1d48-45b2-97bb-8f9cf0130a72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f903a397bba4a76959a12440840513a', 'request_id': 'req-5ea86e07-1d48-45b2-97bb-8f9cf0130a72'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:06:04.447895 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-5ea86e07-1d48-45b2-97bb-8f9cf0130a72 admin admin] The token cache is being invalidate because project 7f903a397bba4a76959a12440840513a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:06:04.448215 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-5ea86e07-1d48-45b2-97bb-8f9cf0130a72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:06:04.449010 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-5ea86e07-1d48-45b2-97bb-8f9cf0130a72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:06:04.454066 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1314/2626] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:06:04 2021] DELETE /identity/v3/projects/7f903a397bba4a76959a12440840513a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 05:06:04.455630 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c188e-885d-43c9-bbc8-9e816f55a00f admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:06:04.457172 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-bf2c188e-885d-43c9-bbc8-9e816f55a00f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:06:04.472379 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c188e-885d-43c9-bbc8-9e816f55a00f admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:06:04.537895 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f4e35-122e-47f6-829c-d5bec214f981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:06:04.538783 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f4e35-122e-47f6-829c-d5bec214f981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:04.539063 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f4e35-122e-47f6-829c-d5bec214f981 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:04.539344 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f4e35-122e-47f6-829c-d5bec214f981 admin admin] PATH_INFO: `/v3/users/2be6c9c067a04006861d7518faeba4c2` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:04.540777 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221f4e35-122e-47f6-829c-d5bec214f981 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2be6c9c067a04006861d7518faeba4c2)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:06:04.542536 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221f4e35-122e-47f6-829c-d5bec214f981 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:06:04.598818 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-221f4e35-122e-47f6-829c-d5bec214f981 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2be6c9c067a04006861d7518faeba4c2'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:06:04.599560 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-221f4e35-122e-47f6-829c-d5bec214f981 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2be6c9c067a04006861d7518faeba4c2'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:06:04.607052 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-221f4e35-122e-47f6-829c-d5bec214f981 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2be6c9c067a04006861d7518faeba4c2'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:06:04.616855 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-221f4e35-122e-47f6-829c-d5bec214f981 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2be6c9c067a04006861d7518faeba4c2'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:06:04.617476 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-221f4e35-122e-47f6-829c-d5bec214f981 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2be6c9c067a04006861d7518faeba4c2'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:06:04.636949 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1313/2627] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:06:04 2021] DELETE /identity/v3/users/2be6c9c067a04006861d7518faeba4c2 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:06:04.963550 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea86e07-1d48-45b2-97bb-8f9cf0130a72 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:06:04.965664 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-5ea86e07-1d48-45b2-97bb-8f9cf0130a72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:06:04.988555 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea86e07-1d48-45b2-97bb-8f9cf0130a72 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:06:05.064077 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba9de3-0366-4f92-a913-1dd4371d82f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:06:05.065356 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba9de3-0366-4f92-a913-1dd4371d82f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:05.065990 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba9de3-0366-4f92-a913-1dd4371d82f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:05.066372 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba9de3-0366-4f92-a913-1dd4371d82f2 admin admin] PATH_INFO: `/v3/projects/015aa8b2f1884bcf8407634c4a01cc22` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:05.068271 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ba9de3-0366-4f92-a913-1dd4371d82f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=015aa8b2f1884bcf8407634c4a01cc22)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:06:05.070544 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ba9de3-0366-4f92-a913-1dd4371d82f2 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:06:05.128469 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-f7ba9de3-0366-4f92-a913-1dd4371d82f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '015aa8b2f1884bcf8407634c4a01cc22', 'request_id': 'req-f7ba9de3-0366-4f92-a913-1dd4371d82f2'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:06:05.138439 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-f7ba9de3-0366-4f92-a913-1dd4371d82f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '015aa8b2f1884bcf8407634c4a01cc22', 'request_id': 'req-f7ba9de3-0366-4f92-a913-1dd4371d82f2'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:06:05.150161 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-f7ba9de3-0366-4f92-a913-1dd4371d82f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '015aa8b2f1884bcf8407634c4a01cc22', 'request_id': 'req-f7ba9de3-0366-4f92-a913-1dd4371d82f2'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:06:05.166426 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-f7ba9de3-0366-4f92-a913-1dd4371d82f2 admin admin] The token cache is being invalidate because project 015aa8b2f1884bcf8407634c4a01cc22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:06:05.166920 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-f7ba9de3-0366-4f92-a913-1dd4371d82f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:06:05.167751 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-f7ba9de3-0366-4f92-a913-1dd4371d82f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:06:05.169573 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1315/2628] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:06:04 2021] DELETE /identity/v3/projects/015aa8b2f1884bcf8407634c4a01cc22 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:06:05.177506 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82efab-c580-44c9-8ab5-c212cacff597 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:05.178372 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82efab-c580-44c9-8ab5-c212cacff597 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:05.178828 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82efab-c580-44c9-8ab5-c212cacff597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:05.203642 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-ff82efab-c580-44c9-8ab5-c212cacff597 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:06:05.205060 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-ff82efab-c580-44c9-8ab5-c212cacff597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:06:05.275723 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1314/2629] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:06:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 05:06:05.283856 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e96df-3c55-4565-9ea6-c2f09a028771 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:05.284622 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e96df-3c55-4565-9ea6-c2f09a028771 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:05.285123 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e96df-3c55-4565-9ea6-c2f09a028771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:05.310381 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-841e96df-3c55-4565-9ea6-c2f09a028771 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:06:05.310381 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-841e96df-3c55-4565-9ea6-c2f09a028771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:06:05.327056 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1316/2630] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:06:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:06:05.331445 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff82efab-c580-44c9-8ab5-c212cacff597 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:06:05.341831 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff82efab-c580-44c9-8ab5-c212cacff597 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:06:05.367214 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1565a-d4b1-433e-bcca-7215a1f91140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:06:05.368793 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1565a-d4b1-433e-bcca-7215a1f91140 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:05.369297 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1565a-d4b1-433e-bcca-7215a1f91140 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:05.370234 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1565a-d4b1-433e-bcca-7215a1f91140 admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:05.371659 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf1565a-d4b1-433e-bcca-7215a1f91140 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 05:06:05.372698 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf1565a-d4b1-433e-bcca-7215a1f91140 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:06:05.374852 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf1565a-d4b1-433e-bcca-7215a1f91140 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:06:05.390214 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1315/2631] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 05:06:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 05:06:05.394477 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e96df-3c55-4565-9ea6-c2f09a028771 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:06:05.405091 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e96df-3c55-4565-9ea6-c2f09a028771 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:06:05.416446 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f1fc25-9cbf-4368-a256-8b9cfe9bc059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:06:05.417611 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1fc25-9cbf-4368-a256-8b9cfe9bc059 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:05.418098 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1fc25-9cbf-4368-a256-8b9cfe9bc059 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:05.418551 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1fc25-9cbf-4368-a256-8b9cfe9bc059 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:05.420070 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f1fc25-9cbf-4368-a256-8b9cfe9bc059 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:06:05.422248 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f1fc25-9cbf-4368-a256-8b9cfe9bc059 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:06:05.464136 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1317/2632] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:06:05 2021] POST /identity/v3/projects => generated 375 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:06:05.466802 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1565a-d4b1-433e-bcca-7215a1f91140 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:06:05.478684 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1565a-d4b1-433e-bcca-7215a1f91140 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:06:05.580193 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129717c4-92ac-4cc4-a55d-3108cc75f758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:06:05.581381 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129717c4-92ac-4cc4-a55d-3108cc75f758 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:05.581813 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129717c4-92ac-4cc4-a55d-3108cc75f758 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:05.582564 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129717c4-92ac-4cc4-a55d-3108cc75f758 admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:05.583443 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129717c4-92ac-4cc4-a55d-3108cc75f758 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:06:05.586883 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129717c4-92ac-4cc4-a55d-3108cc75f758 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:06:05.618496 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1316/2633] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:06:05 2021] POST /identity/v3/users => generated 288 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:06:05.622723 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f1fc25-9cbf-4368-a256-8b9cfe9bc059 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:06:05.640797 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f1fc25-9cbf-4368-a256-8b9cfe9bc059 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:06:05.640797 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926eb023-e05e-4c7a-b20b-01dc2c50217e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:06:05.642264 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c316d167-fb06-43dd-a9bb-590accd78274 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:05.642556 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c316d167-fb06-43dd-a9bb-590accd78274 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:05.642842 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c316d167-fb06-43dd-a9bb-590accd78274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:05.645852 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926eb023-e05e-4c7a-b20b-01dc2c50217e admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:05.646137 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926eb023-e05e-4c7a-b20b-01dc2c50217e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:05.646411 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926eb023-e05e-4c7a-b20b-01dc2c50217e admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:05.647174 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926eb023-e05e-4c7a-b20b-01dc2c50217e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:06:05.652632 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926eb023-e05e-4c7a-b20b-01dc2c50217e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:06:05.671503 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1318/2634] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:06:05 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:06:05.675298 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926eb023-e05e-4c7a-b20b-01dc2c50217e admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:06:05.679356 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-c316d167-fb06-43dd-a9bb-590accd78274 None None] MFA Rules not processed for user `8bd940f9211f415987d3443601acabc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:06:05.680935 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-c316d167-fb06-43dd-a9bb-590accd78274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:06:05.694124 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926eb023-e05e-4c7a-b20b-01dc2c50217e admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:06:05.699486 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d320d89-6189-4cc3-beaf-ba2424dd83ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:06:05.700435 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d320d89-6189-4cc3-beaf-ba2424dd83ec admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:05.700752 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d320d89-6189-4cc3-beaf-ba2424dd83ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:05.701034 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d320d89-6189-4cc3-beaf-ba2424dd83ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:05.701787 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d320d89-6189-4cc3-beaf-ba2424dd83ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:06:05.704331 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d320d89-6189-4cc3-beaf-ba2424dd83ec admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:06:05.720885 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1319/2635] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:06:05 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:06:05.723260 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d320d89-6189-4cc3-beaf-ba2424dd83ec admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:06:05.753726 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d320d89-6189-4cc3-beaf-ba2424dd83ec admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:06:05.760727 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8d2bd-8950-47c0-bd9d-dc0ccd6e5336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:06:05.761717 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8d2bd-8950-47c0-bd9d-dc0ccd6e5336 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:05.762195 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8d2bd-8950-47c0-bd9d-dc0ccd6e5336 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:05.762475 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8d2bd-8950-47c0-bd9d-dc0ccd6e5336 admin admin] PATH_INFO: `/v3/projects/e1e4473904384550b47b8b6848a76ea0/users/38f31abd56444ef7bcafaa425c311712/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:05.777936 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a8d2bd-8950-47c0-bd9d-dc0ccd6e5336 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1e4473904384550b47b8b6848a76ea0, user_id=38f31abd56444ef7bcafaa425c311712, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:06:05.780722 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a8d2bd-8950-47c0-bd9d-dc0ccd6e5336 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:06:05.789910 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1317/2636] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:06:05 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 05:06:05.794718 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c316d167-fb06-43dd-a9bb-590accd78274 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:06:05.794871 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1320/2637] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:06:05 2021] PUT /identity/v3/projects/e1e4473904384550b47b8b6848a76ea0/users/38f31abd56444ef7bcafaa425c311712/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 05:06:05.796002 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-c316d167-fb06-43dd-a9bb-590accd78274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:06:05.808013 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ccbe53-69e8-4891-bf77-39af023f25b4 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:05.808579 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ccbe53-69e8-4891-bf77-39af023f25b4 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:05.809064 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ccbe53-69e8-4891-bf77-39af023f25b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:05.815672 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c316d167-fb06-43dd-a9bb-590accd78274 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:06:05.840573 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-60ccbe53-69e8-4891-bf77-39af023f25b4 None None] MFA Rules not processed for user `38f31abd56444ef7bcafaa425c311712`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:06:05.841781 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-60ccbe53-69e8-4891-bf77-39af023f25b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:06:05.877869 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f75b0fb-391b-40fc-b783-baeaab372695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:06:05.878566 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75b0fb-391b-40fc-b783-baeaab372695 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:05.878843 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75b0fb-391b-40fc-b783-baeaab372695 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:05.879112 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75b0fb-391b-40fc-b783-baeaab372695 admin admin] PATH_INFO: `/v3/projects` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:05.879821 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f75b0fb-391b-40fc-b783-baeaab372695 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:06:05.881814 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f75b0fb-391b-40fc-b783-baeaab372695 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:06:05.918022 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1318/2638] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:06:05 2021] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 05:06:05.919042 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1321/2639] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:06:05 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:06:05.924706 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f75b0fb-391b-40fc-b783-baeaab372695 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:06:05.929433 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ccbe53-69e8-4891-bf77-39af023f25b4 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:06:05.930819 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-60ccbe53-69e8-4891-bf77-39af023f25b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:06:05.994746 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ccbe53-69e8-4891-bf77-39af023f25b4 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:06:05.998076 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f75b0fb-391b-40fc-b783-baeaab372695 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:06:06.003849 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8c356-4576-432b-af9c-a11e9a4a34a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:06:06.004716 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8c356-4576-432b-af9c-a11e9a4a34a1 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:06.004999 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8c356-4576-432b-af9c-a11e9a4a34a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:06.005267 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8c356-4576-432b-af9c-a11e9a4a34a1 admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:06.006007 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b8c356-4576-432b-af9c-a11e9a4a34a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:06:06.007954 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b8c356-4576-432b-af9c-a11e9a4a34a1 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:06:06.034517 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1319/2640] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:06:05 2021] POST /identity/v3/users => generated 299 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 05:06:06.035715 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8c356-4576-432b-af9c-a11e9a4a34a1 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:06:06.046287 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8c356-4576-432b-af9c-a11e9a4a34a1 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:06:06.052624 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5bcdb7-f595-45e9-9102-945ddc7f4ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:06:06.053420 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5bcdb7-f595-45e9-9102-945ddc7f4ecb admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:06.053760 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5bcdb7-f595-45e9-9102-945ddc7f4ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:06.054105 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5bcdb7-f595-45e9-9102-945ddc7f4ecb admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:06.054723 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a710c-0474-459c-82a3-190a30ff6d51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:06:06.055122 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5bcdb7-f595-45e9-9102-945ddc7f4ecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:06:06.055436 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a710c-0474-459c-82a3-190a30ff6d51 service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:06.055717 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a710c-0474-459c-82a3-190a30ff6d51 service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:06.055991 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a710c-0474-459c-82a3-190a30ff6d51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:06.057149 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5bcdb7-f595-45e9-9102-945ddc7f4ecb admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:06:06.067981 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1320/2641] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:06:06 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:06:06.072048 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5bcdb7-f595-45e9-9102-945ddc7f4ecb admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:06:06.083897 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5bcdb7-f595-45e9-9102-945ddc7f4ecb admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:06:06.089373 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb240e3d-904e-47cf-9c8a-7aee372bf2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:06:06.090319 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb240e3d-904e-47cf-9c8a-7aee372bf2e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:06.090601 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb240e3d-904e-47cf-9c8a-7aee372bf2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:06.090876 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb240e3d-904e-47cf-9c8a-7aee372bf2e4 admin admin] PATH_INFO: `/v3/projects/3f3829205cff4830ba6b76ce6b6a8469/users/5ca0652f51eb4221917dceb89516f084/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:06.107626 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb240e3d-904e-47cf-9c8a-7aee372bf2e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f3829205cff4830ba6b76ce6b6a8469, user_id=5ca0652f51eb4221917dceb89516f084, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:06:06.110377 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb240e3d-904e-47cf-9c8a-7aee372bf2e4 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:06:06.118394 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504a710c-0474-459c-82a3-190a30ff6d51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:06:06.119595 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504a710c-0474-459c-82a3-190a30ff6d51 service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:06:06.126990 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1321/2642] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:06:06 2021] PUT /identity/v3/projects/3f3829205cff4830ba6b76ce6b6a8469/users/5ca0652f51eb4221917dceb89516f084/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 05:06:06.129592 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1322/2643] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:06:05 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 24 05:06:06.131407 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb240e3d-904e-47cf-9c8a-7aee372bf2e4 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:06:06.197151 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb240e3d-904e-47cf-9c8a-7aee372bf2e4 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:06:06.202067 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd46eaef-4c40-4eaa-a4ad-ac3df445b537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:06:06.202603 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46eaef-4c40-4eaa-a4ad-ac3df445b537 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:06.202879 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46eaef-4c40-4eaa-a4ad-ac3df445b537 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:06.203148 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46eaef-4c40-4eaa-a4ad-ac3df445b537 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:06.203992 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd46eaef-4c40-4eaa-a4ad-ac3df445b537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:06:06.205873 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd46eaef-4c40-4eaa-a4ad-ac3df445b537 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:06:06.216550 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1322/2644] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:06:06 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 24 05:06:06.224454 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a710c-0474-459c-82a3-190a30ff6d51 service cinder] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:06:06.249751 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a710c-0474-459c-82a3-190a30ff6d51 service cinder] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:06:06.255666 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa6858-ff6e-483c-99a8-2498218a1d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:06:06.256656 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa6858-ff6e-483c-99a8-2498218a1d9b admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:06.256943 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa6858-ff6e-483c-99a8-2498218a1d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:06.257219 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa6858-ff6e-483c-99a8-2498218a1d9b admin admin] PATH_INFO: `/v3/projects/3f3829205cff4830ba6b76ce6b6a8469/users/5ca0652f51eb4221917dceb89516f084/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:06.259380 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa6858-ff6e-483c-99a8-2498218a1d9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f3829205cff4830ba6b76ce6b6a8469, user_id=5ca0652f51eb4221917dceb89516f084, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:06:06.262209 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa6858-ff6e-483c-99a8-2498218a1d9b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:06:06.274975 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1323/2645] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:06:06 2021] PUT /identity/v3/projects/3f3829205cff4830ba6b76ce6b6a8469/users/5ca0652f51eb4221917dceb89516f084/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 05:06:11.083058 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ec8bc-dc18-4b68-8e49-62edc65b0780 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:11.083566 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ec8bc-dc18-4b68-8e49-62edc65b0780 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:11.083673 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ec8bc-dc18-4b68-8e49-62edc65b0780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:11.116143 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-229ec8bc-dc18-4b68-8e49-62edc65b0780 None None] MFA Rules not processed for user `5ca0652f51eb4221917dceb89516f084`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:06:11.117354 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-229ec8bc-dc18-4b68-8e49-62edc65b0780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:06:11.197001 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1323/2646] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:06:11 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:06:11.211093 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa6858-ff6e-483c-99a8-2498218a1d9b admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:06:11.212959 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-91fa6858-ff6e-483c-99a8-2498218a1d9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:06:11.282872 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa6858-ff6e-483c-99a8-2498218a1d9b admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:06:11.282872 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75d914-24ee-45b2-84e2-c82e3fc88d02 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1782324ce854868bd11b32bd24b435c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:06:11.282872 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75d914-24ee-45b2-84e2-c82e3fc88d02 service glance] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:11.293288 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75d914-24ee-45b2-84e2-c82e3fc88d02 service glance] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:11.294006 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75d914-24ee-45b2-84e2-c82e3fc88d02 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:11.375427 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e75d914-24ee-45b2-84e2-c82e3fc88d02 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:06:11.377265 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e75d914-24ee-45b2-84e2-c82e3fc88d02 service glance] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:06:11.392282 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1324/2647] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:06:11 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:06:11.505941 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17861ca-d3f6-4731-a993-dec9c0059226 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:11.505941 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17861ca-d3f6-4731-a993-dec9c0059226 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:11.505941 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17861ca-d3f6-4731-a993-dec9c0059226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:11.530570 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-d17861ca-d3f6-4731-a993-dec9c0059226 None None] MFA Rules not processed for user `3d0ee2c830754741b0f9eedabf6bded8`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:06:11.532031 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-d17861ca-d3f6-4731-a993-dec9c0059226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:06:11.616806 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1324/2648] 10.222.0.43 () {58 vars in 1009 bytes} [Fri Dec 24 05:06:11 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:06:11.626117 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75d914-24ee-45b2-84e2-c82e3fc88d02 service glance] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:06:11.627822 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-1e75d914-24ee-45b2-84e2-c82e3fc88d02 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:06:11.753749 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75d914-24ee-45b2-84e2-c82e3fc88d02 service glance] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:06:11.759321 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafbd614-8bb2-4cb4-a3d2-195ffa867229 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218ae7d29b71487d86b11aeb380788ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:06:11.760135 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafbd614-8bb2-4cb4-a3d2-195ffa867229 service swift] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:11.760509 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafbd614-8bb2-4cb4-a3d2-195ffa867229 service swift] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:11.760933 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafbd614-8bb2-4cb4-a3d2-195ffa867229 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:11.771467 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafbd614-8bb2-4cb4-a3d2-195ffa867229 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:06:11.773428 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafbd614-8bb2-4cb4-a3d2-195ffa867229 service swift] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:06:11.783953 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1325/2649] 10.222.0.43 () {60 vars in 1384 bytes} [Fri Dec 24 05:06:11 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 24 05:06:16.809560 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17861ca-d3f6-4731-a993-dec9c0059226 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:06:16.877709 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17861ca-d3f6-4731-a993-dec9c0059226 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:06:16.882264 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a11d43-4b18-4aa1-afc9-68c4b6f1b02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:06:16.883169 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a11d43-4b18-4aa1-afc9-68c4b6f1b02e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:16.883432 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a11d43-4b18-4aa1-afc9-68c4b6f1b02e admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:16.883704 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a11d43-4b18-4aa1-afc9-68c4b6f1b02e admin admin] PATH_INFO: `/v3/users/38f31abd56444ef7bcafaa425c311712` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:16.885183 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a11d43-4b18-4aa1-afc9-68c4b6f1b02e admin admin] RBAC: Authorizing `identity:delete_user(user_id=38f31abd56444ef7bcafaa425c311712)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:06:16.889615 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a11d43-4b18-4aa1-afc9-68c4b6f1b02e admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:06:16.945857 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-17a11d43-4b18-4aa1-afc9-68c4b6f1b02e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38f31abd56444ef7bcafaa425c311712'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:06:16.946614 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-17a11d43-4b18-4aa1-afc9-68c4b6f1b02e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38f31abd56444ef7bcafaa425c311712'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:06:16.954528 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-17a11d43-4b18-4aa1-afc9-68c4b6f1b02e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38f31abd56444ef7bcafaa425c311712'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:06:16.965818 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-17a11d43-4b18-4aa1-afc9-68c4b6f1b02e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38f31abd56444ef7bcafaa425c311712'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:06:16.966855 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-17a11d43-4b18-4aa1-afc9-68c4b6f1b02e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38f31abd56444ef7bcafaa425c311712'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:06:16.985477 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1325/2650] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:06:16 2021] DELETE /identity/v3/users/38f31abd56444ef7bcafaa425c311712 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:06:16.990186 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd09c1b-f1cf-4d57-8278-fb6c25819b1d None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:16.990679 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd09c1b-f1cf-4d57-8278-fb6c25819b1d None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:16.990766 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd09c1b-f1cf-4d57-8278-fb6c25819b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:17.013773 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-1bd09c1b-f1cf-4d57-8278-fb6c25819b1d None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:06:17.015013 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-1bd09c1b-f1cf-4d57-8278-fb6c25819b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:06:17.081618 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1326/2651] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:06:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 05:06:17.093237 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a11d43-4b18-4aa1-afc9-68c4b6f1b02e admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:06:17.095163 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-17a11d43-4b18-4aa1-afc9-68c4b6f1b02e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:06:17.169775 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a11d43-4b18-4aa1-afc9-68c4b6f1b02e admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:06:17.174587 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b874e-9993-4876-98b6-a64edcef9ce7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:06:17.175334 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b874e-9993-4876-98b6-a64edcef9ce7 service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:17.175692 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b874e-9993-4876-98b6-a64edcef9ce7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:17.176063 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b874e-9993-4876-98b6-a64edcef9ce7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:17.193604 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799b874e-9993-4876-98b6-a64edcef9ce7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:06:17.195310 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799b874e-9993-4876-98b6-a64edcef9ce7 service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:06:17.208386 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1326/2652] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:06:17 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:06:17.557109 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd09c1b-f1cf-4d57-8278-fb6c25819b1d None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:06:17.558656 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-1bd09c1b-f1cf-4d57-8278-fb6c25819b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:06:17.579294 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd09c1b-f1cf-4d57-8278-fb6c25819b1d None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:06:17.586345 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05365ae-8d90-446f-93eb-236be240e4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:06:17.587255 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05365ae-8d90-446f-93eb-236be240e4e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:17.587531 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05365ae-8d90-446f-93eb-236be240e4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:17.587803 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05365ae-8d90-446f-93eb-236be240e4e9 admin admin] PATH_INFO: `/v3/projects/e1e4473904384550b47b8b6848a76ea0` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:17.589348 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05365ae-8d90-446f-93eb-236be240e4e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1e4473904384550b47b8b6848a76ea0)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:06:17.595118 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05365ae-8d90-446f-93eb-236be240e4e9 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:06:17.669487 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-f05365ae-8d90-446f-93eb-236be240e4e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1e4473904384550b47b8b6848a76ea0', 'request_id': 'req-f05365ae-8d90-446f-93eb-236be240e4e9'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:06:17.679660 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-f05365ae-8d90-446f-93eb-236be240e4e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1e4473904384550b47b8b6848a76ea0', 'request_id': 'req-f05365ae-8d90-446f-93eb-236be240e4e9'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:06:17.685615 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-f05365ae-8d90-446f-93eb-236be240e4e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1e4473904384550b47b8b6848a76ea0', 'request_id': 'req-f05365ae-8d90-446f-93eb-236be240e4e9'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:06:17.697570 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-f05365ae-8d90-446f-93eb-236be240e4e9 admin admin] The token cache is being invalidate because project e1e4473904384550b47b8b6848a76ea0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:06:17.698151 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-f05365ae-8d90-446f-93eb-236be240e4e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:06:17.698895 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-f05365ae-8d90-446f-93eb-236be240e4e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:06:17.700511 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1327/2653] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:06:17 2021] DELETE /identity/v3/projects/e1e4473904384550b47b8b6848a76ea0 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:06:17.706743 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d14e9-28b9-468e-b584-94d1477017d7 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:17.706951 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d14e9-28b9-468e-b584-94d1477017d7 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:17.707233 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d14e9-28b9-468e-b584-94d1477017d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:17.726405 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-7e5d14e9-28b9-468e-b584-94d1477017d7 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:06:17.727649 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-7e5d14e9-28b9-468e-b584-94d1477017d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:06:17.790287 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1327/2654] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:06:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:06:17.798608 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5f9b7-3cc6-49d3-961e-8dbd190426ee None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:17.798863 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5f9b7-3cc6-49d3-961e-8dbd190426ee None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:17.799148 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5f9b7-3cc6-49d3-961e-8dbd190426ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:17.818810 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-dfa5f9b7-3cc6-49d3-961e-8dbd190426ee None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:06:17.820133 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-dfa5f9b7-3cc6-49d3-961e-8dbd190426ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:06:17.828339 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1328/2655] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:06:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:06:17.833019 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d14e9-28b9-468e-b584-94d1477017d7 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:06:17.843740 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d14e9-28b9-468e-b584-94d1477017d7 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:06:17.849111 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e0d7a-8be7-4dde-bf2d-137978715a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:06:17.849941 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e0d7a-8be7-4dde-bf2d-137978715a5b admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:17.850229 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e0d7a-8be7-4dde-bf2d-137978715a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:17.850503 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e0d7a-8be7-4dde-bf2d-137978715a5b admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:17.851272 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720e0d7a-8be7-4dde-bf2d-137978715a5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 05:06:17.851583 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720e0d7a-8be7-4dde-bf2d-137978715a5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:06:17.853258 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720e0d7a-8be7-4dde-bf2d-137978715a5b admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:06:17.866230 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1328/2656] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 05:06:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 05:06:17.870852 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5f9b7-3cc6-49d3-961e-8dbd190426ee None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:06:17.880551 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5f9b7-3cc6-49d3-961e-8dbd190426ee None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:06:17.885391 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f604e0a-6b1f-4da1-9ee7-abab62d7f4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:06:17.886064 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f604e0a-6b1f-4da1-9ee7-abab62d7f4ca admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:17.886340 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f604e0a-6b1f-4da1-9ee7-abab62d7f4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:17.886616 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f604e0a-6b1f-4da1-9ee7-abab62d7f4ca admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:17.887510 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f604e0a-6b1f-4da1-9ee7-abab62d7f4ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:06:17.889472 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f604e0a-6b1f-4da1-9ee7-abab62d7f4ca admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:06:17.917491 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1329/2657] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:06:17 2021] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:06:17.921536 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e0d7a-8be7-4dde-bf2d-137978715a5b admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:06:17.933199 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e0d7a-8be7-4dde-bf2d-137978715a5b admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:06:18.006101 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a4d36-4244-4301-acf5-996239a124f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:06:18.006902 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a4d36-4244-4301-acf5-996239a124f1 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:18.007280 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a4d36-4244-4301-acf5-996239a124f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:18.007650 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a4d36-4244-4301-acf5-996239a124f1 admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:18.008493 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2a4d36-4244-4301-acf5-996239a124f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:06:18.010710 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2a4d36-4244-4301-acf5-996239a124f1 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:06:18.035700 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1329/2658] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:06:17 2021] POST /identity/v3/users => generated 290 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 05:06:18.037019 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f604e0a-6b1f-4da1-9ee7-abab62d7f4ca admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:06:18.053818 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f604e0a-6b1f-4da1-9ee7-abab62d7f4ca admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:06:18.059727 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db6e5e-26cd-4ea9-be67-537a5c9870b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:06:18.060399 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db6e5e-26cd-4ea9-be67-537a5c9870b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:18.060732 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db6e5e-26cd-4ea9-be67-537a5c9870b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:18.061008 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db6e5e-26cd-4ea9-be67-537a5c9870b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:18.061760 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50db6e5e-26cd-4ea9-be67-537a5c9870b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:06:18.063474 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50db6e5e-26cd-4ea9-be67-537a5c9870b0 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:06:18.081375 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1330/2659] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:06:18 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:06:18.082611 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a4d36-4244-4301-acf5-996239a124f1 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:06:18.093772 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a4d36-4244-4301-acf5-996239a124f1 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:06:18.098865 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dab105c-403f-4019-8ad7-f50a46af8a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:06:18.099532 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab105c-403f-4019-8ad7-f50a46af8a18 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:18.099843 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab105c-403f-4019-8ad7-f50a46af8a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:18.100117 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab105c-403f-4019-8ad7-f50a46af8a18 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:18.100904 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dab105c-403f-4019-8ad7-f50a46af8a18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:06:18.103968 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dab105c-403f-4019-8ad7-f50a46af8a18 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:06:18.117238 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1330/2660] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:06:18 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:06:18.119249 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db6e5e-26cd-4ea9-be67-537a5c9870b0 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:06:18.133995 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db6e5e-26cd-4ea9-be67-537a5c9870b0 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:06:18.139378 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd5ed6-0444-42a1-bcee-a78c57d3688e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:06:18.140263 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd5ed6-0444-42a1-bcee-a78c57d3688e admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:18.140568 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd5ed6-0444-42a1-bcee-a78c57d3688e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:18.140842 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd5ed6-0444-42a1-bcee-a78c57d3688e admin admin] PATH_INFO: `/v3/projects/8b1a80c6322a493ba10c69a77168b46f/users/4039d5c6890448ee99194d769c5c387b/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:18.159063 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffd5ed6-0444-42a1-bcee-a78c57d3688e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b1a80c6322a493ba10c69a77168b46f, user_id=4039d5c6890448ee99194d769c5c387b, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:06:18.161812 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffd5ed6-0444-42a1-bcee-a78c57d3688e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:06:18.179870 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1331/2661] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:06:18 2021] PUT /identity/v3/projects/8b1a80c6322a493ba10c69a77168b46f/users/4039d5c6890448ee99194d769c5c387b/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:06:18.185578 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3058c1-4ec0-4616-b633-722bdff8e283 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:18.185578 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3058c1-4ec0-4616-b633-722bdff8e283 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:18.185860 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3058c1-4ec0-4616-b633-722bdff8e283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:18.205187 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-4c3058c1-4ec0-4616-b633-722bdff8e283 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:06:18.206467 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-4c3058c1-4ec0-4616-b633-722bdff8e283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:06:18.273715 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1331/2662] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:06:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 05:06:18.286158 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd5ed6-0444-42a1-bcee-a78c57d3688e admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:06:18.287904 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-bffd5ed6-0444-42a1-bcee-a78c57d3688e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:06:18.358711 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd5ed6-0444-42a1-bcee-a78c57d3688e admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:06:18.362915 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b33b0-1cc3-4068-86c1-92141cc9de72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:06:18.363712 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b33b0-1cc3-4068-86c1-92141cc9de72 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:18.364097 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b33b0-1cc3-4068-86c1-92141cc9de72 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:18.364472 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b33b0-1cc3-4068-86c1-92141cc9de72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:18.377357 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5b33b0-1cc3-4068-86c1-92141cc9de72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:06:18.379002 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5b33b0-1cc3-4068-86c1-92141cc9de72 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:06:18.393496 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1332/2663] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:06:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:06:22.252749 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaea14c-fbcf-43c4-b931-cede38d69bc4 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:22.253957 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaea14c-fbcf-43c4-b931-cede38d69bc4 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:22.254424 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaea14c-fbcf-43c4-b931-cede38d69bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:22.274353 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-4eaea14c-fbcf-43c4-b931-cede38d69bc4 None None] MFA Rules not processed for user `8bd940f9211f415987d3443601acabc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:06:22.275867 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-4eaea14c-fbcf-43c4-b931-cede38d69bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:06:22.351312 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1332/2664] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:06:22 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 05:06:23.560704 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90622554-2b84-4d59-8202-386c5bc917b5 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:23.561529 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90622554-2b84-4d59-8202-386c5bc917b5 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:23.562044 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90622554-2b84-4d59-8202-386c5bc917b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:23.608774 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-90622554-2b84-4d59-8202-386c5bc917b5 None None] MFA Rules not processed for user `4039d5c6890448ee99194d769c5c387b`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:06:23.610459 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-90622554-2b84-4d59-8202-386c5bc917b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:06:23.716695 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1333/2665] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:06:23 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:06:23.721014 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaea14c-fbcf-43c4-b931-cede38d69bc4 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:06:23.734465 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaea14c-fbcf-43c4-b931-cede38d69bc4 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:06:23.739887 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d58dd-e6e9-47bb-8265-8f42ea944e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:06:23.740809 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d58dd-e6e9-47bb-8265-8f42ea944e53 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:23.741165 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d58dd-e6e9-47bb-8265-8f42ea944e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:23.741503 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d58dd-e6e9-47bb-8265-8f42ea944e53 admin admin] PATH_INFO: `/v3/projects` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:23.742303 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d58dd-e6e9-47bb-8265-8f42ea944e53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:06:23.744326 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d58dd-e6e9-47bb-8265-8f42ea944e53 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:06:23.778955 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1333/2666] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:06:23 2021] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 05:06:23.779626 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90622554-2b84-4d59-8202-386c5bc917b5 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:06:23.793606 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90622554-2b84-4d59-8202-386c5bc917b5 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:06:23.885261 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c66dd-16ae-48c1-b701-b751a4398502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:06:23.886598 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c66dd-16ae-48c1-b701-b751a4398502 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:23.886974 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c66dd-16ae-48c1-b701-b751a4398502 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:23.887303 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c66dd-16ae-48c1-b701-b751a4398502 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:23.888175 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c66dd-16ae-48c1-b701-b751a4398502 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:06:23.890376 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c66dd-16ae-48c1-b701-b751a4398502 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:06:23.918614 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1334/2667] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:06:23 2021] POST /identity/v3/users => generated 296 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:06:23.923218 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d58dd-e6e9-47bb-8265-8f42ea944e53 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:06:23.934513 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d58dd-e6e9-47bb-8265-8f42ea944e53 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:06:23.940811 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5abb12d-e17d-4667-9288-9012aafcbbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:06:23.941526 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5abb12d-e17d-4667-9288-9012aafcbbf3 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:23.941804 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5abb12d-e17d-4667-9288-9012aafcbbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:23.942077 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5abb12d-e17d-4667-9288-9012aafcbbf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:23.943006 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5abb12d-e17d-4667-9288-9012aafcbbf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:06:23.945017 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5abb12d-e17d-4667-9288-9012aafcbbf3 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:06:23.961495 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c66dd-16ae-48c1-b701-b751a4398502 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:06:23.968194 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1334/2668] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:06:23 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:06:23.972497 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c66dd-16ae-48c1-b701-b751a4398502 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:06:23.978624 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1713fa-d7a6-42ab-a9fc-544bfe4226df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:06:23.980016 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1713fa-d7a6-42ab-a9fc-544bfe4226df admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:23.980016 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1713fa-d7a6-42ab-a9fc-544bfe4226df admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:23.980288 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1713fa-d7a6-42ab-a9fc-544bfe4226df admin admin] PATH_INFO: `/v3/projects/bf7b649b22d644f4971ea81dfca887e0/users/d60d649823d04e47a791100bdb3362e4/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:24.000930 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1713fa-d7a6-42ab-a9fc-544bfe4226df admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf7b649b22d644f4971ea81dfca887e0, user_id=d60d649823d04e47a791100bdb3362e4, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:06:24.004097 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1713fa-d7a6-42ab-a9fc-544bfe4226df admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:06:24.018598 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1335/2669] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:06:23 2021] PUT /identity/v3/projects/bf7b649b22d644f4971ea81dfca887e0/users/d60d649823d04e47a791100bdb3362e4/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 05:06:24.022810 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5abb12d-e17d-4667-9288-9012aafcbbf3 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:06:24.034938 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5abb12d-e17d-4667-9288-9012aafcbbf3 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:06:24.100412 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b623c2-ae3a-4310-8ae7-904abed14242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:06:24.101387 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b623c2-ae3a-4310-8ae7-904abed14242 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:24.101791 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b623c2-ae3a-4310-8ae7-904abed14242 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:24.102160 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b623c2-ae3a-4310-8ae7-904abed14242 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:24.103043 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b623c2-ae3a-4310-8ae7-904abed14242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:06:24.104843 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b623c2-ae3a-4310-8ae7-904abed14242 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:06:24.117339 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1335/2670] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:06:24 2021] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:06:24.122120 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1713fa-d7a6-42ab-a9fc-544bfe4226df admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:06:24.133743 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1713fa-d7a6-42ab-a9fc-544bfe4226df admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:06:24.138608 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3ac07-d498-45d2-9851-1984a76ec3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:06:24.139774 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3ac07-d498-45d2-9851-1984a76ec3c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:24.140048 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3ac07-d498-45d2-9851-1984a76ec3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:24.140318 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3ac07-d498-45d2-9851-1984a76ec3c9 admin admin] PATH_INFO: `/v3/projects/bf7b649b22d644f4971ea81dfca887e0/users/d60d649823d04e47a791100bdb3362e4/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:24.142560 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e3ac07-d498-45d2-9851-1984a76ec3c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf7b649b22d644f4971ea81dfca887e0, user_id=d60d649823d04e47a791100bdb3362e4, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:06:24.145246 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e3ac07-d498-45d2-9851-1984a76ec3c9 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:06:24.156639 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1336/2671] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:06:24 2021] PUT /identity/v3/projects/bf7b649b22d644f4971ea81dfca887e0/users/d60d649823d04e47a791100bdb3362e4/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:06:25.012310 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba48ef-b720-42e8-aa55-e5626c9f303b None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:25.012888 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba48ef-b720-42e8-aa55-e5626c9f303b None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:25.012888 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba48ef-b720-42e8-aa55-e5626c9f303b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:25.046567 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-11ba48ef-b720-42e8-aa55-e5626c9f303b None None] MFA Rules not processed for user `3d0ee2c830754741b0f9eedabf6bded8`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:06:25.049243 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-11ba48ef-b720-42e8-aa55-e5626c9f303b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:06:25.119669 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1336/2672] 10.222.0.43 () {58 vars in 1009 bytes} [Fri Dec 24 05:06:25 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 05:06:25.139940 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3ac07-d498-45d2-9851-1984a76ec3c9 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:06:25.141992 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-41e3ac07-d498-45d2-9851-1984a76ec3c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:06:25.259405 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3ac07-d498-45d2-9851-1984a76ec3c9 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:06:25.268126 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10872323-ba3d-4be1-a0e1-3a9c46c1dc79 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218ae7d29b71487d86b11aeb380788ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:06:25.269178 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10872323-ba3d-4be1-a0e1-3a9c46c1dc79 service swift] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:25.269556 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10872323-ba3d-4be1-a0e1-3a9c46c1dc79 service swift] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:25.270209 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10872323-ba3d-4be1-a0e1-3a9c46c1dc79 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:25.281203 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10872323-ba3d-4be1-a0e1-3a9c46c1dc79 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:06:25.287432 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10872323-ba3d-4be1-a0e1-3a9c46c1dc79 service swift] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:06:25.306914 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1337/2673] 10.222.0.43 () {60 vars in 1384 bytes} [Fri Dec 24 05:06:25 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 24 05:06:30.960980 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a754f-129d-43b6-abeb-35e5086ca2af None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:30.961480 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a754f-129d-43b6-abeb-35e5086ca2af None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:30.962137 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a754f-129d-43b6-abeb-35e5086ca2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:31.017252 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-556a754f-129d-43b6-abeb-35e5086ca2af None None] MFA Rules not processed for user `d60d649823d04e47a791100bdb3362e4`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:06:31.018517 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-556a754f-129d-43b6-abeb-35e5086ca2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:06:31.133691 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1337/2674] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:06:30 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:06:31.145378 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10872323-ba3d-4be1-a0e1-3a9c46c1dc79 service swift] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:06:31.147075 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-10872323-ba3d-4be1-a0e1-3a9c46c1dc79 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:06:31.248226 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10872323-ba3d-4be1-a0e1-3a9c46c1dc79 service swift] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:06:31.253745 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94551f7-4391-44f0-92f5-fb61925af00a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f9ad1e8f8f74edcb44aabe17eb59648', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:06:31.254394 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94551f7-4391-44f0-92f5-fb61925af00a service nova] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:31.254668 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94551f7-4391-44f0-92f5-fb61925af00a service nova] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:31.254938 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94551f7-4391-44f0-92f5-fb61925af00a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:31.329695 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94551f7-4391-44f0-92f5-fb61925af00a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:06:31.339530 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94551f7-4391-44f0-92f5-fb61925af00a service nova] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:06:31.349034 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1338/2675] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:06:31 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:06:47.378145 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5aa4b-7b0d-47d6-98a5-ac35a22619e5 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:47.378763 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5aa4b-7b0d-47d6-98a5-ac35a22619e5 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:47.378763 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5aa4b-7b0d-47d6-98a5-ac35a22619e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:47.396372 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-74a5aa4b-7b0d-47d6-98a5-ac35a22619e5 None None] MFA Rules not processed for user `979cc4a0723b4543a16197d393c7929a`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:06:47.397601 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-74a5aa4b-7b0d-47d6-98a5-ac35a22619e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:06:47.461593 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1338/2676] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:06:47 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:06:57.178984 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1e94d-8300-47c3-a372-1305b90a5cf6 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:06:57.179552 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1e94d-8300-47c3-a372-1305b90a5cf6 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:06:57.179552 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1e94d-8300-47c3-a372-1305b90a5cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:06:57.198068 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-62d1e94d-8300-47c3-a372-1305b90a5cf6 None None] MFA Rules not processed for user `4039d5c6890448ee99194d769c5c387b`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:06:57.199221 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-62d1e94d-8300-47c3-a372-1305b90a5cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:06:57.208196 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1339/2677] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:06:57 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:07:02.046421 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5aa4b-7b0d-47d6-98a5-ac35a22619e5 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:07:02.048033 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-74a5aa4b-7b0d-47d6-98a5-ac35a22619e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:07:02.113234 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5aa4b-7b0d-47d6-98a5-ac35a22619e5 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:07:02.117152 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0849d81-b4f9-405a-9740-1660f35df423 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:07:02.118867 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0849d81-b4f9-405a-9740-1660f35df423 service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:07:02.119151 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0849d81-b4f9-405a-9740-1660f35df423 service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:07:02.119427 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0849d81-b4f9-405a-9740-1660f35df423 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:07:02.121466 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-b0849d81-b4f9-405a-9740-1660f35df423 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:07:02.188132 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0849d81-b4f9-405a-9740-1660f35df423 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:07:02.189603 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0849d81-b4f9-405a-9740-1660f35df423 service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:07:02.199046 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1339/2678] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:07:02 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:07:03.023675 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1e94d-8300-47c3-a372-1305b90a5cf6 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:07:03.025849 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-62d1e94d-8300-47c3-a372-1305b90a5cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:07:03.045506 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1e94d-8300-47c3-a372-1305b90a5cf6 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:07:03.051557 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14a655f-7b9c-4fbd-a68f-f5888b352f68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f9ad1e8f8f74edcb44aabe17eb59648', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:07:03.052357 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a655f-7b9c-4fbd-a68f-f5888b352f68 service nova] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:07:03.052754 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a655f-7b9c-4fbd-a68f-f5888b352f68 service nova] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:07:03.054296 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a655f-7b9c-4fbd-a68f-f5888b352f68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:07:03.056399 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-a14a655f-7b9c-4fbd-a68f-f5888b352f68 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:07:03.069291 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14a655f-7b9c-4fbd-a68f-f5888b352f68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:07:03.071335 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14a655f-7b9c-4fbd-a68f-f5888b352f68 service nova] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:07:03.083825 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1340/2679] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:07:03 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:07:15.185817 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0849d81-b4f9-405a-9740-1660f35df423 service neutron] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:07:15.194983 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0849d81-b4f9-405a-9740-1660f35df423 service neutron] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:07:15.199810 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73271ca4-ec92-48ea-9b02-4350614cffdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:07:15.200444 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73271ca4-ec92-48ea-9b02-4350614cffdd service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:07:15.200759 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73271ca4-ec92-48ea-9b02-4350614cffdd service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:07:15.201028 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73271ca4-ec92-48ea-9b02-4350614cffdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:07:15.211805 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73271ca4-ec92-48ea-9b02-4350614cffdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:07:15.213285 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73271ca4-ec92-48ea-9b02-4350614cffdd service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:07:15.223246 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1340/2680] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:07:15 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:07:29.145538 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14a655f-7b9c-4fbd-a68f-f5888b352f68 service nova] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:07:29.147042 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-a14a655f-7b9c-4fbd-a68f-f5888b352f68 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:07:29.225261 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14a655f-7b9c-4fbd-a68f-f5888b352f68 service nova] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:07:29.233268 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd01e7-348c-46ed-b0a4-08eec29fa98e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '430d6177e74c4dbda7fb83d04c75617e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:07:29.234180 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd01e7-348c-46ed-b0a4-08eec29fa98e service placement] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:07:29.234462 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd01e7-348c-46ed-b0a4-08eec29fa98e service placement] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:07:29.234735 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd01e7-348c-46ed-b0a4-08eec29fa98e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:07:29.237466 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-0ddd01e7-348c-46ed-b0a4-08eec29fa98e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:07:29.256583 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddd01e7-348c-46ed-b0a4-08eec29fa98e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:07:29.258552 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddd01e7-348c-46ed-b0a4-08eec29fa98e service placement] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:07:29.269333 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1341/2681] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:07:29 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:08:58.166879 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71d06d-f627-4d9d-b836-4fa9eb988d97 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:08:58.167430 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71d06d-f627-4d9d-b836-4fa9eb988d97 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:08:58.167430 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71d06d-f627-4d9d-b836-4fa9eb988d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:08:58.185497 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-ac71d06d-f627-4d9d-b836-4fa9eb988d97 None None] MFA Rules not processed for user `3d0ee2c830754741b0f9eedabf6bded8`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:08:58.186709 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-ac71d06d-f627-4d9d-b836-4fa9eb988d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:08:58.194653 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1341/2682] 10.222.0.43 () {58 vars in 1009 bytes} [Fri Dec 24 05:08:58 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:08:58.235173 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd01e7-348c-46ed-b0a4-08eec29fa98e service placement] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:08:58.247344 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd01e7-348c-46ed-b0a4-08eec29fa98e service placement] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:08:58.252896 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cbaee7-1e94-4a28-992d-0ec975d57f23 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218ae7d29b71487d86b11aeb380788ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:08:58.253534 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbaee7-1e94-4a28-992d-0ec975d57f23 service swift] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:08:58.253809 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbaee7-1e94-4a28-992d-0ec975d57f23 service swift] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:08:58.254085 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbaee7-1e94-4a28-992d-0ec975d57f23 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:08:58.262328 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cbaee7-1e94-4a28-992d-0ec975d57f23 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:08:58.263899 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cbaee7-1e94-4a28-992d-0ec975d57f23 service swift] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:08:58.271900 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1342/2683] 10.222.0.43 () {60 vars in 1384 bytes} [Fri Dec 24 05:08:58 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 24 05:09:09.759273 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac71d06d-f627-4d9d-b836-4fa9eb988d97 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:09:09.770310 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac71d06d-f627-4d9d-b836-4fa9eb988d97 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:09:09.774615 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb321461-e64b-41b9-9c05-512d04937811 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:09:09.775256 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb321461-e64b-41b9-9c05-512d04937811 service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:09:09.775539 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb321461-e64b-41b9-9c05-512d04937811 service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:09:09.775810 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb321461-e64b-41b9-9c05-512d04937811 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:09:09.778140 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-eb321461-e64b-41b9-9c05-512d04937811 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:09:09.793878 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb321461-e64b-41b9-9c05-512d04937811 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:09:09.795324 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb321461-e64b-41b9-9c05-512d04937811 service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:09:09.808731 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1342/2684] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:09:09 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:09:11.381840 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cbaee7-1e94-4a28-992d-0ec975d57f23 service swift] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:09:11.383422 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-88cbaee7-1e94-4a28-992d-0ec975d57f23 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:09:11.442732 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cbaee7-1e94-4a28-992d-0ec975d57f23 service swift] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:09:11.446889 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c686f2c-3630-496f-a6ae-ea253918aeb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:09:11.447537 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c686f2c-3630-496f-a6ae-ea253918aeb9 service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:09:11.447813 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c686f2c-3630-496f-a6ae-ea253918aeb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:09:11.448094 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c686f2c-3630-496f-a6ae-ea253918aeb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:09:11.450221 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-9c686f2c-3630-496f-a6ae-ea253918aeb9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:09:11.465031 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c686f2c-3630-496f-a6ae-ea253918aeb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:09:11.466474 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c686f2c-3630-496f-a6ae-ea253918aeb9 service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:09:11.479131 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1343/2685] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:09:11 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:09:14.467916 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98cf2e-4607-45c6-b4d9-509636d1d5f6 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:09:14.468416 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98cf2e-4607-45c6-b4d9-509636d1d5f6 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:09:14.468517 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98cf2e-4607-45c6-b4d9-509636d1d5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:09:14.487090 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-bd98cf2e-4607-45c6-b4d9-509636d1d5f6 None None] MFA Rules not processed for user `3d0ee2c830754741b0f9eedabf6bded8`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:09:14.488652 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-bd98cf2e-4607-45c6-b4d9-509636d1d5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:09:14.496751 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1343/2686] 10.222.0.43 () {58 vars in 1009 bytes} [Fri Dec 24 05:09:14 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:09:14.509700 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c686f2c-3630-496f-a6ae-ea253918aeb9 service cinder] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:09:14.522785 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c686f2c-3630-496f-a6ae-ea253918aeb9 service cinder] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:09:14.529347 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ab69a-9c49-46a7-898b-abcce8cb5293 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218ae7d29b71487d86b11aeb380788ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:09:14.530021 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ab69a-9c49-46a7-898b-abcce8cb5293 service swift] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:09:14.530299 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ab69a-9c49-46a7-898b-abcce8cb5293 service swift] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:09:14.530569 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ab69a-9c49-46a7-898b-abcce8cb5293 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:09:14.539780 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4ab69a-9c49-46a7-898b-abcce8cb5293 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:09:14.541842 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4ab69a-9c49-46a7-898b-abcce8cb5293 service swift] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:09:14.550293 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1344/2687] 10.222.0.43 () {60 vars in 1384 bytes} [Fri Dec 24 05:09:14 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 24 05:09:18.626152 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd98cf2e-4607-45c6-b4d9-509636d1d5f6 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:09:18.640605 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd98cf2e-4607-45c6-b4d9-509636d1d5f6 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:09:18.647100 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dec7eb-882c-4b95-bc4a-b4ad508b4b3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f9ad1e8f8f74edcb44aabe17eb59648', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:09:18.647768 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dec7eb-882c-4b95-bc4a-b4ad508b4b3f service nova] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:09:18.648040 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dec7eb-882c-4b95-bc4a-b4ad508b4b3f service nova] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:09:18.648318 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dec7eb-882c-4b95-bc4a-b4ad508b4b3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:09:18.650344 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-c6dec7eb-882c-4b95-bc4a-b4ad508b4b3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:09:18.683095 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dec7eb-882c-4b95-bc4a-b4ad508b4b3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:09:18.685293 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dec7eb-882c-4b95-bc4a-b4ad508b4b3f service nova] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:09:18.720182 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1344/2688] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:09:18 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:09:29.354733 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ab69a-9c49-46a7-898b-abcce8cb5293 service swift] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:09:29.364780 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ab69a-9c49-46a7-898b-abcce8cb5293 service swift] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:09:29.369377 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af2adb6-edd3-43a7-a9e7-30e2dd1b4b3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:09:29.370029 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2adb6-edd3-43a7-a9e7-30e2dd1b4b3d service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:09:29.370309 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2adb6-edd3-43a7-a9e7-30e2dd1b4b3d service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:09:29.370579 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2adb6-edd3-43a7-a9e7-30e2dd1b4b3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:09:29.372789 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-8af2adb6-edd3-43a7-a9e7-30e2dd1b4b3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:09:29.383892 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af2adb6-edd3-43a7-a9e7-30e2dd1b4b3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:09:29.385352 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af2adb6-edd3-43a7-a9e7-30e2dd1b4b3d service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:09:29.394374 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1345/2689] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:09:29 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:09:34.944586 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ec8ed-1415-4378-b70e-d2e8e3501337 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:09:34.945165 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ec8ed-1415-4378-b70e-d2e8e3501337 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:09:34.945165 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ec8ed-1415-4378-b70e-d2e8e3501337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:09:34.971903 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-a56ec8ed-1415-4378-b70e-d2e8e3501337 None None] MFA Rules not processed for user `3d0ee2c830754741b0f9eedabf6bded8`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:09:34.973123 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-a56ec8ed-1415-4378-b70e-d2e8e3501337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:09:34.982568 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1345/2690] 10.222.0.43 () {58 vars in 967 bytes} [Fri Dec 24 05:09:34 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:09:34.996478 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af2adb6-edd3-43a7-a9e7-30e2dd1b4b3d service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:09:35.011818 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af2adb6-edd3-43a7-a9e7-30e2dd1b4b3d service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:09:35.018066 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a244bef8-5f5e-482a-a751-6452e0d95ff6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218ae7d29b71487d86b11aeb380788ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:09:35.018861 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244bef8-5f5e-482a-a751-6452e0d95ff6 service swift] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:09:35.019151 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244bef8-5f5e-482a-a751-6452e0d95ff6 service swift] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:09:35.019429 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244bef8-5f5e-482a-a751-6452e0d95ff6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:09:35.027884 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a244bef8-5f5e-482a-a751-6452e0d95ff6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:09:35.029515 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a244bef8-5f5e-482a-a751-6452e0d95ff6 service swift] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:09:35.037430 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1346/2691] 10.222.0.43 () {60 vars in 1384 bytes} [Fri Dec 24 05:09:34 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 24 05:09:40.434462 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6c396-3c69-4c96-a85d-8741e4822f49 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:09:40.434981 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6c396-3c69-4c96-a85d-8741e4822f49 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:09:40.434981 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6c396-3c69-4c96-a85d-8741e4822f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:09:40.452834 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-9bd6c396-3c69-4c96-a85d-8741e4822f49 None None] MFA Rules not processed for user `4039d5c6890448ee99194d769c5c387b`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:09:40.454031 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-9bd6c396-3c69-4c96-a85d-8741e4822f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:09:40.462490 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1346/2692] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:09:40 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:09:40.781640 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a244bef8-5f5e-482a-a751-6452e0d95ff6 service swift] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:09:40.796175 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a244bef8-5f5e-482a-a751-6452e0d95ff6 service swift] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:09:40.802131 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cdf8e9-d87b-414f-8f52-1ed668da7b8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:09:40.802769 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cdf8e9-d87b-414f-8f52-1ed668da7b8b service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:09:40.803048 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cdf8e9-d87b-414f-8f52-1ed668da7b8b service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:09:40.803318 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cdf8e9-d87b-414f-8f52-1ed668da7b8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:09:40.805431 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-c0cdf8e9-d87b-414f-8f52-1ed668da7b8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:09:40.817388 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cdf8e9-d87b-414f-8f52-1ed668da7b8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:09:40.817388 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cdf8e9-d87b-414f-8f52-1ed668da7b8b service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:09:40.825616 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1347/2693] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:09:40 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:09:41.301145 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa881a-6f3e-499a-8d38-9f26d7033378 None None] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:09:41.301456 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa881a-6f3e-499a-8d38-9f26d7033378 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:09:41.301734 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa881a-6f3e-499a-8d38-9f26d7033378 None None] PATH_INFO: `/` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:09:41.303585 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1347/2694] 10.222.0.43 () {54 vars in 960 bytes} [Fri Dec 24 05:09:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 24 05:09:41.309331 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e277aea-07ed-4b42-9b9e-ce798b96d13e None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:09:41.309850 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e277aea-07ed-4b42-9b9e-ce798b96d13e None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:09:41.310131 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e277aea-07ed-4b42-9b9e-ce798b96d13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:09:41.349041 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-1e277aea-07ed-4b42-9b9e-ce798b96d13e None None] MFA Rules not processed for user `430d6177e74c4dbda7fb83d04c75617e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:09:41.350253 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-1e277aea-07ed-4b42-9b9e-ce798b96d13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:09:41.359209 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1348/2695] 10.222.0.43 () {58 vars in 1057 bytes} [Fri Dec 24 05:09:41 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:09:41.367437 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa881a-6f3e-499a-8d38-9f26d7033378 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:09:41.381949 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa881a-6f3e-499a-8d38-9f26d7033378 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:09:41.386993 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23407382-ddd0-4869-aa16-96c56ea1c6b5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '430d6177e74c4dbda7fb83d04c75617e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:09:41.387629 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23407382-ddd0-4869-aa16-96c56ea1c6b5 service placement] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:09:41.387908 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23407382-ddd0-4869-aa16-96c56ea1c6b5 service placement] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:09:41.388179 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23407382-ddd0-4869-aa16-96c56ea1c6b5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:09:41.389983 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-23407382-ddd0-4869-aa16-96c56ea1c6b5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:09:41.401466 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23407382-ddd0-4869-aa16-96c56ea1c6b5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:09:41.403214 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23407382-ddd0-4869-aa16-96c56ea1c6b5 service placement] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:09:41.413089 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1348/2696] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:09:41 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:09:50.318301 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956a513-2249-40b4-9639-a41d4d03cbfc None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:09:50.318851 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956a513-2249-40b4-9639-a41d4d03cbfc None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:09:50.318851 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956a513-2249-40b4-9639-a41d4d03cbfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:09:50.339612 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-5956a513-2249-40b4-9639-a41d4d03cbfc None None] MFA Rules not processed for user `3d0ee2c830754741b0f9eedabf6bded8`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:09:50.340850 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-5956a513-2249-40b4-9639-a41d4d03cbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:09:50.350510 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1349/2697] 10.222.0.43 () {58 vars in 967 bytes} [Fri Dec 24 05:09:50 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:09:50.366850 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23407382-ddd0-4869-aa16-96c56ea1c6b5 service placement] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:09:50.378438 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23407382-ddd0-4869-aa16-96c56ea1c6b5 service placement] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:09:50.384242 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ec353-2c72-44a8-a30f-81e0e3725de1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218ae7d29b71487d86b11aeb380788ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:09:50.384910 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ec353-2c72-44a8-a30f-81e0e3725de1 service swift] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:09:50.385203 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ec353-2c72-44a8-a30f-81e0e3725de1 service swift] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:09:50.385457 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ec353-2c72-44a8-a30f-81e0e3725de1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:09:50.393756 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ec353-2c72-44a8-a30f-81e0e3725de1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:09:50.395329 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ec353-2c72-44a8-a30f-81e0e3725de1 service swift] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:09:50.403410 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1349/2698] 10.222.0.43 () {60 vars in 1384 bytes} [Fri Dec 24 05:09:50 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 24 05:09:57.752825 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5956a513-2249-40b4-9639-a41d4d03cbfc None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:09:57.760803 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-5956a513-2249-40b4-9639-a41d4d03cbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:09:57.836007 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5956a513-2249-40b4-9639-a41d4d03cbfc None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:09:57.842767 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278bd7a4-c616-4670-ad1a-2765882d7472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:09:57.843694 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278bd7a4-c616-4670-ad1a-2765882d7472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:09:57.843974 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278bd7a4-c616-4670-ad1a-2765882d7472 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:09:57.844308 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278bd7a4-c616-4670-ad1a-2765882d7472 admin admin] PATH_INFO: `/v3/users/8bd940f9211f415987d3443601acabc4` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:09:57.845679 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278bd7a4-c616-4670-ad1a-2765882d7472 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bd940f9211f415987d3443601acabc4)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:09:57.847663 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278bd7a4-c616-4670-ad1a-2765882d7472 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:09:57.899399 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-278bd7a4-c616-4670-ad1a-2765882d7472 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bd940f9211f415987d3443601acabc4'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:09:57.900097 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-278bd7a4-c616-4670-ad1a-2765882d7472 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bd940f9211f415987d3443601acabc4'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:09:57.908878 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-278bd7a4-c616-4670-ad1a-2765882d7472 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bd940f9211f415987d3443601acabc4'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:09:57.916309 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-278bd7a4-c616-4670-ad1a-2765882d7472 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bd940f9211f415987d3443601acabc4'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:09:57.932078 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-278bd7a4-c616-4670-ad1a-2765882d7472 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bd940f9211f415987d3443601acabc4'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:09:57.939290 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1350/2699] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:09:57 2021] DELETE /identity/v3/users/8bd940f9211f415987d3443601acabc4 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:09:58.126992 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ec353-2c72-44a8-a30f-81e0e3725de1 service swift] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:09:58.145491 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ec353-2c72-44a8-a30f-81e0e3725de1 service swift] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:09:58.214301 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf9377-4c08-4d9a-91b7-f65a514fd7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:09:58.215177 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf9377-4c08-4d9a-91b7-f65a514fd7bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:09:58.215454 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf9377-4c08-4d9a-91b7-f65a514fd7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:09:58.215720 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf9377-4c08-4d9a-91b7-f65a514fd7bb admin admin] PATH_INFO: `/v3/projects/f081e71a66b74c3bb12e1bec9d9a5cd1` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:09:58.216977 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf9377-4c08-4d9a-91b7-f65a514fd7bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f081e71a66b74c3bb12e1bec9d9a5cd1)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:09:58.218870 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf9377-4c08-4d9a-91b7-f65a514fd7bb admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:09:58.266291 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-7edf9377-4c08-4d9a-91b7-f65a514fd7bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'request_id': 'req-7edf9377-4c08-4d9a-91b7-f65a514fd7bb'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:09:58.275030 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-7edf9377-4c08-4d9a-91b7-f65a514fd7bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'request_id': 'req-7edf9377-4c08-4d9a-91b7-f65a514fd7bb'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:09:58.281052 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-7edf9377-4c08-4d9a-91b7-f65a514fd7bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'request_id': 'req-7edf9377-4c08-4d9a-91b7-f65a514fd7bb'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:09:58.295573 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-7edf9377-4c08-4d9a-91b7-f65a514fd7bb admin admin] The token cache is being invalidate because project f081e71a66b74c3bb12e1bec9d9a5cd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:09:58.295857 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-7edf9377-4c08-4d9a-91b7-f65a514fd7bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:09:58.296509 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-7edf9377-4c08-4d9a-91b7-f65a514fd7bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:09:58.298173 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1350/2700] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:09:58 2021] DELETE /identity/v3/projects/f081e71a66b74c3bb12e1bec9d9a5cd1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:09:58.302408 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278bd7a4-c616-4670-ad1a-2765882d7472 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:09:58.304054 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-278bd7a4-c616-4670-ad1a-2765882d7472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:09:58.317558 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278bd7a4-c616-4670-ad1a-2765882d7472 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:09:58.374844 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b776e54d-62b5-4fee-8bf0-1754f264aba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:09:58.375739 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776e54d-62b5-4fee-8bf0-1754f264aba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:09:58.376017 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776e54d-62b5-4fee-8bf0-1754f264aba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:09:58.376318 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776e54d-62b5-4fee-8bf0-1754f264aba1 admin admin] PATH_INFO: `/v3/users/5ca0652f51eb4221917dceb89516f084` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:09:58.377648 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b776e54d-62b5-4fee-8bf0-1754f264aba1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ca0652f51eb4221917dceb89516f084)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:09:58.379616 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b776e54d-62b5-4fee-8bf0-1754f264aba1 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:09:58.426446 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b776e54d-62b5-4fee-8bf0-1754f264aba1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ca0652f51eb4221917dceb89516f084'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:09:58.427110 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b776e54d-62b5-4fee-8bf0-1754f264aba1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ca0652f51eb4221917dceb89516f084'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:09:58.435951 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b776e54d-62b5-4fee-8bf0-1754f264aba1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ca0652f51eb4221917dceb89516f084'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:09:58.443179 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b776e54d-62b5-4fee-8bf0-1754f264aba1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ca0652f51eb4221917dceb89516f084'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:09:58.454618 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b776e54d-62b5-4fee-8bf0-1754f264aba1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ca0652f51eb4221917dceb89516f084'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:09:58.461442 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1351/2701] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:09:58 2021] DELETE /identity/v3/users/5ca0652f51eb4221917dceb89516f084 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:09:58.640941 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf9377-4c08-4d9a-91b7-f65a514fd7bb admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:09:58.642479 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-7edf9377-4c08-4d9a-91b7-f65a514fd7bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:09:58.656842 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf9377-4c08-4d9a-91b7-f65a514fd7bb admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:09:58.714644 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37dbb2-c02d-4e5d-b7f7-0bfbf0b0a611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:09:58.715617 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37dbb2-c02d-4e5d-b7f7-0bfbf0b0a611 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:09:58.715895 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37dbb2-c02d-4e5d-b7f7-0bfbf0b0a611 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:09:58.716179 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37dbb2-c02d-4e5d-b7f7-0bfbf0b0a611 admin admin] PATH_INFO: `/v3/projects/3f3829205cff4830ba6b76ce6b6a8469` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:09:58.717405 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c37dbb2-c02d-4e5d-b7f7-0bfbf0b0a611 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f3829205cff4830ba6b76ce6b6a8469)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:09:58.719336 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c37dbb2-c02d-4e5d-b7f7-0bfbf0b0a611 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:09:58.766750 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-1c37dbb2-c02d-4e5d-b7f7-0bfbf0b0a611 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f3829205cff4830ba6b76ce6b6a8469', 'request_id': 'req-1c37dbb2-c02d-4e5d-b7f7-0bfbf0b0a611'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:09:58.774604 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-1c37dbb2-c02d-4e5d-b7f7-0bfbf0b0a611 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f3829205cff4830ba6b76ce6b6a8469', 'request_id': 'req-1c37dbb2-c02d-4e5d-b7f7-0bfbf0b0a611'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:09:58.780091 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-1c37dbb2-c02d-4e5d-b7f7-0bfbf0b0a611 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f3829205cff4830ba6b76ce6b6a8469', 'request_id': 'req-1c37dbb2-c02d-4e5d-b7f7-0bfbf0b0a611'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:09:58.791379 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-1c37dbb2-c02d-4e5d-b7f7-0bfbf0b0a611 admin admin] The token cache is being invalidate because project 3f3829205cff4830ba6b76ce6b6a8469 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:09:58.791719 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-1c37dbb2-c02d-4e5d-b7f7-0bfbf0b0a611 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:09:58.792285 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-1c37dbb2-c02d-4e5d-b7f7-0bfbf0b0a611 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:09:58.794012 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1351/2702] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:09:58 2021] DELETE /identity/v3/projects/3f3829205cff4830ba6b76ce6b6a8469 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:10:35.106846 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b776e54d-62b5-4fee-8bf0-1754f264aba1 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:10:35.109136 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-b776e54d-62b5-4fee-8bf0-1754f264aba1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:10:35.194953 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b776e54d-62b5-4fee-8bf0-1754f264aba1 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:10:35.280778 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4259a61-8fbf-4429-ae12-94135697503c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f9ad1e8f8f74edcb44aabe17eb59648', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:10:35.281399 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4259a61-8fbf-4429-ae12-94135697503c service nova] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:10:35.281703 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4259a61-8fbf-4429-ae12-94135697503c service nova] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:10:35.282040 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4259a61-8fbf-4429-ae12-94135697503c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:10:35.284575 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-f4259a61-8fbf-4429-ae12-94135697503c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:10:35.297663 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4259a61-8fbf-4429-ae12-94135697503c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:10:35.299282 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4259a61-8fbf-4429-ae12-94135697503c service nova] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:10:35.317702 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1352/2703] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:10:35 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:10:39.063757 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37dbb2-c02d-4e5d-b7f7-0bfbf0b0a611 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:10:39.065395 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-1c37dbb2-c02d-4e5d-b7f7-0bfbf0b0a611 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:10:39.122532 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37dbb2-c02d-4e5d-b7f7-0bfbf0b0a611 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:10:39.126920 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d380c39-074a-45db-8fb6-3e5efd5936eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:10:39.127551 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d380c39-074a-45db-8fb6-3e5efd5936eb service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:10:39.127838 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d380c39-074a-45db-8fb6-3e5efd5936eb service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:10:39.128117 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d380c39-074a-45db-8fb6-3e5efd5936eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:10:39.130255 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-5d380c39-074a-45db-8fb6-3e5efd5936eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:10:39.193267 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d380c39-074a-45db-8fb6-3e5efd5936eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:10:39.194718 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d380c39-074a-45db-8fb6-3e5efd5936eb service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:10:39.204664 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1352/2704] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:10:39 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:10:42.443201 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4259a61-8fbf-4429-ae12-94135697503c service nova] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:10:42.444748 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-f4259a61-8fbf-4429-ae12-94135697503c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:10:42.460559 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4259a61-8fbf-4429-ae12-94135697503c service nova] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:10:42.465884 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18916a-3ede-4b2d-abbf-4b229f781091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:10:42.466791 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18916a-3ede-4b2d-abbf-4b229f781091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:10:42.467071 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18916a-3ede-4b2d-abbf-4b229f781091 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:10:42.467346 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18916a-3ede-4b2d-abbf-4b229f781091 admin admin] PATH_INFO: `/v3/users/979cc4a0723b4543a16197d393c7929a` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:10:42.468695 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18916a-3ede-4b2d-abbf-4b229f781091 admin admin] RBAC: Authorizing `identity:delete_user(user_id=979cc4a0723b4543a16197d393c7929a)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:10:42.470621 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18916a-3ede-4b2d-abbf-4b229f781091 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:10:42.518553 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-cf18916a-3ede-4b2d-abbf-4b229f781091 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '979cc4a0723b4543a16197d393c7929a'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:10:42.519197 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-cf18916a-3ede-4b2d-abbf-4b229f781091 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '979cc4a0723b4543a16197d393c7929a'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:10:42.527715 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-cf18916a-3ede-4b2d-abbf-4b229f781091 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '979cc4a0723b4543a16197d393c7929a'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:10:42.534423 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-cf18916a-3ede-4b2d-abbf-4b229f781091 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '979cc4a0723b4543a16197d393c7929a'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:10:42.546024 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-cf18916a-3ede-4b2d-abbf-4b229f781091 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '979cc4a0723b4543a16197d393c7929a'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:10:42.552199 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1353/2705] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:10:42 2021] DELETE /identity/v3/users/979cc4a0723b4543a16197d393c7929a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:10:42.744554 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d380c39-074a-45db-8fb6-3e5efd5936eb service neutron] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:10:42.756645 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d380c39-074a-45db-8fb6-3e5efd5936eb service neutron] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:10:42.814778 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd11ef-36c8-4f36-8be9-89899f249151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:10:42.815641 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd11ef-36c8-4f36-8be9-89899f249151 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:10:42.815922 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd11ef-36c8-4f36-8be9-89899f249151 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:10:42.816199 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd11ef-36c8-4f36-8be9-89899f249151 admin admin] PATH_INFO: `/v3/projects/6c9c47f70b8d4da5827a8ef4349559ab` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:10:42.817494 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd11ef-36c8-4f36-8be9-89899f249151 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c9c47f70b8d4da5827a8ef4349559ab)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:10:42.819454 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd11ef-36c8-4f36-8be9-89899f249151 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:10:42.865850 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-e6cd11ef-36c8-4f36-8be9-89899f249151 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c9c47f70b8d4da5827a8ef4349559ab', 'request_id': 'req-e6cd11ef-36c8-4f36-8be9-89899f249151'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:10:42.874350 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-e6cd11ef-36c8-4f36-8be9-89899f249151 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c9c47f70b8d4da5827a8ef4349559ab', 'request_id': 'req-e6cd11ef-36c8-4f36-8be9-89899f249151'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:10:42.879597 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-e6cd11ef-36c8-4f36-8be9-89899f249151 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c9c47f70b8d4da5827a8ef4349559ab', 'request_id': 'req-e6cd11ef-36c8-4f36-8be9-89899f249151'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:10:42.890091 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-e6cd11ef-36c8-4f36-8be9-89899f249151 admin admin] The token cache is being invalidate because project 6c9c47f70b8d4da5827a8ef4349559ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:10:42.890372 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-e6cd11ef-36c8-4f36-8be9-89899f249151 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:10:42.890997 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-e6cd11ef-36c8-4f36-8be9-89899f249151 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:10:42.892579 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1353/2706] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:10:42 2021] DELETE /identity/v3/projects/6c9c47f70b8d4da5827a8ef4349559ab => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:10:42.898699 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74afed47-5521-4d42-a641-842f6bb3605a None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:10:42.898985 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74afed47-5521-4d42-a641-842f6bb3605a None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:10:42.899261 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74afed47-5521-4d42-a641-842f6bb3605a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:10:42.918322 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-74afed47-5521-4d42-a641-842f6bb3605a None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:10:42.919456 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-74afed47-5521-4d42-a641-842f6bb3605a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:10:42.981865 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1354/2707] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:10:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:10:42.990191 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc38e8e-696e-4d0c-9eb7-760d222f9f89 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:10:42.990481 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc38e8e-696e-4d0c-9eb7-760d222f9f89 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:10:42.990759 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc38e8e-696e-4d0c-9eb7-760d222f9f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:10:43.011577 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-ecc38e8e-696e-4d0c-9eb7-760d222f9f89 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:10:43.012822 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-ecc38e8e-696e-4d0c-9eb7-760d222f9f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:10:43.022537 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1354/2708] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:10:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:10:43.027614 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74afed47-5521-4d42-a641-842f6bb3605a None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:10:43.041422 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74afed47-5521-4d42-a641-842f6bb3605a None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:10:43.047694 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf8364-c5f2-41b6-afc6-8d483f818b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:10:43.048329 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf8364-c5f2-41b6-afc6-8d483f818b96 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:10:43.048649 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf8364-c5f2-41b6-afc6-8d483f818b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:10:43.048915 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf8364-c5f2-41b6-afc6-8d483f818b96 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:10:43.049648 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbf8364-c5f2-41b6-afc6-8d483f818b96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 05:10:43.049953 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbf8364-c5f2-41b6-afc6-8d483f818b96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:10:43.051582 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbf8364-c5f2-41b6-afc6-8d483f818b96 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:10:43.063640 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1355/2709] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 05:10:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 05:10:43.069674 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc38e8e-696e-4d0c-9eb7-760d222f9f89 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:10:43.079783 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc38e8e-696e-4d0c-9eb7-760d222f9f89 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:10:43.086573 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a7ff0-551c-4239-a6f6-e9e0bcd60cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:10:43.087237 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a7ff0-551c-4239-a6f6-e9e0bcd60cc1 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:10:43.087515 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a7ff0-551c-4239-a6f6-e9e0bcd60cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:10:43.087790 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a7ff0-551c-4239-a6f6-e9e0bcd60cc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:10:43.088508 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7a7ff0-551c-4239-a6f6-e9e0bcd60cc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:10:43.090510 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7a7ff0-551c-4239-a6f6-e9e0bcd60cc1 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:10:43.118299 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1355/2710] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:10:43 2021] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:10:43.122621 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf8364-c5f2-41b6-afc6-8d483f818b96 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:10:43.133465 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf8364-c5f2-41b6-afc6-8d483f818b96 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:10:43.194961 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a605b-b4f7-4a99-87f9-875c91c43cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:10:43.195670 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a605b-b4f7-4a99-87f9-875c91c43cec admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:10:43.195950 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a605b-b4f7-4a99-87f9-875c91c43cec admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:10:43.196225 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a605b-b4f7-4a99-87f9-875c91c43cec admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:10:43.196950 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a605b-b4f7-4a99-87f9-875c91c43cec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:10:43.198857 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a605b-b4f7-4a99-87f9-875c91c43cec admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:10:43.227030 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1356/2711] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:10:43 2021] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:10:43.231330 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a7ff0-551c-4239-a6f6-e9e0bcd60cc1 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:10:43.242378 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a7ff0-551c-4239-a6f6-e9e0bcd60cc1 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:10:43.248077 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccec182-d938-4600-a892-0da14db657a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:10:43.248769 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccec182-d938-4600-a892-0da14db657a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:10:43.249052 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccec182-d938-4600-a892-0da14db657a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:10:43.249322 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccec182-d938-4600-a892-0da14db657a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:10:43.250070 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccec182-d938-4600-a892-0da14db657a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:10:43.251697 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccec182-d938-4600-a892-0da14db657a8 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:10:43.262695 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1356/2712] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:10:43 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:10:43.266692 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a605b-b4f7-4a99-87f9-875c91c43cec admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:10:43.277364 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a605b-b4f7-4a99-87f9-875c91c43cec admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:10:43.283512 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771bb3db-f666-404c-879c-0f119e77bce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:10:43.284175 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771bb3db-f666-404c-879c-0f119e77bce6 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:10:43.284458 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771bb3db-f666-404c-879c-0f119e77bce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:10:43.284765 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771bb3db-f666-404c-879c-0f119e77bce6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:10:43.285508 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771bb3db-f666-404c-879c-0f119e77bce6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:10:43.287116 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771bb3db-f666-404c-879c-0f119e77bce6 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:10:43.297787 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1357/2713] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:10:43 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:10:43.302075 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccec182-d938-4600-a892-0da14db657a8 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:10:43.312458 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccec182-d938-4600-a892-0da14db657a8 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:10:43.317760 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3870f447-382f-462a-963a-cc526172c2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:10:43.318700 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870f447-382f-462a-963a-cc526172c2bb admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:10:43.318977 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870f447-382f-462a-963a-cc526172c2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:10:43.319244 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870f447-382f-462a-963a-cc526172c2bb admin admin] PATH_INFO: `/v3/projects/fc4cefad8fef403e90ad695e2098ee7b/users/bccbafbbab7e4c358b444e4efc684a01/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:10:43.334026 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3870f447-382f-462a-963a-cc526172c2bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc4cefad8fef403e90ad695e2098ee7b, user_id=bccbafbbab7e4c358b444e4efc684a01, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:10:43.337213 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3870f447-382f-462a-963a-cc526172c2bb admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:10:43.351121 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1357/2714] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:10:43 2021] PUT /identity/v3/projects/fc4cefad8fef403e90ad695e2098ee7b/users/bccbafbbab7e4c358b444e4efc684a01/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:10:43.356432 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e7846-5d02-4fbb-911e-b1b98427c3bd None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:10:43.356764 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e7846-5d02-4fbb-911e-b1b98427c3bd None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:10:43.357040 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e7846-5d02-4fbb-911e-b1b98427c3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:10:43.375846 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-1d4e7846-5d02-4fbb-911e-b1b98427c3bd None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:10:43.377105 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-1d4e7846-5d02-4fbb-911e-b1b98427c3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:10:43.436388 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1358/2715] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:10:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 05:10:43.447478 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3870f447-382f-462a-963a-cc526172c2bb admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:10:43.450625 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-3870f447-382f-462a-963a-cc526172c2bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:10:43.513441 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3870f447-382f-462a-963a-cc526172c2bb admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:10:43.517934 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d941e1c5-44e2-4558-9d3a-43b9dc7e1994 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:10:43.518581 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941e1c5-44e2-4558-9d3a-43b9dc7e1994 service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:10:43.518865 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941e1c5-44e2-4558-9d3a-43b9dc7e1994 service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:10:43.519161 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941e1c5-44e2-4558-9d3a-43b9dc7e1994 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:10:43.528585 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d941e1c5-44e2-4558-9d3a-43b9dc7e1994 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:10:43.530097 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d941e1c5-44e2-4558-9d3a-43b9dc7e1994 service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:10:43.539531 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1358/2716] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:10:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:10:47.549380 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2defa7fa-402d-42eb-96f6-68d8fd1336b0 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:10:47.549964 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2defa7fa-402d-42eb-96f6-68d8fd1336b0 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:10:47.549964 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2defa7fa-402d-42eb-96f6-68d8fd1336b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:10:47.577823 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-2defa7fa-402d-42eb-96f6-68d8fd1336b0 None None] MFA Rules not processed for user `bccbafbbab7e4c358b444e4efc684a01`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:10:47.579270 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-2defa7fa-402d-42eb-96f6-68d8fd1336b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:10:47.652710 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1359/2717] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:10:47 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:10:47.665070 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d941e1c5-44e2-4558-9d3a-43b9dc7e1994 service neutron] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:10:47.666496 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-d941e1c5-44e2-4558-9d3a-43b9dc7e1994 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:10:47.740696 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d941e1c5-44e2-4558-9d3a-43b9dc7e1994 service neutron] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:10:47.747111 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5539f4-3c9f-443a-9464-b893ce005287 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f9ad1e8f8f74edcb44aabe17eb59648', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:10:47.747769 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5539f4-3c9f-443a-9464-b893ce005287 service nova] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:10:47.748068 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5539f4-3c9f-443a-9464-b893ce005287 service nova] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:10:47.748344 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5539f4-3c9f-443a-9464-b893ce005287 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:10:47.758506 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5539f4-3c9f-443a-9464-b893ce005287 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:10:47.761003 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5539f4-3c9f-443a-9464-b893ce005287 service nova] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:10:47.775477 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1359/2718] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:10:47 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:10:49.424491 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc76d24-4c4b-48bb-a103-553766f64436 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:10:49.425202 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc76d24-4c4b-48bb-a103-553766f64436 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:10:49.425574 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc76d24-4c4b-48bb-a103-553766f64436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:10:49.444109 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-5fc76d24-4c4b-48bb-a103-553766f64436 None None] MFA Rules not processed for user `bccbafbbab7e4c358b444e4efc684a01`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:10:49.445380 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-5fc76d24-4c4b-48bb-a103-553766f64436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:10:49.454001 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1360/2719] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:10:49 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:10:59.356385 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5539f4-3c9f-443a-9464-b893ce005287 service nova] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:10:59.357936 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-fd5539f4-3c9f-443a-9464-b893ce005287 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:10:59.374548 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5539f4-3c9f-443a-9464-b893ce005287 service nova] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:10:59.380489 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a77e982-563d-4baa-abb9-acae0168a4fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f9ad1e8f8f74edcb44aabe17eb59648', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:10:59.381174 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77e982-563d-4baa-abb9-acae0168a4fe service nova] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:10:59.381454 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77e982-563d-4baa-abb9-acae0168a4fe service nova] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:10:59.381724 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77e982-563d-4baa-abb9-acae0168a4fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:10:59.383709 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-0a77e982-563d-4baa-abb9-acae0168a4fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:10:59.397461 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a77e982-563d-4baa-abb9-acae0168a4fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:10:59.399063 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a77e982-563d-4baa-abb9-acae0168a4fe service nova] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:10:59.411257 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1360/2720] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:10:59 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:11:49.957415 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc76d24-4c4b-48bb-a103-553766f64436 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:11:49.959119 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-5fc76d24-4c4b-48bb-a103-553766f64436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:11:50.026734 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc76d24-4c4b-48bb-a103-553766f64436 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:11:50.032137 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d12bf56-ee0b-421d-be67-9477e970c450 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:11:50.032861 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12bf56-ee0b-421d-be67-9477e970c450 service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:11:50.033144 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12bf56-ee0b-421d-be67-9477e970c450 service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:11:50.033409 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12bf56-ee0b-421d-be67-9477e970c450 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:11:50.035561 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-4d12bf56-ee0b-421d-be67-9477e970c450 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:11:50.098779 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d12bf56-ee0b-421d-be67-9477e970c450 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:11:50.100247 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d12bf56-ee0b-421d-be67-9477e970c450 service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:11:50.109935 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1361/2721] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:11:49 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:12:01.193403 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e491b0-079d-43e4-9e92-9562fbcd3f7c None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:12:01.193964 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e491b0-079d-43e4-9e92-9562fbcd3f7c None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:12:01.193964 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e491b0-079d-43e4-9e92-9562fbcd3f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:12:01.213365 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-43e491b0-079d-43e4-9e92-9562fbcd3f7c None None] MFA Rules not processed for user `4039d5c6890448ee99194d769c5c387b`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:12:01.214576 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-43e491b0-079d-43e4-9e92-9562fbcd3f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:12:01.241675 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1361/2722] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:12:01 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:12:01.585716 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d12bf56-ee0b-421d-be67-9477e970c450 service cinder] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:12:01.606087 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d12bf56-ee0b-421d-be67-9477e970c450 service cinder] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:12:01.610448 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5b0b4-0b7e-4ff2-9806-9889ad93ee47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:12:01.611091 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5b0b4-0b7e-4ff2-9806-9889ad93ee47 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:12:01.611365 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5b0b4-0b7e-4ff2-9806-9889ad93ee47 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:12:01.611629 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5b0b4-0b7e-4ff2-9806-9889ad93ee47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:12:01.613707 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-edc5b0b4-0b7e-4ff2-9806-9889ad93ee47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:12:01.624047 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc5b0b4-0b7e-4ff2-9806-9889ad93ee47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:12:01.625506 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc5b0b4-0b7e-4ff2-9806-9889ad93ee47 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:12:01.633828 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1362/2723] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:12:01 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:12:18.977110 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e491b0-079d-43e4-9e92-9562fbcd3f7c None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:12:19.006459 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e491b0-079d-43e4-9e92-9562fbcd3f7c None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:12:19.011045 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d2b8c-4d05-42e9-82c4-9c38d73b5d2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:12:19.011685 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d2b8c-4d05-42e9-82c4-9c38d73b5d2f service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:12:19.011981 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d2b8c-4d05-42e9-82c4-9c38d73b5d2f service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:12:19.012256 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d2b8c-4d05-42e9-82c4-9c38d73b5d2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:12:19.014497 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-db2d2b8c-4d05-42e9-82c4-9c38d73b5d2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:12:19.094262 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2d2b8c-4d05-42e9-82c4-9c38d73b5d2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:12:19.095720 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2d2b8c-4d05-42e9-82c4-9c38d73b5d2f service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:12:19.106730 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1362/2724] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:12:18 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:12:31.774737 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5b0b4-0b7e-4ff2-9806-9889ad93ee47 service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:12:31.776518 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-edc5b0b4-0b7e-4ff2-9806-9889ad93ee47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:12:31.888519 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5b0b4-0b7e-4ff2-9806-9889ad93ee47 service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:12:31.895147 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e5a2b-e179-45b8-a6f5-53fa20d0a7f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '430d6177e74c4dbda7fb83d04c75617e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:12:31.895805 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e5a2b-e179-45b8-a6f5-53fa20d0a7f4 service placement] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:12:31.896086 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e5a2b-e179-45b8-a6f5-53fa20d0a7f4 service placement] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:12:31.896357 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e5a2b-e179-45b8-a6f5-53fa20d0a7f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:12:31.898220 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-535e5a2b-e179-45b8-a6f5-53fa20d0a7f4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:12:31.909977 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535e5a2b-e179-45b8-a6f5-53fa20d0a7f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:12:31.911557 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535e5a2b-e179-45b8-a6f5-53fa20d0a7f4 service placement] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:12:31.921625 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1363/2725] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:12:31 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:14:09.452846 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d2b8c-4d05-42e9-82c4-9c38d73b5d2f service neutron] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:14:09.454938 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-db2d2b8c-4d05-42e9-82c4-9c38d73b5d2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:14:09.484838 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d2b8c-4d05-42e9-82c4-9c38d73b5d2f service neutron] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:14:09.489257 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d716a1-46e8-40d9-b497-af94a200d771 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:14:09.489939 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d716a1-46e8-40d9-b497-af94a200d771 service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:14:09.490221 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d716a1-46e8-40d9-b497-af94a200d771 service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:14:09.490495 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d716a1-46e8-40d9-b497-af94a200d771 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:14:09.492670 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-c3d716a1-46e8-40d9-b497-af94a200d771 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:14:09.527284 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d716a1-46e8-40d9-b497-af94a200d771 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:14:09.528829 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d716a1-46e8-40d9-b497-af94a200d771 service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:14:09.549970 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1363/2726] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:14:09 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:14:10.794839 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e5a2b-e179-45b8-a6f5-53fa20d0a7f4 service placement] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:14:10.807379 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e5a2b-e179-45b8-a6f5-53fa20d0a7f4 service placement] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:14:10.813258 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58115a96-48e2-4744-98c8-46330819bbba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f9ad1e8f8f74edcb44aabe17eb59648', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:14:10.814145 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58115a96-48e2-4744-98c8-46330819bbba service nova] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:14:10.814579 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58115a96-48e2-4744-98c8-46330819bbba service nova] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:14:10.815013 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58115a96-48e2-4744-98c8-46330819bbba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:14:10.817119 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-58115a96-48e2-4744-98c8-46330819bbba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:14:10.830500 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58115a96-48e2-4744-98c8-46330819bbba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:14:10.832343 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58115a96-48e2-4744-98c8-46330819bbba service nova] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:14:10.844693 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1364/2727] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:14:10 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:14:12.268079 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d716a1-46e8-40d9-b497-af94a200d771 service neutron] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:14:12.277106 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d716a1-46e8-40d9-b497-af94a200d771 service neutron] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:14:12.281564 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58912252-3352-49d7-9624-f38e45fbba4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:14:12.282187 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58912252-3352-49d7-9624-f38e45fbba4b service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:14:12.282514 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58912252-3352-49d7-9624-f38e45fbba4b service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:14:12.282832 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58912252-3352-49d7-9624-f38e45fbba4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:14:12.284905 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-58912252-3352-49d7-9624-f38e45fbba4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:14:12.299726 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58912252-3352-49d7-9624-f38e45fbba4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:14:12.301209 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58912252-3352-49d7-9624-f38e45fbba4b service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:14:12.312834 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1364/2728] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:14:12 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:14:23.431147 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58115a96-48e2-4744-98c8-46330819bbba service nova] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:14:23.443314 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58115a96-48e2-4744-98c8-46330819bbba service nova] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:14:23.447642 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99db655-327e-4090-891a-e06e7b4df839 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:14:23.448308 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99db655-327e-4090-891a-e06e7b4df839 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:14:23.448585 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99db655-327e-4090-891a-e06e7b4df839 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:14:23.448888 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99db655-327e-4090-891a-e06e7b4df839 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:14:23.450794 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-e99db655-327e-4090-891a-e06e7b4df839 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:14:23.488689 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99db655-327e-4090-891a-e06e7b4df839 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:14:23.490112 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99db655-327e-4090-891a-e06e7b4df839 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:14:23.509059 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1365/2729] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:14:23 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:14:30.136698 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58912252-3352-49d7-9624-f38e45fbba4b service neutron] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:14:30.138784 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-58912252-3352-49d7-9624-f38e45fbba4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:14:30.156288 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58912252-3352-49d7-9624-f38e45fbba4b service neutron] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:14:30.161089 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f310822a-ba9b-4a53-9759-cd6af4f0732b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:14:30.162099 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310822a-ba9b-4a53-9759-cd6af4f0732b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:14:30.162474 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310822a-ba9b-4a53-9759-cd6af4f0732b admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:14:30.162836 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310822a-ba9b-4a53-9759-cd6af4f0732b admin admin] PATH_INFO: `/v3/users/4039d5c6890448ee99194d769c5c387b` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:14:30.164166 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f310822a-ba9b-4a53-9759-cd6af4f0732b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4039d5c6890448ee99194d769c5c387b)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:14:30.166249 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f310822a-ba9b-4a53-9759-cd6af4f0732b admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:14:30.226971 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-f310822a-ba9b-4a53-9759-cd6af4f0732b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4039d5c6890448ee99194d769c5c387b'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:14:30.227677 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-f310822a-ba9b-4a53-9759-cd6af4f0732b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4039d5c6890448ee99194d769c5c387b'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:14:30.234538 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-f310822a-ba9b-4a53-9759-cd6af4f0732b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4039d5c6890448ee99194d769c5c387b'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:14:30.241859 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-f310822a-ba9b-4a53-9759-cd6af4f0732b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4039d5c6890448ee99194d769c5c387b'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:14:30.242498 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-f310822a-ba9b-4a53-9759-cd6af4f0732b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4039d5c6890448ee99194d769c5c387b'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:14:30.261353 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1365/2730] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:14:30 2021] DELETE /identity/v3/users/4039d5c6890448ee99194d769c5c387b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:14:30.433400 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99db655-327e-4090-891a-e06e7b4df839 service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:14:30.444981 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99db655-327e-4090-891a-e06e7b4df839 service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:14:30.516148 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10418a32-4517-478d-aa20-20dc2d1bab6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:14:30.516975 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10418a32-4517-478d-aa20-20dc2d1bab6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:14:30.517255 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10418a32-4517-478d-aa20-20dc2d1bab6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:14:30.517525 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10418a32-4517-478d-aa20-20dc2d1bab6b admin admin] PATH_INFO: `/v3/projects/8b1a80c6322a493ba10c69a77168b46f` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:14:30.518740 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10418a32-4517-478d-aa20-20dc2d1bab6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b1a80c6322a493ba10c69a77168b46f)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:14:30.520722 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10418a32-4517-478d-aa20-20dc2d1bab6b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:14:30.567553 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-10418a32-4517-478d-aa20-20dc2d1bab6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b1a80c6322a493ba10c69a77168b46f', 'request_id': 'req-10418a32-4517-478d-aa20-20dc2d1bab6b'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:14:30.575738 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-10418a32-4517-478d-aa20-20dc2d1bab6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b1a80c6322a493ba10c69a77168b46f', 'request_id': 'req-10418a32-4517-478d-aa20-20dc2d1bab6b'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:14:30.581159 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-10418a32-4517-478d-aa20-20dc2d1bab6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b1a80c6322a493ba10c69a77168b46f', 'request_id': 'req-10418a32-4517-478d-aa20-20dc2d1bab6b'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:14:30.592837 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-10418a32-4517-478d-aa20-20dc2d1bab6b admin admin] The token cache is being invalidate because project 8b1a80c6322a493ba10c69a77168b46f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:14:30.593126 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-10418a32-4517-478d-aa20-20dc2d1bab6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:14:30.593873 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-10418a32-4517-478d-aa20-20dc2d1bab6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:14:30.595564 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1366/2731] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:14:30 2021] DELETE /identity/v3/projects/8b1a80c6322a493ba10c69a77168b46f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:14:30.599616 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f310822a-ba9b-4a53-9759-cd6af4f0732b admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:14:30.601229 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-f310822a-ba9b-4a53-9759-cd6af4f0732b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:14:30.615665 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f310822a-ba9b-4a53-9759-cd6af4f0732b admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:14:30.676627 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee06af45-0f65-4ab0-a61d-279b1af61c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:14:30.677430 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06af45-0f65-4ab0-a61d-279b1af61c7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:14:30.677710 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06af45-0f65-4ab0-a61d-279b1af61c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:14:30.677990 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06af45-0f65-4ab0-a61d-279b1af61c7a admin admin] PATH_INFO: `/v3/users/d60d649823d04e47a791100bdb3362e4` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:14:30.679358 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee06af45-0f65-4ab0-a61d-279b1af61c7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d60d649823d04e47a791100bdb3362e4)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:14:30.681389 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee06af45-0f65-4ab0-a61d-279b1af61c7a admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:14:30.731529 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-ee06af45-0f65-4ab0-a61d-279b1af61c7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd60d649823d04e47a791100bdb3362e4'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:14:30.732184 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-ee06af45-0f65-4ab0-a61d-279b1af61c7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd60d649823d04e47a791100bdb3362e4'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:14:30.738943 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-ee06af45-0f65-4ab0-a61d-279b1af61c7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd60d649823d04e47a791100bdb3362e4'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:14:30.747401 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-ee06af45-0f65-4ab0-a61d-279b1af61c7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd60d649823d04e47a791100bdb3362e4'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:14:30.748024 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-ee06af45-0f65-4ab0-a61d-279b1af61c7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd60d649823d04e47a791100bdb3362e4'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:14:30.765532 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1366/2732] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:14:30 2021] DELETE /identity/v3/users/d60d649823d04e47a791100bdb3362e4 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:14:30.957457 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10418a32-4517-478d-aa20-20dc2d1bab6b admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:14:30.959301 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-10418a32-4517-478d-aa20-20dc2d1bab6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:14:30.972693 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10418a32-4517-478d-aa20-20dc2d1bab6b admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:14:31.031107 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b664f-628a-4b95-9e64-9890652ace93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:14:31.032180 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b664f-628a-4b95-9e64-9890652ace93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:14:31.032457 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b664f-628a-4b95-9e64-9890652ace93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:14:31.032874 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b664f-628a-4b95-9e64-9890652ace93 admin admin] PATH_INFO: `/v3/projects/bf7b649b22d644f4971ea81dfca887e0` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:14:31.034142 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b664f-628a-4b95-9e64-9890652ace93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf7b649b22d644f4971ea81dfca887e0)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:14:31.036034 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b664f-628a-4b95-9e64-9890652ace93 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:14:31.089052 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-916b664f-628a-4b95-9e64-9890652ace93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf7b649b22d644f4971ea81dfca887e0', 'request_id': 'req-916b664f-628a-4b95-9e64-9890652ace93'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:14:31.097504 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-916b664f-628a-4b95-9e64-9890652ace93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf7b649b22d644f4971ea81dfca887e0', 'request_id': 'req-916b664f-628a-4b95-9e64-9890652ace93'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:14:31.103814 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-916b664f-628a-4b95-9e64-9890652ace93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf7b649b22d644f4971ea81dfca887e0', 'request_id': 'req-916b664f-628a-4b95-9e64-9890652ace93'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:14:31.116651 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-916b664f-628a-4b95-9e64-9890652ace93 admin admin] The token cache is being invalidate because project bf7b649b22d644f4971ea81dfca887e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:14:31.116933 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-916b664f-628a-4b95-9e64-9890652ace93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:14:31.117635 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-916b664f-628a-4b95-9e64-9890652ace93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:14:31.119254 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1367/2733] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:14:30 2021] DELETE /identity/v3/projects/bf7b649b22d644f4971ea81dfca887e0 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:15:23.116706 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ca90d-e77a-48ab-967f-e01bf26af990 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:15:23.117302 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ca90d-e77a-48ab-967f-e01bf26af990 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:15:23.117302 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ca90d-e77a-48ab-967f-e01bf26af990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:15:23.134380 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-454ca90d-e77a-48ab-967f-e01bf26af990 None None] MFA Rules not processed for user `bccbafbbab7e4c358b444e4efc684a01`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:15:23.135591 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-454ca90d-e77a-48ab-967f-e01bf26af990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:15:23.195759 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1367/2734] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:15:23 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 05:15:23.525380 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b664f-628a-4b95-9e64-9890652ace93 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:15:23.527040 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-916b664f-628a-4b95-9e64-9890652ace93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:15:23.593352 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b664f-628a-4b95-9e64-9890652ace93 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:15:23.598345 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cecf32-e187-4fd6-adbd-951eb22bf8d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:15:23.598992 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cecf32-e187-4fd6-adbd-951eb22bf8d2 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:15:23.599243 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cecf32-e187-4fd6-adbd-951eb22bf8d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:15:23.599799 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cecf32-e187-4fd6-adbd-951eb22bf8d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:15:23.601961 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-20cecf32-e187-4fd6-adbd-951eb22bf8d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:15:23.612205 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cecf32-e187-4fd6-adbd-951eb22bf8d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:15:23.613705 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cecf32-e187-4fd6-adbd-951eb22bf8d2 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:15:23.621978 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1368/2735] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:15:23 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:15:25.979383 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454ca90d-e77a-48ab-967f-e01bf26af990 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:15:25.982289 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-454ca90d-e77a-48ab-967f-e01bf26af990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:15:26.053290 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454ca90d-e77a-48ab-967f-e01bf26af990 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:15:26.058642 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54801247-904f-454b-9f75-c404c6a97ba6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '430d6177e74c4dbda7fb83d04c75617e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:15:26.059307 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54801247-904f-454b-9f75-c404c6a97ba6 service placement] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:15:26.059586 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54801247-904f-454b-9f75-c404c6a97ba6 service placement] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:15:26.059867 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54801247-904f-454b-9f75-c404c6a97ba6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:15:26.062003 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-54801247-904f-454b-9f75-c404c6a97ba6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:15:26.074236 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54801247-904f-454b-9f75-c404c6a97ba6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:15:26.075836 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54801247-904f-454b-9f75-c404c6a97ba6 service placement] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:15:26.086447 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1368/2736] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:15:25 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:15:30.950383 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cecf32-e187-4fd6-adbd-951eb22bf8d2 service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:15:30.951900 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-20cecf32-e187-4fd6-adbd-951eb22bf8d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:15:30.963167 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cecf32-e187-4fd6-adbd-951eb22bf8d2 service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:15:30.967365 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6306e42-4e40-437b-91d7-1dbf310932e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:15:30.967925 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6306e42-4e40-437b-91d7-1dbf310932e3 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:15:30.968210 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6306e42-4e40-437b-91d7-1dbf310932e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:15:30.968486 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6306e42-4e40-437b-91d7-1dbf310932e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:15:30.970677 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-c6306e42-4e40-437b-91d7-1dbf310932e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:15:30.981462 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6306e42-4e40-437b-91d7-1dbf310932e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:15:30.982929 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6306e42-4e40-437b-91d7-1dbf310932e3 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:15:30.990935 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1369/2737] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:15:30 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:15:46.827789 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54801247-904f-454b-9f75-c404c6a97ba6 service placement] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:15:46.830605 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-54801247-904f-454b-9f75-c404c6a97ba6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:15:46.913657 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54801247-904f-454b-9f75-c404c6a97ba6 service placement] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:15:46.920980 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20575c16-f37a-44c6-af07-c6458c89a39e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f9ad1e8f8f74edcb44aabe17eb59648', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:15:46.921628 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20575c16-f37a-44c6-af07-c6458c89a39e service nova] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:15:46.921911 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20575c16-f37a-44c6-af07-c6458c89a39e service nova] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:15:46.922191 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20575c16-f37a-44c6-af07-c6458c89a39e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:15:46.925063 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-20575c16-f37a-44c6-af07-c6458c89a39e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:15:46.939392 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20575c16-f37a-44c6-af07-c6458c89a39e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:15:46.941020 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20575c16-f37a-44c6-af07-c6458c89a39e service nova] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:15:46.950502 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1369/2738] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:15:46 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:17:21.694072 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6306e42-4e40-437b-91d7-1dbf310932e3 service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:21.709543 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6306e42-4e40-437b-91d7-1dbf310932e3 service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:21.716563 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7761f84-21cd-45b7-94ab-1eedbf01d26b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f9ad1e8f8f74edcb44aabe17eb59648', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:21.717525 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7761f84-21cd-45b7-94ab-1eedbf01d26b service nova] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:21.717975 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7761f84-21cd-45b7-94ab-1eedbf01d26b service nova] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:21.718411 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7761f84-21cd-45b7-94ab-1eedbf01d26b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:21.720591 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-e7761f84-21cd-45b7-94ab-1eedbf01d26b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:17:21.734580 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7761f84-21cd-45b7-94ab-1eedbf01d26b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:21.736164 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7761f84-21cd-45b7-94ab-1eedbf01d26b service nova] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:21.747484 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1370/2739] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:17:21 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:17:27.341260 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20575c16-f37a-44c6-af07-c6458c89a39e service nova] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:27.351432 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20575c16-f37a-44c6-af07-c6458c89a39e service nova] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:27.356050 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5530e-d4cc-4540-8094-ca636fac7373 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:27.356737 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5530e-d4cc-4540-8094-ca636fac7373 service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:27.357005 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5530e-d4cc-4540-8094-ca636fac7373 service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:27.357280 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5530e-d4cc-4540-8094-ca636fac7373 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:27.359421 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-a7e5530e-d4cc-4540-8094-ca636fac7373 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:17:27.426008 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e5530e-d4cc-4540-8094-ca636fac7373 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:27.427456 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e5530e-d4cc-4540-8094-ca636fac7373 service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:27.437465 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1370/2740] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:17:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:17:30.697125 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7761f84-21cd-45b7-94ab-1eedbf01d26b service nova] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:30.698764 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-e7761f84-21cd-45b7-94ab-1eedbf01d26b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:17:30.712281 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7761f84-21cd-45b7-94ab-1eedbf01d26b service nova] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:30.718356 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d0306-fe30-4b09-8b53-152a033e9c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:30.719239 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d0306-fe30-4b09-8b53-152a033e9c28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:30.719540 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d0306-fe30-4b09-8b53-152a033e9c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:30.720495 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d0306-fe30-4b09-8b53-152a033e9c28 admin admin] PATH_INFO: `/v3/users/bccbafbbab7e4c358b444e4efc684a01` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:30.722166 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1d0306-fe30-4b09-8b53-152a033e9c28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bccbafbbab7e4c358b444e4efc684a01)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:30.724820 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1d0306-fe30-4b09-8b53-152a033e9c28 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:30.772417 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-3c1d0306-fe30-4b09-8b53-152a033e9c28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bccbafbbab7e4c358b444e4efc684a01'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:30.773093 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-3c1d0306-fe30-4b09-8b53-152a033e9c28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bccbafbbab7e4c358b444e4efc684a01'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:30.781741 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-3c1d0306-fe30-4b09-8b53-152a033e9c28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bccbafbbab7e4c358b444e4efc684a01'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:30.788357 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-3c1d0306-fe30-4b09-8b53-152a033e9c28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bccbafbbab7e4c358b444e4efc684a01'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:30.799670 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-3c1d0306-fe30-4b09-8b53-152a033e9c28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bccbafbbab7e4c358b444e4efc684a01'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:30.805458 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1371/2741] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:17:30 2021] DELETE /identity/v3/users/bccbafbbab7e4c358b444e4efc684a01 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:17:31.002225 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5530e-d4cc-4540-8094-ca636fac7373 service neutron] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:31.012009 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5530e-d4cc-4540-8094-ca636fac7373 service neutron] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:31.069761 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc3fda-86bd-4400-8d92-b5c0943b40b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:31.070633 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc3fda-86bd-4400-8d92-b5c0943b40b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:31.070918 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc3fda-86bd-4400-8d92-b5c0943b40b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:31.071196 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc3fda-86bd-4400-8d92-b5c0943b40b8 admin admin] PATH_INFO: `/v3/projects/fc4cefad8fef403e90ad695e2098ee7b` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:31.072492 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fc3fda-86bd-4400-8d92-b5c0943b40b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc4cefad8fef403e90ad695e2098ee7b)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:31.074655 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fc3fda-86bd-4400-8d92-b5c0943b40b8 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:31.123447 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-50fc3fda-86bd-4400-8d92-b5c0943b40b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc4cefad8fef403e90ad695e2098ee7b', 'request_id': 'req-50fc3fda-86bd-4400-8d92-b5c0943b40b8'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:31.131326 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-50fc3fda-86bd-4400-8d92-b5c0943b40b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc4cefad8fef403e90ad695e2098ee7b', 'request_id': 'req-50fc3fda-86bd-4400-8d92-b5c0943b40b8'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:31.136776 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-50fc3fda-86bd-4400-8d92-b5c0943b40b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc4cefad8fef403e90ad695e2098ee7b', 'request_id': 'req-50fc3fda-86bd-4400-8d92-b5c0943b40b8'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:31.147361 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-50fc3fda-86bd-4400-8d92-b5c0943b40b8 admin admin] The token cache is being invalidate because project fc4cefad8fef403e90ad695e2098ee7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:17:31.147646 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-50fc3fda-86bd-4400-8d92-b5c0943b40b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:31.148271 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-50fc3fda-86bd-4400-8d92-b5c0943b40b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:31.149835 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1371/2742] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:17:31 2021] DELETE /identity/v3/projects/fc4cefad8fef403e90ad695e2098ee7b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:17:31.155902 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361d5d2-b723-4db2-9171-fd543c963e06 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:31.156190 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361d5d2-b723-4db2-9171-fd543c963e06 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:31.156467 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361d5d2-b723-4db2-9171-fd543c963e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:31.220615 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-f361d5d2-b723-4db2-9171-fd543c963e06 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:17:31.221863 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-f361d5d2-b723-4db2-9171-fd543c963e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:17:31.294723 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1372/2743] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:17:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:17:31.307032 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee4435-23a2-4b0a-b4e0-b87e1fe133f4 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:31.307319 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee4435-23a2-4b0a-b4e0-b87e1fe133f4 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:31.307594 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee4435-23a2-4b0a-b4e0-b87e1fe133f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:31.329734 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-57ee4435-23a2-4b0a-b4e0-b87e1fe133f4 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:17:31.330967 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-57ee4435-23a2-4b0a-b4e0-b87e1fe133f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:17:31.340903 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1372/2744] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:17:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:17:31.345391 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361d5d2-b723-4db2-9171-fd543c963e06 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:31.355692 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361d5d2-b723-4db2-9171-fd543c963e06 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:31.361640 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a8df87-eb7f-4ce6-a5e1-96e19624dcde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:31.362300 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8df87-eb7f-4ce6-a5e1-96e19624dcde admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:31.362581 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8df87-eb7f-4ce6-a5e1-96e19624dcde admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:31.362863 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8df87-eb7f-4ce6-a5e1-96e19624dcde admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:31.363599 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a8df87-eb7f-4ce6-a5e1-96e19624dcde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 05:17:31.363908 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a8df87-eb7f-4ce6-a5e1-96e19624dcde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:31.365567 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a8df87-eb7f-4ce6-a5e1-96e19624dcde admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:31.377514 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1373/2745] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 05:17:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 05:17:31.381921 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee4435-23a2-4b0a-b4e0-b87e1fe133f4 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:31.392854 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee4435-23a2-4b0a-b4e0-b87e1fe133f4 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:31.401352 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ed3c5-35ae-46fa-b929-25277bbe5f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:31.402292 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ed3c5-35ae-46fa-b929-25277bbe5f1f admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:31.402774 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ed3c5-35ae-46fa-b929-25277bbe5f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:31.403335 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ed3c5-35ae-46fa-b929-25277bbe5f1f admin admin] PATH_INFO: `/v3/projects` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:31.404495 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4ed3c5-35ae-46fa-b929-25277bbe5f1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:31.407551 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4ed3c5-35ae-46fa-b929-25277bbe5f1f admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:31.449993 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1373/2746] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:17:31 2021] POST /identity/v3/projects => generated 367 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 05:17:31.455835 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a8df87-eb7f-4ce6-a5e1-96e19624dcde admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:31.468380 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a8df87-eb7f-4ce6-a5e1-96e19624dcde admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:31.526465 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71622c-06cf-4a69-9277-8c339edf5b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:31.527132 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71622c-06cf-4a69-9277-8c339edf5b2f admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:31.527408 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71622c-06cf-4a69-9277-8c339edf5b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:31.527710 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71622c-06cf-4a69-9277-8c339edf5b2f admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:31.528917 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71622c-06cf-4a69-9277-8c339edf5b2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:31.530869 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71622c-06cf-4a69-9277-8c339edf5b2f admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:31.554539 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1374/2747] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:17:31 2021] POST /identity/v3/users => generated 284 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 05:17:31.558483 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ed3c5-35ae-46fa-b929-25277bbe5f1f admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:31.569199 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ed3c5-35ae-46fa-b929-25277bbe5f1f admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:31.574086 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820bbb2f-54d6-477b-887b-9740e878bdc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:31.574741 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820bbb2f-54d6-477b-887b-9740e878bdc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:31.575139 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820bbb2f-54d6-477b-887b-9740e878bdc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:31.575627 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820bbb2f-54d6-477b-887b-9740e878bdc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:31.576138 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820bbb2f-54d6-477b-887b-9740e878bdc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:31.577811 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820bbb2f-54d6-477b-887b-9740e878bdc1 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:31.588063 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1374/2748] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:17:31 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:17:31.592185 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71622c-06cf-4a69-9277-8c339edf5b2f admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:31.602400 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71622c-06cf-4a69-9277-8c339edf5b2f admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:31.607786 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da3620-75a6-4098-a0d0-1890eacf6b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:31.608435 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da3620-75a6-4098-a0d0-1890eacf6b84 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:31.608746 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da3620-75a6-4098-a0d0-1890eacf6b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:31.609023 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da3620-75a6-4098-a0d0-1890eacf6b84 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:31.609765 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da3620-75a6-4098-a0d0-1890eacf6b84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:31.611384 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da3620-75a6-4098-a0d0-1890eacf6b84 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:31.622112 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1375/2749] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:17:31 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:17:31.627195 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820bbb2f-54d6-477b-887b-9740e878bdc1 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:31.643349 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820bbb2f-54d6-477b-887b-9740e878bdc1 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:31.653191 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99d91e-78d3-4e4d-9445-123b00ac960e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:31.654424 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99d91e-78d3-4e4d-9445-123b00ac960e admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:31.654713 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99d91e-78d3-4e4d-9445-123b00ac960e admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:31.654991 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99d91e-78d3-4e4d-9445-123b00ac960e admin admin] PATH_INFO: `/v3/projects/1f098ab1221e4a3cb8cf5c28d901b7a2/users/19f7fdc0850645b8bbaa66d9d71c023c/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:31.670932 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c99d91e-78d3-4e4d-9445-123b00ac960e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f098ab1221e4a3cb8cf5c28d901b7a2, user_id=19f7fdc0850645b8bbaa66d9d71c023c, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:31.673667 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c99d91e-78d3-4e4d-9445-123b00ac960e admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:31.689158 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1375/2750] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:17:31 2021] PUT /identity/v3/projects/1f098ab1221e4a3cb8cf5c28d901b7a2/users/19f7fdc0850645b8bbaa66d9d71c023c/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:17:31.699342 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fbac0-4f87-410a-a3d0-0d154895f770 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:31.699887 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fbac0-4f87-410a-a3d0-0d154895f770 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:31.699994 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fbac0-4f87-410a-a3d0-0d154895f770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:31.730099 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-503fbac0-4f87-410a-a3d0-0d154895f770 None None] MFA Rules not processed for user `19f7fdc0850645b8bbaa66d9d71c023c`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:17:31.731587 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-503fbac0-4f87-410a-a3d0-0d154895f770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:17:31.801359 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1376/2751] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:17:31 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:17:31.806051 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99d91e-78d3-4e4d-9445-123b00ac960e admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:31.871912 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99d91e-78d3-4e4d-9445-123b00ac960e admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:31.877065 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b36b86-4fc6-4a19-8b49-41f252945b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:31.877719 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b36b86-4fc6-4a19-8b49-41f252945b07 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:31.877997 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b36b86-4fc6-4a19-8b49-41f252945b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:31.878267 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b36b86-4fc6-4a19-8b49-41f252945b07 admin admin] PATH_INFO: `/v3/projects` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:31.878948 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b36b86-4fc6-4a19-8b49-41f252945b07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:31.880900 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b36b86-4fc6-4a19-8b49-41f252945b07 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:31.907543 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1376/2752] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:17:31 2021] POST /identity/v3/projects => generated 369 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:17:31.911715 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503fbac0-4f87-410a-a3d0-0d154895f770 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:31.923376 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503fbac0-4f87-410a-a3d0-0d154895f770 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:31.983890 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c5c9f-808b-4484-9980-d78c8b8b4850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:31.984581 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c5c9f-808b-4484-9980-d78c8b8b4850 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:31.984865 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c5c9f-808b-4484-9980-d78c8b8b4850 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:31.985137 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c5c9f-808b-4484-9980-d78c8b8b4850 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:31.985878 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5c5c9f-808b-4484-9980-d78c8b8b4850 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:31.987837 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5c5c9f-808b-4484-9980-d78c8b8b4850 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:32.012314 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1377/2753] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:17:31 2021] POST /identity/v3/users => generated 291 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:17:32.016511 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b36b86-4fc6-4a19-8b49-41f252945b07 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:32.027105 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b36b86-4fc6-4a19-8b49-41f252945b07 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:32.033107 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d735516b-5bc9-46a9-8109-894279c4b58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:32.033764 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735516b-5bc9-46a9-8109-894279c4b58d admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:32.034040 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735516b-5bc9-46a9-8109-894279c4b58d admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:32.034309 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735516b-5bc9-46a9-8109-894279c4b58d admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:32.035054 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d735516b-5bc9-46a9-8109-894279c4b58d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:32.036706 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d735516b-5bc9-46a9-8109-894279c4b58d admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:32.047959 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1377/2754] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:17:32 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 24 05:17:32.051850 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c5c9f-808b-4484-9980-d78c8b8b4850 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:32.063282 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c5c9f-808b-4484-9980-d78c8b8b4850 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:32.068402 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35947ef1-cafd-40b3-856c-c92b3b1cbea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:32.069355 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35947ef1-cafd-40b3-856c-c92b3b1cbea6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:32.069640 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35947ef1-cafd-40b3-856c-c92b3b1cbea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:32.069914 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35947ef1-cafd-40b3-856c-c92b3b1cbea6 admin admin] PATH_INFO: `/v3/projects/9a48d0c1b04e4b89bef3a50b3fab90a1/users/feb67d1457894edb9b970d7d6273367a/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:32.085861 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35947ef1-cafd-40b3-856c-c92b3b1cbea6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a48d0c1b04e4b89bef3a50b3fab90a1, user_id=feb67d1457894edb9b970d7d6273367a, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:32.088549 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35947ef1-cafd-40b3-856c-c92b3b1cbea6 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:32.106724 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1378/2755] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:17:32 2021] PUT /identity/v3/projects/9a48d0c1b04e4b89bef3a50b3fab90a1/users/feb67d1457894edb9b970d7d6273367a/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:17:32.112479 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d735516b-5bc9-46a9-8109-894279c4b58d admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:32.123066 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d735516b-5bc9-46a9-8109-894279c4b58d admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:32.183357 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be3692-2c21-49b7-9096-172bd54d44d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:32.184032 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be3692-2c21-49b7-9096-172bd54d44d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:32.184345 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be3692-2c21-49b7-9096-172bd54d44d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:32.184654 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be3692-2c21-49b7-9096-172bd54d44d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:32.185504 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89be3692-2c21-49b7-9096-172bd54d44d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:32.187127 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89be3692-2c21-49b7-9096-172bd54d44d6 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:32.200982 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1378/2756] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:17:32 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:17:32.206912 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35947ef1-cafd-40b3-856c-c92b3b1cbea6 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:32.218749 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35947ef1-cafd-40b3-856c-c92b3b1cbea6 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:32.225026 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a4baf-a76a-4ea2-8d85-671a7974ec08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:32.225907 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a4baf-a76a-4ea2-8d85-671a7974ec08 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:32.226208 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a4baf-a76a-4ea2-8d85-671a7974ec08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:32.226453 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a4baf-a76a-4ea2-8d85-671a7974ec08 admin admin] PATH_INFO: `/v3/projects/9a48d0c1b04e4b89bef3a50b3fab90a1/users/feb67d1457894edb9b970d7d6273367a/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:32.228721 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1a4baf-a76a-4ea2-8d85-671a7974ec08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a48d0c1b04e4b89bef3a50b3fab90a1, user_id=feb67d1457894edb9b970d7d6273367a, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:32.231619 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1a4baf-a76a-4ea2-8d85-671a7974ec08 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:32.244072 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1379/2757] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:17:32 2021] PUT /identity/v3/projects/9a48d0c1b04e4b89bef3a50b3fab90a1/users/feb67d1457894edb9b970d7d6273367a/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:17:32.257940 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785dc95-e596-4054-ba32-70e8097c241a None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:32.258373 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785dc95-e596-4054-ba32-70e8097c241a None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:32.258821 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785dc95-e596-4054-ba32-70e8097c241a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:32.292664 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-8785dc95-e596-4054-ba32-70e8097c241a None None] MFA Rules not processed for user `feb67d1457894edb9b970d7d6273367a`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:17:32.294517 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-8785dc95-e596-4054-ba32-70e8097c241a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:17:32.365673 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1379/2758] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:17:32 2021] POST /identity/v3/auth/tokens => generated 3303 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:17:32.376728 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a4baf-a76a-4ea2-8d85-671a7974ec08 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:32.379798 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-5f1a4baf-a76a-4ea2-8d85-671a7974ec08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:17:32.468959 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a4baf-a76a-4ea2-8d85-671a7974ec08 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:32.473455 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b0b051-0fff-44df-a277-fa1f9bce37da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:32.474111 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b0b051-0fff-44df-a277-fa1f9bce37da service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:32.474391 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b0b051-0fff-44df-a277-fa1f9bce37da service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:32.474663 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b0b051-0fff-44df-a277-fa1f9bce37da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:32.485730 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b0b051-0fff-44df-a277-fa1f9bce37da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:32.487952 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b0b051-0fff-44df-a277-fa1f9bce37da service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:32.501033 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1380/2759] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:17:32 2021] GET /identity/v3/auth/tokens => generated 3303 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:17:33.871557 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8785dc95-e596-4054-ba32-70e8097c241a None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:33.940226 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8785dc95-e596-4054-ba32-70e8097c241a None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:33.945045 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23dcc87-4aa0-4744-be25-e016bea041d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:33.945910 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23dcc87-4aa0-4744-be25-e016bea041d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:33.946185 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23dcc87-4aa0-4744-be25-e016bea041d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:33.946449 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23dcc87-4aa0-4744-be25-e016bea041d1 admin admin] PATH_INFO: `/v3/users/19f7fdc0850645b8bbaa66d9d71c023c` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:33.947700 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23dcc87-4aa0-4744-be25-e016bea041d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19f7fdc0850645b8bbaa66d9d71c023c)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:33.949677 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23dcc87-4aa0-4744-be25-e016bea041d1 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:34.001328 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-d23dcc87-4aa0-4744-be25-e016bea041d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19f7fdc0850645b8bbaa66d9d71c023c'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:34.001988 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-d23dcc87-4aa0-4744-be25-e016bea041d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19f7fdc0850645b8bbaa66d9d71c023c'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:34.010065 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-d23dcc87-4aa0-4744-be25-e016bea041d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19f7fdc0850645b8bbaa66d9d71c023c'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:34.020984 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-d23dcc87-4aa0-4744-be25-e016bea041d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19f7fdc0850645b8bbaa66d9d71c023c'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:34.021698 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-d23dcc87-4aa0-4744-be25-e016bea041d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19f7fdc0850645b8bbaa66d9d71c023c'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:34.040001 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1380/2760] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:17:33 2021] DELETE /identity/v3/users/19f7fdc0850645b8bbaa66d9d71c023c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:17:34.044957 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5093b5c-2209-4a02-ae7b-2485d2b14b16 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:34.045449 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5093b5c-2209-4a02-ae7b-2485d2b14b16 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:34.045579 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5093b5c-2209-4a02-ae7b-2485d2b14b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:34.062863 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-f5093b5c-2209-4a02-ae7b-2485d2b14b16 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:17:34.064064 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-f5093b5c-2209-4a02-ae7b-2485d2b14b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:17:34.122799 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1381/2761] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:17:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:17:34.133852 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23dcc87-4aa0-4744-be25-e016bea041d1 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:34.136020 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-d23dcc87-4aa0-4744-be25-e016bea041d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:17:34.201892 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23dcc87-4aa0-4744-be25-e016bea041d1 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:34.206221 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbad1a3-ad47-41c3-8455-aafa790522be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:34.206863 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbad1a3-ad47-41c3-8455-aafa790522be service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:34.207142 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbad1a3-ad47-41c3-8455-aafa790522be service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:34.207414 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbad1a3-ad47-41c3-8455-aafa790522be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:34.217908 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbad1a3-ad47-41c3-8455-aafa790522be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:34.219365 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbad1a3-ad47-41c3-8455-aafa790522be service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:34.228966 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1381/2762] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:17:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:17:34.516047 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5093b5c-2209-4a02-ae7b-2485d2b14b16 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:34.517684 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-f5093b5c-2209-4a02-ae7b-2485d2b14b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:17:34.532144 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5093b5c-2209-4a02-ae7b-2485d2b14b16 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:34.537696 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293864f6-8f0c-441d-8f3f-07f69a7bc1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:34.539011 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293864f6-8f0c-441d-8f3f-07f69a7bc1dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:34.539463 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293864f6-8f0c-441d-8f3f-07f69a7bc1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:34.539795 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293864f6-8f0c-441d-8f3f-07f69a7bc1dd admin admin] PATH_INFO: `/v3/projects/1f098ab1221e4a3cb8cf5c28d901b7a2` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:34.541360 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293864f6-8f0c-441d-8f3f-07f69a7bc1dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f098ab1221e4a3cb8cf5c28d901b7a2)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:34.543287 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293864f6-8f0c-441d-8f3f-07f69a7bc1dd admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:34.603541 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-293864f6-8f0c-441d-8f3f-07f69a7bc1dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f098ab1221e4a3cb8cf5c28d901b7a2', 'request_id': 'req-293864f6-8f0c-441d-8f3f-07f69a7bc1dd'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:34.612752 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-293864f6-8f0c-441d-8f3f-07f69a7bc1dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f098ab1221e4a3cb8cf5c28d901b7a2', 'request_id': 'req-293864f6-8f0c-441d-8f3f-07f69a7bc1dd'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:34.618459 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-293864f6-8f0c-441d-8f3f-07f69a7bc1dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f098ab1221e4a3cb8cf5c28d901b7a2', 'request_id': 'req-293864f6-8f0c-441d-8f3f-07f69a7bc1dd'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:34.636234 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-293864f6-8f0c-441d-8f3f-07f69a7bc1dd admin admin] The token cache is being invalidate because project 1f098ab1221e4a3cb8cf5c28d901b7a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:17:34.636500 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-293864f6-8f0c-441d-8f3f-07f69a7bc1dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:34.637859 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-293864f6-8f0c-441d-8f3f-07f69a7bc1dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:34.639993 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1382/2763] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:17:34 2021] DELETE /identity/v3/projects/1f098ab1221e4a3cb8cf5c28d901b7a2 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:17:34.644886 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbad1a3-ad47-41c3-8455-aafa790522be service neutron] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:34.654765 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbad1a3-ad47-41c3-8455-aafa790522be service neutron] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:34.719633 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9cba1e-e8d3-47f6-9fd3-f2dc400e1f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:34.720557 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9cba1e-e8d3-47f6-9fd3-f2dc400e1f28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:34.720860 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9cba1e-e8d3-47f6-9fd3-f2dc400e1f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:34.721133 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9cba1e-e8d3-47f6-9fd3-f2dc400e1f28 admin admin] PATH_INFO: `/v3/users/feb67d1457894edb9b970d7d6273367a` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:34.722497 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9cba1e-e8d3-47f6-9fd3-f2dc400e1f28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=feb67d1457894edb9b970d7d6273367a)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:34.724450 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9cba1e-e8d3-47f6-9fd3-f2dc400e1f28 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:34.778369 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-fb9cba1e-e8d3-47f6-9fd3-f2dc400e1f28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'feb67d1457894edb9b970d7d6273367a'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:34.779249 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-fb9cba1e-e8d3-47f6-9fd3-f2dc400e1f28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'feb67d1457894edb9b970d7d6273367a'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:34.786408 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-fb9cba1e-e8d3-47f6-9fd3-f2dc400e1f28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'feb67d1457894edb9b970d7d6273367a'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:34.795436 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-fb9cba1e-e8d3-47f6-9fd3-f2dc400e1f28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'feb67d1457894edb9b970d7d6273367a'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:34.796128 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-fb9cba1e-e8d3-47f6-9fd3-f2dc400e1f28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'feb67d1457894edb9b970d7d6273367a'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:34.812704 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1382/2764] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:17:34 2021] DELETE /identity/v3/users/feb67d1457894edb9b970d7d6273367a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:17:35.096254 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293864f6-8f0c-441d-8f3f-07f69a7bc1dd admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:35.097936 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-293864f6-8f0c-441d-8f3f-07f69a7bc1dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:17:35.112548 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293864f6-8f0c-441d-8f3f-07f69a7bc1dd admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:35.170270 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7228ee2-5c72-4e6c-85a1-4bdec94c481c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:35.171050 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7228ee2-5c72-4e6c-85a1-4bdec94c481c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:35.171334 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7228ee2-5c72-4e6c-85a1-4bdec94c481c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:35.171606 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7228ee2-5c72-4e6c-85a1-4bdec94c481c admin admin] PATH_INFO: `/v3/projects/9a48d0c1b04e4b89bef3a50b3fab90a1` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:35.172869 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7228ee2-5c72-4e6c-85a1-4bdec94c481c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a48d0c1b04e4b89bef3a50b3fab90a1)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:35.174783 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7228ee2-5c72-4e6c-85a1-4bdec94c481c admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:35.222211 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b7228ee2-5c72-4e6c-85a1-4bdec94c481c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a48d0c1b04e4b89bef3a50b3fab90a1', 'request_id': 'req-b7228ee2-5c72-4e6c-85a1-4bdec94c481c'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:35.230726 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b7228ee2-5c72-4e6c-85a1-4bdec94c481c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a48d0c1b04e4b89bef3a50b3fab90a1', 'request_id': 'req-b7228ee2-5c72-4e6c-85a1-4bdec94c481c'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:35.236411 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b7228ee2-5c72-4e6c-85a1-4bdec94c481c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a48d0c1b04e4b89bef3a50b3fab90a1', 'request_id': 'req-b7228ee2-5c72-4e6c-85a1-4bdec94c481c'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:35.247202 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b7228ee2-5c72-4e6c-85a1-4bdec94c481c admin admin] The token cache is being invalidate because project 9a48d0c1b04e4b89bef3a50b3fab90a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:17:35.247513 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b7228ee2-5c72-4e6c-85a1-4bdec94c481c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:35.248155 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b7228ee2-5c72-4e6c-85a1-4bdec94c481c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:35.249712 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1383/2765] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:17:35 2021] DELETE /identity/v3/projects/9a48d0c1b04e4b89bef3a50b3fab90a1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:17:35.255528 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08eade2-7aeb-4486-ab65-19a70b2af198 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:35.256026 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08eade2-7aeb-4486-ab65-19a70b2af198 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:35.256131 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08eade2-7aeb-4486-ab65-19a70b2af198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:35.273935 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-d08eade2-7aeb-4486-ab65-19a70b2af198 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:17:35.275155 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-d08eade2-7aeb-4486-ab65-19a70b2af198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:17:35.344816 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1383/2766] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:17:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:17:35.353037 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81376374-dfa9-4ab9-a02d-0baac5684405 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:35.353322 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81376374-dfa9-4ab9-a02d-0baac5684405 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:35.353640 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81376374-dfa9-4ab9-a02d-0baac5684405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:35.373274 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-81376374-dfa9-4ab9-a02d-0baac5684405 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:17:35.374466 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-81376374-dfa9-4ab9-a02d-0baac5684405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:17:35.383270 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1384/2767] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:17:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:17:35.387635 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08eade2-7aeb-4486-ab65-19a70b2af198 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:35.398308 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08eade2-7aeb-4486-ab65-19a70b2af198 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:35.403365 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508826b2-c21a-446e-ac7f-0d4161b3c9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:35.404399 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508826b2-c21a-446e-ac7f-0d4161b3c9a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:35.404708 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508826b2-c21a-446e-ac7f-0d4161b3c9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:35.404971 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508826b2-c21a-446e-ac7f-0d4161b3c9a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:35.405726 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508826b2-c21a-446e-ac7f-0d4161b3c9a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 05:17:35.406034 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508826b2-c21a-446e-ac7f-0d4161b3c9a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:35.407663 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508826b2-c21a-446e-ac7f-0d4161b3c9a6 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:35.419788 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1384/2768] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 05:17:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 05:17:35.424289 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81376374-dfa9-4ab9-a02d-0baac5684405 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:35.433601 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81376374-dfa9-4ab9-a02d-0baac5684405 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:35.439385 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba483e-42a7-4780-be5a-406fb6cbbe47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:35.440031 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba483e-42a7-4780-be5a-406fb6cbbe47 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:35.440315 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba483e-42a7-4780-be5a-406fb6cbbe47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:35.440576 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba483e-42a7-4780-be5a-406fb6cbbe47 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:35.441316 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ba483e-42a7-4780-be5a-406fb6cbbe47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:35.443249 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ba483e-42a7-4780-be5a-406fb6cbbe47 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:35.472254 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1385/2769] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:17:35 2021] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:17:35.476516 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508826b2-c21a-446e-ac7f-0d4161b3c9a6 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:35.487158 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508826b2-c21a-446e-ac7f-0d4161b3c9a6 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:35.548872 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69e13a-031e-4fb0-8a49-36c5700b7606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:35.549602 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69e13a-031e-4fb0-8a49-36c5700b7606 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:35.549885 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69e13a-031e-4fb0-8a49-36c5700b7606 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:35.550159 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69e13a-031e-4fb0-8a49-36c5700b7606 admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:35.550846 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b69e13a-031e-4fb0-8a49-36c5700b7606 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:35.552850 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b69e13a-031e-4fb0-8a49-36c5700b7606 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:35.573656 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1385/2770] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:17:35 2021] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:17:35.578013 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba483e-42a7-4780-be5a-406fb6cbbe47 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:35.588887 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba483e-42a7-4780-be5a-406fb6cbbe47 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:35.594265 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af68e3fd-ab60-41ec-b2a6-2273b1ad5e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:35.594941 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68e3fd-ab60-41ec-b2a6-2273b1ad5e38 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:35.595220 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68e3fd-ab60-41ec-b2a6-2273b1ad5e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:35.595492 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68e3fd-ab60-41ec-b2a6-2273b1ad5e38 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:35.596237 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af68e3fd-ab60-41ec-b2a6-2273b1ad5e38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:35.597865 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af68e3fd-ab60-41ec-b2a6-2273b1ad5e38 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:35.608603 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1386/2771] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:17:35 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:17:35.612569 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69e13a-031e-4fb0-8a49-36c5700b7606 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:35.623421 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69e13a-031e-4fb0-8a49-36c5700b7606 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:35.629902 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c94e48c-7b09-4e23-8ce3-47f8b4746a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:35.630824 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94e48c-7b09-4e23-8ce3-47f8b4746a0b admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:35.631194 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94e48c-7b09-4e23-8ce3-47f8b4746a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:35.631503 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94e48c-7b09-4e23-8ce3-47f8b4746a0b admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:35.632714 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c94e48c-7b09-4e23-8ce3-47f8b4746a0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:35.634997 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c94e48c-7b09-4e23-8ce3-47f8b4746a0b admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:35.649706 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1386/2772] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:17:35 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:17:35.655693 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af68e3fd-ab60-41ec-b2a6-2273b1ad5e38 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:35.666332 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af68e3fd-ab60-41ec-b2a6-2273b1ad5e38 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:35.672478 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cbe96c-fcd2-4880-ba21-f2e209986920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:35.673480 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cbe96c-fcd2-4880-ba21-f2e209986920 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:35.673761 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cbe96c-fcd2-4880-ba21-f2e209986920 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:35.674029 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cbe96c-fcd2-4880-ba21-f2e209986920 admin admin] PATH_INFO: `/v3/projects/77168be0d2c04f47863d6738c328073a/users/25c27eaddf46415484344cfb5a2274ee/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:35.690342 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cbe96c-fcd2-4880-ba21-f2e209986920 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77168be0d2c04f47863d6738c328073a, user_id=25c27eaddf46415484344cfb5a2274ee, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:35.692976 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cbe96c-fcd2-4880-ba21-f2e209986920 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:35.708715 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1387/2773] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:17:35 2021] PUT /identity/v3/projects/77168be0d2c04f47863d6738c328073a/users/25c27eaddf46415484344cfb5a2274ee/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 05:17:35.720081 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d6e1d-8504-4369-a136-22fc7de5b90f None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:35.720473 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d6e1d-8504-4369-a136-22fc7de5b90f None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:35.720879 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d6e1d-8504-4369-a136-22fc7de5b90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:35.755007 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-c45d6e1d-8504-4369-a136-22fc7de5b90f None None] MFA Rules not processed for user `25c27eaddf46415484344cfb5a2274ee`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:17:35.756233 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-c45d6e1d-8504-4369-a136-22fc7de5b90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:17:35.820963 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1387/2774] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:17:35 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:17:35.825747 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cbe96c-fcd2-4880-ba21-f2e209986920 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:35.900343 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cbe96c-fcd2-4880-ba21-f2e209986920 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:35.908561 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac8286b-5b19-41d5-a44b-d483acf9358c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:35.909561 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac8286b-5b19-41d5-a44b-d483acf9358c admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:35.910023 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac8286b-5b19-41d5-a44b-d483acf9358c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:35.910475 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac8286b-5b19-41d5-a44b-d483acf9358c admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:35.911744 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac8286b-5b19-41d5-a44b-d483acf9358c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:35.914311 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac8286b-5b19-41d5-a44b-d483acf9358c admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:35.951151 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1388/2775] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:17:35 2021] POST /identity/v3/projects => generated 387 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:17:35.955306 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45d6e1d-8504-4369-a136-22fc7de5b90f None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:35.967293 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45d6e1d-8504-4369-a136-22fc7de5b90f None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:36.024766 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd09c5d-cc1f-4176-9b90-afc69ceb336a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:36.025434 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd09c5d-cc1f-4176-9b90-afc69ceb336a admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:36.025713 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd09c5d-cc1f-4176-9b90-afc69ceb336a admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:36.025984 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd09c5d-cc1f-4176-9b90-afc69ceb336a admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:36.026679 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd09c5d-cc1f-4176-9b90-afc69ceb336a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:36.028681 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd09c5d-cc1f-4176-9b90-afc69ceb336a admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:36.050258 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1388/2776] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:17:35 2021] POST /identity/v3/users => generated 300 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:17:36.055632 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac8286b-5b19-41d5-a44b-d483acf9358c admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:36.066072 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac8286b-5b19-41d5-a44b-d483acf9358c admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:36.071405 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f442f08-47be-41fa-b6cc-de304d638f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:36.072058 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f442f08-47be-41fa-b6cc-de304d638f1c admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:36.072335 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f442f08-47be-41fa-b6cc-de304d638f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:36.072638 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f442f08-47be-41fa-b6cc-de304d638f1c admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:36.073373 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f442f08-47be-41fa-b6cc-de304d638f1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:36.074989 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f442f08-47be-41fa-b6cc-de304d638f1c admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:36.085864 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1389/2777] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:17:36 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:17:36.090434 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd09c5d-cc1f-4176-9b90-afc69ceb336a admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:36.101445 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd09c5d-cc1f-4176-9b90-afc69ceb336a admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:36.106701 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee89f44-4e4f-413e-b470-0a9a46983f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:36.107667 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee89f44-4e4f-413e-b470-0a9a46983f10 admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:36.107948 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee89f44-4e4f-413e-b470-0a9a46983f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:36.108222 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee89f44-4e4f-413e-b470-0a9a46983f10 admin admin] PATH_INFO: `/v3/projects/dc66a71184a046de8979ce1141af917f/users/5284b566c9f34b34bd4bdf9480081772/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:36.124254 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee89f44-4e4f-413e-b470-0a9a46983f10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc66a71184a046de8979ce1141af917f, user_id=5284b566c9f34b34bd4bdf9480081772, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:36.127025 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee89f44-4e4f-413e-b470-0a9a46983f10 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:36.142564 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1389/2778] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:17:36 2021] PUT /identity/v3/projects/dc66a71184a046de8979ce1141af917f/users/5284b566c9f34b34bd4bdf9480081772/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:17:36.146682 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f442f08-47be-41fa-b6cc-de304d638f1c admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:36.157462 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f442f08-47be-41fa-b6cc-de304d638f1c admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:36.212316 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2147637-ec6d-4c6d-810b-e8cdd8abc0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:36.212926 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2147637-ec6d-4c6d-810b-e8cdd8abc0ec admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:36.213201 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2147637-ec6d-4c6d-810b-e8cdd8abc0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:36.213473 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2147637-ec6d-4c6d-810b-e8cdd8abc0ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:36.214205 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2147637-ec6d-4c6d-810b-e8cdd8abc0ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:36.215791 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2147637-ec6d-4c6d-810b-e8cdd8abc0ec admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:36.225846 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1390/2779] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:17:36 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:17:36.232595 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee89f44-4e4f-413e-b470-0a9a46983f10 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:36.248436 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee89f44-4e4f-413e-b470-0a9a46983f10 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:36.254335 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d7ec2-2b66-4087-a175-c78c8f3e4647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:36.255213 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d7ec2-2b66-4087-a175-c78c8f3e4647 admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:36.255498 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d7ec2-2b66-4087-a175-c78c8f3e4647 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:36.255767 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d7ec2-2b66-4087-a175-c78c8f3e4647 admin admin] PATH_INFO: `/v3/projects/dc66a71184a046de8979ce1141af917f/users/5284b566c9f34b34bd4bdf9480081772/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:36.258028 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0d7ec2-2b66-4087-a175-c78c8f3e4647 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc66a71184a046de8979ce1141af917f, user_id=5284b566c9f34b34bd4bdf9480081772, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:36.260715 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0d7ec2-2b66-4087-a175-c78c8f3e4647 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:36.272044 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1390/2780] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:17:36 2021] PUT /identity/v3/projects/dc66a71184a046de8979ce1141af917f/users/5284b566c9f34b34bd4bdf9480081772/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:17:36.284587 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f5754-e907-4a6e-876d-1d6580c759ca None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:36.284924 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f5754-e907-4a6e-876d-1d6580c759ca None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:36.285218 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f5754-e907-4a6e-876d-1d6580c759ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:36.320545 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-b41f5754-e907-4a6e-876d-1d6580c759ca None None] MFA Rules not processed for user `5284b566c9f34b34bd4bdf9480081772`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:17:36.321804 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-b41f5754-e907-4a6e-876d-1d6580c759ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:17:36.393272 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1391/2781] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:17:36 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:17:36.406779 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d7ec2-2b66-4087-a175-c78c8f3e4647 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:36.409524 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-6d0d7ec2-2b66-4087-a175-c78c8f3e4647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:17:36.473783 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d7ec2-2b66-4087-a175-c78c8f3e4647 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:36.479717 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0ce21-ecf3-4183-bc02-56b97b339927 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:36.480657 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0ce21-ecf3-4183-bc02-56b97b339927 service cinder] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:36.481051 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0ce21-ecf3-4183-bc02-56b97b339927 service cinder] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:36.481444 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0ce21-ecf3-4183-bc02-56b97b339927 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:36.491431 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec0ce21-ecf3-4183-bc02-56b97b339927 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:36.492916 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec0ce21-ecf3-4183-bc02-56b97b339927 service cinder] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:36.503181 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1391/2782] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:17:36 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:17:36.571825 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f5754-e907-4a6e-876d-1d6580c759ca None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:36.637663 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f5754-e907-4a6e-876d-1d6580c759ca None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:36.645222 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887432a-539d-4aff-8c1f-36cc034b0526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:36.646511 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887432a-539d-4aff-8c1f-36cc034b0526 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:36.646871 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887432a-539d-4aff-8c1f-36cc034b0526 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:36.647235 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887432a-539d-4aff-8c1f-36cc034b0526 admin admin] PATH_INFO: `/v3/users/25c27eaddf46415484344cfb5a2274ee` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:36.649443 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d887432a-539d-4aff-8c1f-36cc034b0526 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25c27eaddf46415484344cfb5a2274ee)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:36.652597 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d887432a-539d-4aff-8c1f-36cc034b0526 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:36.710736 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-d887432a-539d-4aff-8c1f-36cc034b0526 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25c27eaddf46415484344cfb5a2274ee'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:36.711369 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-d887432a-539d-4aff-8c1f-36cc034b0526 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25c27eaddf46415484344cfb5a2274ee'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:36.719745 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-d887432a-539d-4aff-8c1f-36cc034b0526 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25c27eaddf46415484344cfb5a2274ee'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:36.727802 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-d887432a-539d-4aff-8c1f-36cc034b0526 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25c27eaddf46415484344cfb5a2274ee'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:36.740130 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-d887432a-539d-4aff-8c1f-36cc034b0526 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25c27eaddf46415484344cfb5a2274ee'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:36.746188 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1392/2783] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:17:36 2021] DELETE /identity/v3/users/25c27eaddf46415484344cfb5a2274ee => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:17:36.750980 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a94cf5-c063-4236-9036-fc8291e7efff None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:36.751265 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a94cf5-c063-4236-9036-fc8291e7efff None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:36.751539 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a94cf5-c063-4236-9036-fc8291e7efff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:36.769317 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-b0a94cf5-c063-4236-9036-fc8291e7efff None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:17:36.770507 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-b0a94cf5-c063-4236-9036-fc8291e7efff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:17:36.849945 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1392/2784] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:17:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:17:36.860400 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887432a-539d-4aff-8c1f-36cc034b0526 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:36.862334 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-d887432a-539d-4aff-8c1f-36cc034b0526 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:17:36.929191 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887432a-539d-4aff-8c1f-36cc034b0526 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:36.933577 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff00e8-73fc-46cd-9cc6-b488c3949e16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:36.934221 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff00e8-73fc-46cd-9cc6-b488c3949e16 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:36.934496 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff00e8-73fc-46cd-9cc6-b488c3949e16 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:36.934839 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff00e8-73fc-46cd-9cc6-b488c3949e16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:36.948871 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaff00e8-73fc-46cd-9cc6-b488c3949e16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:36.951707 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaff00e8-73fc-46cd-9cc6-b488c3949e16 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:36.967442 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1393/2785] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:17:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:17:37.237665 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a94cf5-c063-4236-9036-fc8291e7efff None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:37.239100 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-b0a94cf5-c063-4236-9036-fc8291e7efff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:17:37.251683 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a94cf5-c063-4236-9036-fc8291e7efff None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:37.257127 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce1a450-406f-4f15-be20-4bc4442b5a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:37.258026 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1a450-406f-4f15-be20-4bc4442b5a1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:37.258309 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1a450-406f-4f15-be20-4bc4442b5a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:37.259073 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1a450-406f-4f15-be20-4bc4442b5a1f admin admin] PATH_INFO: `/v3/projects/77168be0d2c04f47863d6738c328073a` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:37.260464 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce1a450-406f-4f15-be20-4bc4442b5a1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=77168be0d2c04f47863d6738c328073a)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:37.262962 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce1a450-406f-4f15-be20-4bc4442b5a1f admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:37.314012 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-1ce1a450-406f-4f15-be20-4bc4442b5a1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77168be0d2c04f47863d6738c328073a', 'request_id': 'req-1ce1a450-406f-4f15-be20-4bc4442b5a1f'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:37.322209 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-1ce1a450-406f-4f15-be20-4bc4442b5a1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77168be0d2c04f47863d6738c328073a', 'request_id': 'req-1ce1a450-406f-4f15-be20-4bc4442b5a1f'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:37.329717 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-1ce1a450-406f-4f15-be20-4bc4442b5a1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77168be0d2c04f47863d6738c328073a', 'request_id': 'req-1ce1a450-406f-4f15-be20-4bc4442b5a1f'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:37.341109 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-1ce1a450-406f-4f15-be20-4bc4442b5a1f admin admin] The token cache is being invalidate because project 77168be0d2c04f47863d6738c328073a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:17:37.341398 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-1ce1a450-406f-4f15-be20-4bc4442b5a1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:37.342076 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-1ce1a450-406f-4f15-be20-4bc4442b5a1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:37.343767 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1393/2786] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:17:37 2021] DELETE /identity/v3/projects/77168be0d2c04f47863d6738c328073a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:17:37.347931 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff00e8-73fc-46cd-9cc6-b488c3949e16 service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:37.357553 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff00e8-73fc-46cd-9cc6-b488c3949e16 service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:37.413215 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c17b1-942d-4f28-b0eb-bf964e52155f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:37.414248 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c17b1-942d-4f28-b0eb-bf964e52155f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:37.414542 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c17b1-942d-4f28-b0eb-bf964e52155f admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:37.414818 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c17b1-942d-4f28-b0eb-bf964e52155f admin admin] PATH_INFO: `/v3/users/5284b566c9f34b34bd4bdf9480081772` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:37.416110 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c17b1-942d-4f28-b0eb-bf964e52155f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5284b566c9f34b34bd4bdf9480081772)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:37.418183 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c17b1-942d-4f28-b0eb-bf964e52155f admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:37.441193 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce1a450-406f-4f15-be20-4bc4442b5a1f admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:37.442771 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-1ce1a450-406f-4f15-be20-4bc4442b5a1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:17:37.468482 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-fe0c17b1-942d-4f28-b0eb-bf964e52155f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5284b566c9f34b34bd4bdf9480081772'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:37.469298 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-fe0c17b1-942d-4f28-b0eb-bf964e52155f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5284b566c9f34b34bd4bdf9480081772'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:37.477589 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-fe0c17b1-942d-4f28-b0eb-bf964e52155f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5284b566c9f34b34bd4bdf9480081772'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:37.484983 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-fe0c17b1-942d-4f28-b0eb-bf964e52155f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5284b566c9f34b34bd4bdf9480081772'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:37.496212 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-fe0c17b1-942d-4f28-b0eb-bf964e52155f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5284b566c9f34b34bd4bdf9480081772'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:37.502489 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1394/2787] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:17:37 2021] DELETE /identity/v3/users/5284b566c9f34b34bd4bdf9480081772 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:17:37.513573 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce1a450-406f-4f15-be20-4bc4442b5a1f admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:37.576426 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f609d-930c-4e0f-953f-6b7b4f839133 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '430d6177e74c4dbda7fb83d04c75617e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:37.577201 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f609d-930c-4e0f-953f-6b7b4f839133 service placement] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:37.577549 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f609d-930c-4e0f-953f-6b7b4f839133 service placement] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:37.578024 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f609d-930c-4e0f-953f-6b7b4f839133 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:37.579925 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-0d3f609d-930c-4e0f-953f-6b7b4f839133 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:17:37.591779 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3f609d-930c-4e0f-953f-6b7b4f839133 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:37.594083 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3f609d-930c-4e0f-953f-6b7b4f839133 service placement] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:37.606037 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1394/2788] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:17:37 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:17:37.771348 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c17b1-942d-4f28-b0eb-bf964e52155f admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:37.773149 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-fe0c17b1-942d-4f28-b0eb-bf964e52155f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:17:37.839388 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c17b1-942d-4f28-b0eb-bf964e52155f admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:37.844186 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d28d54-5ce7-49cb-859e-b1cdaa3f5613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:37.845088 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d28d54-5ce7-49cb-859e-b1cdaa3f5613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:37.845357 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d28d54-5ce7-49cb-859e-b1cdaa3f5613 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:37.845647 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d28d54-5ce7-49cb-859e-b1cdaa3f5613 admin admin] PATH_INFO: `/v3/projects/dc66a71184a046de8979ce1141af917f` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:37.846792 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d28d54-5ce7-49cb-859e-b1cdaa3f5613 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc66a71184a046de8979ce1141af917f)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:37.848728 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d28d54-5ce7-49cb-859e-b1cdaa3f5613 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:37.901116 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-51d28d54-5ce7-49cb-859e-b1cdaa3f5613 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc66a71184a046de8979ce1141af917f', 'request_id': 'req-51d28d54-5ce7-49cb-859e-b1cdaa3f5613'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:37.910738 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-51d28d54-5ce7-49cb-859e-b1cdaa3f5613 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc66a71184a046de8979ce1141af917f', 'request_id': 'req-51d28d54-5ce7-49cb-859e-b1cdaa3f5613'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:37.917745 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-51d28d54-5ce7-49cb-859e-b1cdaa3f5613 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc66a71184a046de8979ce1141af917f', 'request_id': 'req-51d28d54-5ce7-49cb-859e-b1cdaa3f5613'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:37.930226 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-51d28d54-5ce7-49cb-859e-b1cdaa3f5613 admin admin] The token cache is being invalidate because project dc66a71184a046de8979ce1141af917f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:17:37.930510 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-51d28d54-5ce7-49cb-859e-b1cdaa3f5613 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:37.931160 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-51d28d54-5ce7-49cb-859e-b1cdaa3f5613 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:37.932738 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1395/2789] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:17:37 2021] DELETE /identity/v3/projects/dc66a71184a046de8979ce1141af917f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:17:37.939203 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb09e1-4f1a-4722-8435-ac1ac8e7d5ef None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:37.939577 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb09e1-4f1a-4722-8435-ac1ac8e7d5ef None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:37.939974 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb09e1-4f1a-4722-8435-ac1ac8e7d5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:37.963938 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-69eb09e1-4f1a-4722-8435-ac1ac8e7d5ef None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:17:37.965218 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-69eb09e1-4f1a-4722-8435-ac1ac8e7d5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:17:38.032494 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1395/2790] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:17:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:17:38.043458 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5927b-6296-4ce3-bd0b-f788c0942f14 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:38.043816 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5927b-6296-4ce3-bd0b-f788c0942f14 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:38.044094 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5927b-6296-4ce3-bd0b-f788c0942f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:38.064192 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-0aa5927b-6296-4ce3-bd0b-f788c0942f14 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:17:38.065441 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-0aa5927b-6296-4ce3-bd0b-f788c0942f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:17:38.073832 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1396/2791] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:17:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:17:38.078345 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb09e1-4f1a-4722-8435-ac1ac8e7d5ef None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:38.088989 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb09e1-4f1a-4722-8435-ac1ac8e7d5ef None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:38.095016 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f549ea-ed13-401b-8f03-b399de098dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:38.095665 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f549ea-ed13-401b-8f03-b399de098dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:38.096004 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f549ea-ed13-401b-8f03-b399de098dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:38.096293 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f549ea-ed13-401b-8f03-b399de098dc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:38.097077 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f549ea-ed13-401b-8f03-b399de098dc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 05:17:38.097381 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f549ea-ed13-401b-8f03-b399de098dc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:38.098987 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f549ea-ed13-401b-8f03-b399de098dc2 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:38.111286 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1396/2792] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 05:17:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 05:17:38.115822 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5927b-6296-4ce3-bd0b-f788c0942f14 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:38.125974 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5927b-6296-4ce3-bd0b-f788c0942f14 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:38.131138 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01412e5-7c2a-435c-8133-5d3efa13e82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:38.131824 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01412e5-7c2a-435c-8133-5d3efa13e82b admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:38.132105 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01412e5-7c2a-435c-8133-5d3efa13e82b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:38.132381 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01412e5-7c2a-435c-8133-5d3efa13e82b admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:38.133120 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01412e5-7c2a-435c-8133-5d3efa13e82b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:38.135041 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01412e5-7c2a-435c-8133-5d3efa13e82b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:38.163580 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1397/2793] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:17:38 2021] POST /identity/v3/projects => generated 399 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:17:38.167993 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f549ea-ed13-401b-8f03-b399de098dc2 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:38.179173 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f549ea-ed13-401b-8f03-b399de098dc2 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:38.241940 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52594d5-8133-4a5f-9392-e3b24ee2777c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:38.242603 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52594d5-8133-4a5f-9392-e3b24ee2777c admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:38.242887 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52594d5-8133-4a5f-9392-e3b24ee2777c admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:38.243161 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52594d5-8133-4a5f-9392-e3b24ee2777c admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:38.243875 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52594d5-8133-4a5f-9392-e3b24ee2777c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:38.245848 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52594d5-8133-4a5f-9392-e3b24ee2777c admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:38.268129 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1397/2794] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:17:38 2021] POST /identity/v3/users => generated 300 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:17:38.272939 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01412e5-7c2a-435c-8133-5d3efa13e82b admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:38.286597 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01412e5-7c2a-435c-8133-5d3efa13e82b admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:38.291740 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373eb456-bbd8-491e-b66a-f56f69b29d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:38.292397 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373eb456-bbd8-491e-b66a-f56f69b29d66 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:38.292710 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373eb456-bbd8-491e-b66a-f56f69b29d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:38.292980 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373eb456-bbd8-491e-b66a-f56f69b29d66 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:38.293718 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373eb456-bbd8-491e-b66a-f56f69b29d66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:38.295347 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373eb456-bbd8-491e-b66a-f56f69b29d66 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:38.306128 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1398/2795] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:17:38 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:17:38.310056 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52594d5-8133-4a5f-9392-e3b24ee2777c admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:38.320731 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52594d5-8133-4a5f-9392-e3b24ee2777c admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:38.325726 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a2ee35-435c-44b9-8541-40e45b6c9082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:38.326384 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a2ee35-435c-44b9-8541-40e45b6c9082 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:38.326660 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a2ee35-435c-44b9-8541-40e45b6c9082 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:38.326941 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a2ee35-435c-44b9-8541-40e45b6c9082 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:38.327799 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a2ee35-435c-44b9-8541-40e45b6c9082 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:38.329350 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a2ee35-435c-44b9-8541-40e45b6c9082 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:38.339562 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1398/2796] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:17:38 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:17:38.344477 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373eb456-bbd8-491e-b66a-f56f69b29d66 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:38.354458 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373eb456-bbd8-491e-b66a-f56f69b29d66 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:38.360562 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf1994-b0e3-4829-8197-ce2fd716824b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:38.361441 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf1994-b0e3-4829-8197-ce2fd716824b admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:38.361714 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf1994-b0e3-4829-8197-ce2fd716824b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:38.361985 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf1994-b0e3-4829-8197-ce2fd716824b admin admin] PATH_INFO: `/v3/projects/62d30c1be9f249f998edafec03da852c/users/412c4ff9f86048508d8e0e1cb9e0d356/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:38.379072 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdf1994-b0e3-4829-8197-ce2fd716824b admin admin] RBAC: Authorizing `identity:create_grant(project_id=62d30c1be9f249f998edafec03da852c, user_id=412c4ff9f86048508d8e0e1cb9e0d356, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:38.381739 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdf1994-b0e3-4829-8197-ce2fd716824b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:38.397749 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1399/2797] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:17:38 2021] PUT /identity/v3/projects/62d30c1be9f249f998edafec03da852c/users/412c4ff9f86048508d8e0e1cb9e0d356/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:17:38.408171 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05134c85-fd3d-4808-95cc-fe11f4db196a None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:38.408479 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05134c85-fd3d-4808-95cc-fe11f4db196a None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:38.408786 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05134c85-fd3d-4808-95cc-fe11f4db196a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:38.435156 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-05134c85-fd3d-4808-95cc-fe11f4db196a None None] MFA Rules not processed for user `412c4ff9f86048508d8e0e1cb9e0d356`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:17:38.436423 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-05134c85-fd3d-4808-95cc-fe11f4db196a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:17:38.510638 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1399/2798] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:17:38 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:17:38.515569 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf1994-b0e3-4829-8197-ce2fd716824b admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:38.575407 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf1994-b0e3-4829-8197-ce2fd716824b admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:38.581879 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce14c3-36ad-4655-b0d4-23ea0fbefb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:38.582562 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce14c3-36ad-4655-b0d4-23ea0fbefb6f admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:38.583215 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce14c3-36ad-4655-b0d4-23ea0fbefb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:38.583485 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce14c3-36ad-4655-b0d4-23ea0fbefb6f admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:38.584187 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efce14c3-36ad-4655-b0d4-23ea0fbefb6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:38.586134 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efce14c3-36ad-4655-b0d4-23ea0fbefb6f admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:38.615830 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1400/2799] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:17:38 2021] POST /identity/v3/projects => generated 401 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 05:17:38.620612 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05134c85-fd3d-4808-95cc-fe11f4db196a None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:38.633939 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05134c85-fd3d-4808-95cc-fe11f4db196a None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:38.692700 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2acf94-d019-47f2-9402-82a16ac71279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:38.693362 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2acf94-d019-47f2-9402-82a16ac71279 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:38.693628 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2acf94-d019-47f2-9402-82a16ac71279 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:38.693897 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2acf94-d019-47f2-9402-82a16ac71279 admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:38.694602 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2acf94-d019-47f2-9402-82a16ac71279 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:38.696558 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2acf94-d019-47f2-9402-82a16ac71279 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:38.719769 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1400/2800] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:17:38 2021] POST /identity/v3/users => generated 307 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 05:17:38.724200 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce14c3-36ad-4655-b0d4-23ea0fbefb6f admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:38.735633 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce14c3-36ad-4655-b0d4-23ea0fbefb6f admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:38.740797 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7945e16f-efe9-4755-9faf-5b31cae2ec30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:38.741459 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945e16f-efe9-4755-9faf-5b31cae2ec30 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:38.741880 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945e16f-efe9-4755-9faf-5b31cae2ec30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:38.742161 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945e16f-efe9-4755-9faf-5b31cae2ec30 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:38.742910 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7945e16f-efe9-4755-9faf-5b31cae2ec30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:38.744544 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7945e16f-efe9-4755-9faf-5b31cae2ec30 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:38.755243 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1401/2801] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:17:38 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:17:38.759309 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2acf94-d019-47f2-9402-82a16ac71279 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:38.769687 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2acf94-d019-47f2-9402-82a16ac71279 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:38.774578 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c3a4e-b4a6-4cdf-9cde-cc546b22e1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:38.775443 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c3a4e-b4a6-4cdf-9cde-cc546b22e1b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:38.775731 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c3a4e-b4a6-4cdf-9cde-cc546b22e1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:38.776005 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c3a4e-b4a6-4cdf-9cde-cc546b22e1b4 admin admin] PATH_INFO: `/v3/projects/06dc08d53859420fa5324867741cd739/users/15cdadd6a9ba4f699760e6daf342fdaf/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:38.790930 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c3a4e-b4a6-4cdf-9cde-cc546b22e1b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06dc08d53859420fa5324867741cd739, user_id=15cdadd6a9ba4f699760e6daf342fdaf, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:38.793635 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c3a4e-b4a6-4cdf-9cde-cc546b22e1b4 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:38.808821 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1401/2802] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:17:38 2021] PUT /identity/v3/projects/06dc08d53859420fa5324867741cd739/users/15cdadd6a9ba4f699760e6daf342fdaf/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:17:38.812949 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7945e16f-efe9-4755-9faf-5b31cae2ec30 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:38.822858 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7945e16f-efe9-4755-9faf-5b31cae2ec30 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:38.880102 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dac788-1ac3-4d0e-ac85-146923bd49fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:38.880669 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dac788-1ac3-4d0e-ac85-146923bd49fe admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:38.880850 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dac788-1ac3-4d0e-ac85-146923bd49fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:38.881176 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dac788-1ac3-4d0e-ac85-146923bd49fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:38.881909 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dac788-1ac3-4d0e-ac85-146923bd49fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:38.883501 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dac788-1ac3-4d0e-ac85-146923bd49fe admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:38.893173 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1402/2803] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:17:38 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:17:38.897965 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c3a4e-b4a6-4cdf-9cde-cc546b22e1b4 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:38.914067 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c3a4e-b4a6-4cdf-9cde-cc546b22e1b4 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:38.921672 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834bd5a1-2847-4fb8-8c61-b7f32a628c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:38.922956 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834bd5a1-2847-4fb8-8c61-b7f32a628c47 admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:38.923237 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834bd5a1-2847-4fb8-8c61-b7f32a628c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:38.923513 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834bd5a1-2847-4fb8-8c61-b7f32a628c47 admin admin] PATH_INFO: `/v3/projects/06dc08d53859420fa5324867741cd739/users/15cdadd6a9ba4f699760e6daf342fdaf/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:38.925593 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834bd5a1-2847-4fb8-8c61-b7f32a628c47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06dc08d53859420fa5324867741cd739, user_id=15cdadd6a9ba4f699760e6daf342fdaf, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:38.928245 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834bd5a1-2847-4fb8-8c61-b7f32a628c47 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:38.941160 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1402/2804] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:17:38 2021] PUT /identity/v3/projects/06dc08d53859420fa5324867741cd739/users/15cdadd6a9ba4f699760e6daf342fdaf/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:17:38.952643 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144dab84-f32c-40a0-a1b1-6952cf4f28c6 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:38.953073 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144dab84-f32c-40a0-a1b1-6952cf4f28c6 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:38.953533 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144dab84-f32c-40a0-a1b1-6952cf4f28c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:38.981668 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-144dab84-f32c-40a0-a1b1-6952cf4f28c6 None None] MFA Rules not processed for user `15cdadd6a9ba4f699760e6daf342fdaf`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:17:38.982878 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-144dab84-f32c-40a0-a1b1-6952cf4f28c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:17:39.070242 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1403/2805] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:17:38 2021] POST /identity/v3/auth/tokens => generated 3335 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:17:39.083789 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834bd5a1-2847-4fb8-8c61-b7f32a628c47 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:39.086951 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-834bd5a1-2847-4fb8-8c61-b7f32a628c47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:17:39.150173 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834bd5a1-2847-4fb8-8c61-b7f32a628c47 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:39.155069 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdfcede-0bc3-483d-9f92-6f8868fba67f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:39.155715 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdfcede-0bc3-483d-9f92-6f8868fba67f service cinder] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:39.155990 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdfcede-0bc3-483d-9f92-6f8868fba67f service cinder] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:39.156628 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdfcede-0bc3-483d-9f92-6f8868fba67f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:39.167165 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdfcede-0bc3-483d-9f92-6f8868fba67f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:39.168648 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdfcede-0bc3-483d-9f92-6f8868fba67f service cinder] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:39.178225 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1403/2806] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:17:39 2021] GET /identity/v3/auth/tokens => generated 3335 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:17:39.261925 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144dab84-f32c-40a0-a1b1-6952cf4f28c6 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:39.271888 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144dab84-f32c-40a0-a1b1-6952cf4f28c6 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:39.275801 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e660c79a-38d4-4f68-9d50-0c67b2f7bd33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:39.276430 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660c79a-38d4-4f68-9d50-0c67b2f7bd33 service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:39.276727 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660c79a-38d4-4f68-9d50-0c67b2f7bd33 service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:39.276993 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660c79a-38d4-4f68-9d50-0c67b2f7bd33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:39.335492 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e660c79a-38d4-4f68-9d50-0c67b2f7bd33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:39.336972 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e660c79a-38d4-4f68-9d50-0c67b2f7bd33 service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:39.346927 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1404/2807] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:17:39 2021] GET /identity/v3/auth/tokens => generated 3266 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:17:43.411075 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdfcede-0bc3-483d-9f92-6f8868fba67f service cinder] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:43.485146 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdfcede-0bc3-483d-9f92-6f8868fba67f service cinder] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:43.492776 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6826aca-f845-4960-b372-d427d04ddc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:43.494113 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6826aca-f845-4960-b372-d427d04ddc84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:43.494529 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6826aca-f845-4960-b372-d427d04ddc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:43.494911 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6826aca-f845-4960-b372-d427d04ddc84 admin admin] PATH_INFO: `/v3/users/412c4ff9f86048508d8e0e1cb9e0d356` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:43.497101 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6826aca-f845-4960-b372-d427d04ddc84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=412c4ff9f86048508d8e0e1cb9e0d356)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:43.499700 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6826aca-f845-4960-b372-d427d04ddc84 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:43.549678 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-b6826aca-f845-4960-b372-d427d04ddc84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '412c4ff9f86048508d8e0e1cb9e0d356'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:43.550370 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-b6826aca-f845-4960-b372-d427d04ddc84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '412c4ff9f86048508d8e0e1cb9e0d356'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:43.557376 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-b6826aca-f845-4960-b372-d427d04ddc84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '412c4ff9f86048508d8e0e1cb9e0d356'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:43.566868 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-b6826aca-f845-4960-b372-d427d04ddc84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '412c4ff9f86048508d8e0e1cb9e0d356'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:43.567653 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-b6826aca-f845-4960-b372-d427d04ddc84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '412c4ff9f86048508d8e0e1cb9e0d356'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:43.585214 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1404/2808] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:17:43 2021] DELETE /identity/v3/users/412c4ff9f86048508d8e0e1cb9e0d356 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:17:43.591415 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869671c-5b2d-418d-972b-dde0fc08a917 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:43.591929 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869671c-5b2d-418d-972b-dde0fc08a917 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:43.592064 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869671c-5b2d-418d-972b-dde0fc08a917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:43.609379 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-b869671c-5b2d-418d-972b-dde0fc08a917 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:17:43.610637 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-b869671c-5b2d-418d-972b-dde0fc08a917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:17:43.677049 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1405/2809] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:17:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:17:43.689435 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6826aca-f845-4960-b372-d427d04ddc84 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:43.691151 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-b6826aca-f845-4960-b372-d427d04ddc84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:17:43.751740 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6826aca-f845-4960-b372-d427d04ddc84 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:43.756561 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d394b-2058-474e-be94-0d547e3323bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:43.757212 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d394b-2058-474e-be94-0d547e3323bb service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:43.757488 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d394b-2058-474e-be94-0d547e3323bb service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:43.757738 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d394b-2058-474e-be94-0d547e3323bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:43.767202 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9d394b-2058-474e-be94-0d547e3323bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:43.768674 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9d394b-2058-474e-be94-0d547e3323bb service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:43.778110 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1405/2810] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:17:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:17:44.041308 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b869671c-5b2d-418d-972b-dde0fc08a917 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:44.042867 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-b869671c-5b2d-418d-972b-dde0fc08a917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:17:44.055980 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b869671c-5b2d-418d-972b-dde0fc08a917 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:44.062567 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5bab8-824f-4ef0-a103-d338f89df6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:44.072649 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5bab8-824f-4ef0-a103-d338f89df6af admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:44.073026 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5bab8-824f-4ef0-a103-d338f89df6af admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:44.073442 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5bab8-824f-4ef0-a103-d338f89df6af admin admin] PATH_INFO: `/v3/projects/62d30c1be9f249f998edafec03da852c` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:44.075224 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d5bab8-824f-4ef0-a103-d338f89df6af admin admin] RBAC: Authorizing `identity:delete_project(project_id=62d30c1be9f249f998edafec03da852c)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:44.078236 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d5bab8-824f-4ef0-a103-d338f89df6af admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:44.128332 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-14d5bab8-824f-4ef0-a103-d338f89df6af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62d30c1be9f249f998edafec03da852c', 'request_id': 'req-14d5bab8-824f-4ef0-a103-d338f89df6af'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:44.135824 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-14d5bab8-824f-4ef0-a103-d338f89df6af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62d30c1be9f249f998edafec03da852c', 'request_id': 'req-14d5bab8-824f-4ef0-a103-d338f89df6af'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:44.141265 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-14d5bab8-824f-4ef0-a103-d338f89df6af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62d30c1be9f249f998edafec03da852c', 'request_id': 'req-14d5bab8-824f-4ef0-a103-d338f89df6af'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:44.152705 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-14d5bab8-824f-4ef0-a103-d338f89df6af admin admin] The token cache is being invalidate because project 62d30c1be9f249f998edafec03da852c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:17:44.153008 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-14d5bab8-824f-4ef0-a103-d338f89df6af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:44.153627 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-14d5bab8-824f-4ef0-a103-d338f89df6af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:44.155200 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1406/2811] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:17:44 2021] DELETE /identity/v3/projects/62d30c1be9f249f998edafec03da852c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:17:44.159688 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d394b-2058-474e-be94-0d547e3323bb service neutron] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:44.169443 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d394b-2058-474e-be94-0d547e3323bb service neutron] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:44.227891 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a18cdd-ba0d-457f-8338-23dfa1a1ff8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:44.228962 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a18cdd-ba0d-457f-8338-23dfa1a1ff8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:44.229255 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a18cdd-ba0d-457f-8338-23dfa1a1ff8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:44.229531 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a18cdd-ba0d-457f-8338-23dfa1a1ff8a admin admin] PATH_INFO: `/v3/users/15cdadd6a9ba4f699760e6daf342fdaf` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:44.230826 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a18cdd-ba0d-457f-8338-23dfa1a1ff8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=15cdadd6a9ba4f699760e6daf342fdaf)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:44.233495 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a18cdd-ba0d-457f-8338-23dfa1a1ff8a admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:44.286898 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-04a18cdd-ba0d-457f-8338-23dfa1a1ff8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15cdadd6a9ba4f699760e6daf342fdaf'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:44.287527 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-04a18cdd-ba0d-457f-8338-23dfa1a1ff8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15cdadd6a9ba4f699760e6daf342fdaf'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:44.293999 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-04a18cdd-ba0d-457f-8338-23dfa1a1ff8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15cdadd6a9ba4f699760e6daf342fdaf'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:44.303433 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-04a18cdd-ba0d-457f-8338-23dfa1a1ff8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15cdadd6a9ba4f699760e6daf342fdaf'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:44.304103 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-04a18cdd-ba0d-457f-8338-23dfa1a1ff8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15cdadd6a9ba4f699760e6daf342fdaf'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:44.321765 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1406/2812] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:17:44 2021] DELETE /identity/v3/users/15cdadd6a9ba4f699760e6daf342fdaf => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:17:44.594394 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5bab8-824f-4ef0-a103-d338f89df6af admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:44.596008 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-14d5bab8-824f-4ef0-a103-d338f89df6af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:17:44.609727 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5bab8-824f-4ef0-a103-d338f89df6af admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:44.666560 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8351ae5b-b098-4a30-a695-b208e14f779b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:44.667573 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8351ae5b-b098-4a30-a695-b208e14f779b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:44.667787 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8351ae5b-b098-4a30-a695-b208e14f779b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:44.668050 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8351ae5b-b098-4a30-a695-b208e14f779b admin admin] PATH_INFO: `/v3/projects/06dc08d53859420fa5324867741cd739` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:44.669290 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8351ae5b-b098-4a30-a695-b208e14f779b admin admin] RBAC: Authorizing `identity:delete_project(project_id=06dc08d53859420fa5324867741cd739)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:44.671223 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8351ae5b-b098-4a30-a695-b208e14f779b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:44.719145 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-8351ae5b-b098-4a30-a695-b208e14f779b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06dc08d53859420fa5324867741cd739', 'request_id': 'req-8351ae5b-b098-4a30-a695-b208e14f779b'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:44.728406 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-8351ae5b-b098-4a30-a695-b208e14f779b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06dc08d53859420fa5324867741cd739', 'request_id': 'req-8351ae5b-b098-4a30-a695-b208e14f779b'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:44.737683 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-8351ae5b-b098-4a30-a695-b208e14f779b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06dc08d53859420fa5324867741cd739', 'request_id': 'req-8351ae5b-b098-4a30-a695-b208e14f779b'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:44.749752 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-8351ae5b-b098-4a30-a695-b208e14f779b admin admin] The token cache is being invalidate because project 06dc08d53859420fa5324867741cd739 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:17:44.750033 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-8351ae5b-b098-4a30-a695-b208e14f779b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:44.750786 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-8351ae5b-b098-4a30-a695-b208e14f779b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:44.753168 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1407/2813] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:17:44 2021] DELETE /identity/v3/projects/06dc08d53859420fa5324867741cd739 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 05:17:44.759074 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20495f9a-a7e4-42bf-9fa8-dab7de4482b9 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:44.759552 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20495f9a-a7e4-42bf-9fa8-dab7de4482b9 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:44.759675 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20495f9a-a7e4-42bf-9fa8-dab7de4482b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:44.785411 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-20495f9a-a7e4-42bf-9fa8-dab7de4482b9 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:17:44.786652 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-20495f9a-a7e4-42bf-9fa8-dab7de4482b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:17:44.852657 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1407/2814] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:17:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:17:44.861821 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a20329-9715-4fc9-a4ce-b0e3c9fcf22a None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:44.862109 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a20329-9715-4fc9-a4ce-b0e3c9fcf22a None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:44.862379 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a20329-9715-4fc9-a4ce-b0e3c9fcf22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:44.882246 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-43a20329-9715-4fc9-a4ce-b0e3c9fcf22a None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:17:44.883492 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-43a20329-9715-4fc9-a4ce-b0e3c9fcf22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:17:44.893535 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1408/2815] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:17:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:17:44.897934 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20495f9a-a7e4-42bf-9fa8-dab7de4482b9 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:44.908209 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20495f9a-a7e4-42bf-9fa8-dab7de4482b9 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:44.914102 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39b719-8ff4-480a-8115-526fd6af58ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:44.914749 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39b719-8ff4-480a-8115-526fd6af58ec admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:44.915027 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39b719-8ff4-480a-8115-526fd6af58ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:44.915263 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39b719-8ff4-480a-8115-526fd6af58ec admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:44.916035 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f39b719-8ff4-480a-8115-526fd6af58ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 05:17:44.916348 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f39b719-8ff4-480a-8115-526fd6af58ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:44.918039 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f39b719-8ff4-480a-8115-526fd6af58ec admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:44.930268 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1408/2816] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 05:17:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 05:17:44.934629 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a20329-9715-4fc9-a4ce-b0e3c9fcf22a None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:44.944305 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a20329-9715-4fc9-a4ce-b0e3c9fcf22a None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:44.950392 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c557c60-1c4d-4414-bdbe-dca8554b127e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:44.951068 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c557c60-1c4d-4414-bdbe-dca8554b127e admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:44.951372 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c557c60-1c4d-4414-bdbe-dca8554b127e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:44.951635 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c557c60-1c4d-4414-bdbe-dca8554b127e admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:44.952339 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c557c60-1c4d-4414-bdbe-dca8554b127e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:44.954354 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c557c60-1c4d-4414-bdbe-dca8554b127e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:44.985931 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1409/2817] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:17:44 2021] POST /identity/v3/projects => generated 409 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:17:44.990196 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39b719-8ff4-480a-8115-526fd6af58ec admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:45.000812 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39b719-8ff4-480a-8115-526fd6af58ec admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:45.060601 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4cba46-78a0-4da0-93d0-a14d7fa5b178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:45.061299 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4cba46-78a0-4da0-93d0-a14d7fa5b178 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:45.061585 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4cba46-78a0-4da0-93d0-a14d7fa5b178 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:45.061859 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4cba46-78a0-4da0-93d0-a14d7fa5b178 admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:45.062585 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4cba46-78a0-4da0-93d0-a14d7fa5b178 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:45.064644 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4cba46-78a0-4da0-93d0-a14d7fa5b178 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:45.088705 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1409/2818] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:17:44 2021] POST /identity/v3/users => generated 305 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 24 05:17:45.092973 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c557c60-1c4d-4414-bdbe-dca8554b127e admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:45.103444 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c557c60-1c4d-4414-bdbe-dca8554b127e admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:45.108243 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1484ab-c4c8-46f9-8b03-832e09d26d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:45.108927 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1484ab-c4c8-46f9-8b03-832e09d26d4c admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:45.109203 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1484ab-c4c8-46f9-8b03-832e09d26d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:45.109473 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1484ab-c4c8-46f9-8b03-832e09d26d4c admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:45.110211 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1484ab-c4c8-46f9-8b03-832e09d26d4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:45.111850 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1484ab-c4c8-46f9-8b03-832e09d26d4c admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:45.123048 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1410/2819] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:17:45 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:17:45.127516 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4cba46-78a0-4da0-93d0-a14d7fa5b178 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:45.143845 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4cba46-78a0-4da0-93d0-a14d7fa5b178 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:45.153044 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ec4f8-36f6-4ad1-90a4-0e838257c218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:45.153968 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ec4f8-36f6-4ad1-90a4-0e838257c218 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:45.154250 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ec4f8-36f6-4ad1-90a4-0e838257c218 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:45.154591 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ec4f8-36f6-4ad1-90a4-0e838257c218 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:45.155700 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38ec4f8-36f6-4ad1-90a4-0e838257c218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:45.158319 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38ec4f8-36f6-4ad1-90a4-0e838257c218 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:45.175719 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1410/2820] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:17:45 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:17:45.182476 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1484ab-c4c8-46f9-8b03-832e09d26d4c admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:45.195890 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1484ab-c4c8-46f9-8b03-832e09d26d4c admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:45.201858 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d2cb4-f803-4a63-ae11-e1a182cb8985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:45.202760 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d2cb4-f803-4a63-ae11-e1a182cb8985 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:45.203041 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d2cb4-f803-4a63-ae11-e1a182cb8985 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:45.203323 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d2cb4-f803-4a63-ae11-e1a182cb8985 admin admin] PATH_INFO: `/v3/projects/237dd84788ec4f20bef7b8c0b631642c/users/f7cc1ed5cf7f422b93fa5657a3bb1b7f/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:45.219450 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d2cb4-f803-4a63-ae11-e1a182cb8985 admin admin] RBAC: Authorizing `identity:create_grant(project_id=237dd84788ec4f20bef7b8c0b631642c, user_id=f7cc1ed5cf7f422b93fa5657a3bb1b7f, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:45.222529 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d2cb4-f803-4a63-ae11-e1a182cb8985 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:45.243474 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1411/2821] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:17:45 2021] PUT /identity/v3/projects/237dd84788ec4f20bef7b8c0b631642c/users/f7cc1ed5cf7f422b93fa5657a3bb1b7f/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:17:45.258021 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ed5fe-ae1a-4bd8-9938-82b72ce4f620 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:45.258308 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ed5fe-ae1a-4bd8-9938-82b72ce4f620 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:45.258582 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ed5fe-ae1a-4bd8-9938-82b72ce4f620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:45.289249 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-d90ed5fe-ae1a-4bd8-9938-82b72ce4f620 None None] MFA Rules not processed for user `f7cc1ed5cf7f422b93fa5657a3bb1b7f`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:17:45.290497 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-d90ed5fe-ae1a-4bd8-9938-82b72ce4f620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:17:45.360276 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1411/2822] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:17:45 2021] POST /identity/v3/auth/tokens => generated 3276 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:17:45.367200 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d2cb4-f803-4a63-ae11-e1a182cb8985 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:45.442885 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d2cb4-f803-4a63-ae11-e1a182cb8985 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:45.448364 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e00ff-a451-4c0a-8fd5-824d9bfc2220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:45.449157 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e00ff-a451-4c0a-8fd5-824d9bfc2220 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:45.449435 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e00ff-a451-4c0a-8fd5-824d9bfc2220 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:45.449712 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e00ff-a451-4c0a-8fd5-824d9bfc2220 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:45.450421 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50e00ff-a451-4c0a-8fd5-824d9bfc2220 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:45.452448 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50e00ff-a451-4c0a-8fd5-824d9bfc2220 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:45.480887 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1412/2823] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:17:45 2021] POST /identity/v3/projects => generated 409 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:17:45.486112 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ed5fe-ae1a-4bd8-9938-82b72ce4f620 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:45.500445 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ed5fe-ae1a-4bd8-9938-82b72ce4f620 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:45.565289 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ed087a-93cd-46f6-b053-9daf6f784219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:45.565951 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed087a-93cd-46f6-b053-9daf6f784219 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:45.566236 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed087a-93cd-46f6-b053-9daf6f784219 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:45.566505 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed087a-93cd-46f6-b053-9daf6f784219 admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:45.567206 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ed087a-93cd-46f6-b053-9daf6f784219 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:45.569176 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ed087a-93cd-46f6-b053-9daf6f784219 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:45.592209 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1412/2824] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:17:45 2021] POST /identity/v3/users => generated 311 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:17:45.596276 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e00ff-a451-4c0a-8fd5-824d9bfc2220 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:45.606465 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e00ff-a451-4c0a-8fd5-824d9bfc2220 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:45.611318 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad0699a-1f07-4178-b3e3-c906e3903e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:45.611970 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0699a-1f07-4178-b3e3-c906e3903e03 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:45.612245 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0699a-1f07-4178-b3e3-c906e3903e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:45.612517 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0699a-1f07-4178-b3e3-c906e3903e03 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:45.613284 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad0699a-1f07-4178-b3e3-c906e3903e03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:45.614887 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad0699a-1f07-4178-b3e3-c906e3903e03 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:45.626315 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1413/2825] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:17:45 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:17:45.630531 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ed087a-93cd-46f6-b053-9daf6f784219 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:45.641255 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ed087a-93cd-46f6-b053-9daf6f784219 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:45.646431 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb3db5-dcfa-4865-b7c0-8064e8045113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:45.647288 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb3db5-dcfa-4865-b7c0-8064e8045113 admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:45.647559 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb3db5-dcfa-4865-b7c0-8064e8045113 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:45.647843 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb3db5-dcfa-4865-b7c0-8064e8045113 admin admin] PATH_INFO: `/v3/projects/90162a1c765845638300e9591546af62/users/8e4ff8f701d74b3e9271ce4c7f0f50f9/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:45.662452 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb3db5-dcfa-4865-b7c0-8064e8045113 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90162a1c765845638300e9591546af62, user_id=8e4ff8f701d74b3e9271ce4c7f0f50f9, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:45.665154 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb3db5-dcfa-4865-b7c0-8064e8045113 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:45.681239 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1413/2826] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:17:45 2021] PUT /identity/v3/projects/90162a1c765845638300e9591546af62/users/8e4ff8f701d74b3e9271ce4c7f0f50f9/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 05:17:45.685466 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad0699a-1f07-4178-b3e3-c906e3903e03 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:45.699250 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad0699a-1f07-4178-b3e3-c906e3903e03 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:45.769869 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0a750d-e65d-44f2-9136-1dd48c6b905c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:45.770790 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a750d-e65d-44f2-9136-1dd48c6b905c admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:45.771157 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a750d-e65d-44f2-9136-1dd48c6b905c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:45.771521 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a750d-e65d-44f2-9136-1dd48c6b905c admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:45.772669 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0a750d-e65d-44f2-9136-1dd48c6b905c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:45.775118 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0a750d-e65d-44f2-9136-1dd48c6b905c admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:45.787444 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1414/2827] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:17:45 2021] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:17:45.793177 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb3db5-dcfa-4865-b7c0-8064e8045113 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:45.805361 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb3db5-dcfa-4865-b7c0-8064e8045113 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:45.811447 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa3ff4-102b-4cff-920b-4407a20a09be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:45.812335 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa3ff4-102b-4cff-920b-4407a20a09be admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:45.812659 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa3ff4-102b-4cff-920b-4407a20a09be admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:45.812930 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa3ff4-102b-4cff-920b-4407a20a09be admin admin] PATH_INFO: `/v3/projects/90162a1c765845638300e9591546af62/users/8e4ff8f701d74b3e9271ce4c7f0f50f9/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:45.815284 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efa3ff4-102b-4cff-920b-4407a20a09be admin admin] RBAC: Authorizing `identity:create_grant(project_id=90162a1c765845638300e9591546af62, user_id=8e4ff8f701d74b3e9271ce4c7f0f50f9, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:45.817998 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efa3ff4-102b-4cff-920b-4407a20a09be admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:45.828982 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1414/2828] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:17:45 2021] PUT /identity/v3/projects/90162a1c765845638300e9591546af62/users/8e4ff8f701d74b3e9271ce4c7f0f50f9/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:17:45.839953 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7557528-b7e8-4284-9cad-0691d24bddd3 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:45.840238 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7557528-b7e8-4284-9cad-0691d24bddd3 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:45.840514 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7557528-b7e8-4284-9cad-0691d24bddd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:45.867022 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-a7557528-b7e8-4284-9cad-0691d24bddd3 None None] MFA Rules not processed for user `8e4ff8f701d74b3e9271ce4c7f0f50f9`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:17:45.868218 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-a7557528-b7e8-4284-9cad-0691d24bddd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:17:45.957215 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1415/2829] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:17:45 2021] POST /identity/v3/auth/tokens => generated 3343 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:17:45.967711 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa3ff4-102b-4cff-920b-4407a20a09be admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:45.969728 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-4efa3ff4-102b-4cff-920b-4407a20a09be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:17:46.029846 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa3ff4-102b-4cff-920b-4407a20a09be admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:46.035684 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73631ab6-0ff7-4074-b5b6-a649ec083bef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:46.036596 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73631ab6-0ff7-4074-b5b6-a649ec083bef service cinder] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:46.036970 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73631ab6-0ff7-4074-b5b6-a649ec083bef service cinder] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:46.037299 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73631ab6-0ff7-4074-b5b6-a649ec083bef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:46.053421 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73631ab6-0ff7-4074-b5b6-a649ec083bef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:46.055670 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73631ab6-0ff7-4074-b5b6-a649ec083bef service cinder] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:46.068543 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1415/2830] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:17:45 2021] GET /identity/v3/auth/tokens => generated 3343 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:17:46.222769 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7557528-b7e8-4284-9cad-0691d24bddd3 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:46.233307 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7557528-b7e8-4284-9cad-0691d24bddd3 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:46.238312 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28962590-2b70-47e7-8e3f-d4a4f020fcd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:46.239313 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28962590-2b70-47e7-8e3f-d4a4f020fcd4 service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:46.239630 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28962590-2b70-47e7-8e3f-d4a4f020fcd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:46.239894 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28962590-2b70-47e7-8e3f-d4a4f020fcd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:46.303362 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28962590-2b70-47e7-8e3f-d4a4f020fcd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:46.304844 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28962590-2b70-47e7-8e3f-d4a4f020fcd4 service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:46.316565 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1416/2831] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:17:46 2021] GET /identity/v3/auth/tokens => generated 3276 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:17:55.712635 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73631ab6-0ff7-4074-b5b6-a649ec083bef service cinder] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:55.779896 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73631ab6-0ff7-4074-b5b6-a649ec083bef service cinder] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:55.785002 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de8967-6315-450d-8b5e-5832c79bd802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:55.785847 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de8967-6315-450d-8b5e-5832c79bd802 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:55.786147 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de8967-6315-450d-8b5e-5832c79bd802 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:55.786420 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de8967-6315-450d-8b5e-5832c79bd802 admin admin] PATH_INFO: `/v3/users/f7cc1ed5cf7f422b93fa5657a3bb1b7f` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:55.788051 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5de8967-6315-450d-8b5e-5832c79bd802 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7cc1ed5cf7f422b93fa5657a3bb1b7f)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:55.790049 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5de8967-6315-450d-8b5e-5832c79bd802 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:55.845297 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-e5de8967-6315-450d-8b5e-5832c79bd802 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7cc1ed5cf7f422b93fa5657a3bb1b7f'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:55.845886 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-e5de8967-6315-450d-8b5e-5832c79bd802 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7cc1ed5cf7f422b93fa5657a3bb1b7f'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:55.853006 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-e5de8967-6315-450d-8b5e-5832c79bd802 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7cc1ed5cf7f422b93fa5657a3bb1b7f'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:55.862458 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-e5de8967-6315-450d-8b5e-5832c79bd802 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7cc1ed5cf7f422b93fa5657a3bb1b7f'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:55.863078 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-e5de8967-6315-450d-8b5e-5832c79bd802 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7cc1ed5cf7f422b93fa5657a3bb1b7f'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:55.879950 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1416/2832] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:17:55 2021] DELETE /identity/v3/users/f7cc1ed5cf7f422b93fa5657a3bb1b7f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:17:55.884807 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d2882-0e05-4d84-a4cd-97bd44e175a1 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:55.885316 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d2882-0e05-4d84-a4cd-97bd44e175a1 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:55.885418 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d2882-0e05-4d84-a4cd-97bd44e175a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:55.903251 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-178d2882-0e05-4d84-a4cd-97bd44e175a1 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:17:55.904451 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-178d2882-0e05-4d84-a4cd-97bd44e175a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:17:55.973126 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1417/2833] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:17:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:17:55.983400 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de8967-6315-450d-8b5e-5832c79bd802 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:55.984989 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-e5de8967-6315-450d-8b5e-5832c79bd802 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:17:56.045546 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de8967-6315-450d-8b5e-5832c79bd802 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:56.049684 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e1273-2770-4d13-b5eb-553e7f29f70f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:56.050322 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e1273-2770-4d13-b5eb-553e7f29f70f service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:56.050596 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e1273-2770-4d13-b5eb-553e7f29f70f service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:56.050863 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e1273-2770-4d13-b5eb-553e7f29f70f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:56.060402 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7e1273-2770-4d13-b5eb-553e7f29f70f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:56.061872 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7e1273-2770-4d13-b5eb-553e7f29f70f service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:56.071359 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1417/2834] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:17:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:17:56.336036 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d2882-0e05-4d84-a4cd-97bd44e175a1 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:56.337582 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-178d2882-0e05-4d84-a4cd-97bd44e175a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:17:56.349426 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d2882-0e05-4d84-a4cd-97bd44e175a1 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:56.354724 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c026c49-818c-49d7-b319-94850bc17e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:56.355596 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c026c49-818c-49d7-b319-94850bc17e2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:56.355874 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c026c49-818c-49d7-b319-94850bc17e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:56.356145 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c026c49-818c-49d7-b319-94850bc17e2c admin admin] PATH_INFO: `/v3/projects/237dd84788ec4f20bef7b8c0b631642c` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:56.357395 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c026c49-818c-49d7-b319-94850bc17e2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=237dd84788ec4f20bef7b8c0b631642c)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:56.359323 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c026c49-818c-49d7-b319-94850bc17e2c admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:56.409123 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-7c026c49-818c-49d7-b319-94850bc17e2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '237dd84788ec4f20bef7b8c0b631642c', 'request_id': 'req-7c026c49-818c-49d7-b319-94850bc17e2c'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:56.418436 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-7c026c49-818c-49d7-b319-94850bc17e2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '237dd84788ec4f20bef7b8c0b631642c', 'request_id': 'req-7c026c49-818c-49d7-b319-94850bc17e2c'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:56.424117 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-7c026c49-818c-49d7-b319-94850bc17e2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '237dd84788ec4f20bef7b8c0b631642c', 'request_id': 'req-7c026c49-818c-49d7-b319-94850bc17e2c'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:56.435991 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-7c026c49-818c-49d7-b319-94850bc17e2c admin admin] The token cache is being invalidate because project 237dd84788ec4f20bef7b8c0b631642c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:17:56.436273 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-7c026c49-818c-49d7-b319-94850bc17e2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:56.436974 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-7c026c49-818c-49d7-b319-94850bc17e2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:56.438550 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1418/2835] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:17:56 2021] DELETE /identity/v3/projects/237dd84788ec4f20bef7b8c0b631642c => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:17:56.442741 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e1273-2770-4d13-b5eb-553e7f29f70f service neutron] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:56.455072 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e1273-2770-4d13-b5eb-553e7f29f70f service neutron] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:56.514208 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5b2c9b-590e-472d-8f30-d273c9bf5b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:56.515073 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b2c9b-590e-472d-8f30-d273c9bf5b5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:56.515345 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b2c9b-590e-472d-8f30-d273c9bf5b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:56.515612 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b2c9b-590e-472d-8f30-d273c9bf5b5d admin admin] PATH_INFO: `/v3/users/8e4ff8f701d74b3e9271ce4c7f0f50f9` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:56.516879 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5b2c9b-590e-472d-8f30-d273c9bf5b5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e4ff8f701d74b3e9271ce4c7f0f50f9)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:56.518798 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5b2c9b-590e-472d-8f30-d273c9bf5b5d admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:56.567879 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-6e5b2c9b-590e-472d-8f30-d273c9bf5b5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e4ff8f701d74b3e9271ce4c7f0f50f9'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:56.568711 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-6e5b2c9b-590e-472d-8f30-d273c9bf5b5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e4ff8f701d74b3e9271ce4c7f0f50f9'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:56.575545 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-6e5b2c9b-590e-472d-8f30-d273c9bf5b5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e4ff8f701d74b3e9271ce4c7f0f50f9'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:56.584052 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-6e5b2c9b-590e-472d-8f30-d273c9bf5b5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e4ff8f701d74b3e9271ce4c7f0f50f9'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:56.584760 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-6e5b2c9b-590e-472d-8f30-d273c9bf5b5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e4ff8f701d74b3e9271ce4c7f0f50f9'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:56.602709 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1418/2836] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:17:56 2021] DELETE /identity/v3/users/8e4ff8f701d74b3e9271ce4c7f0f50f9 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:17:56.876949 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c026c49-818c-49d7-b319-94850bc17e2c admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:56.878415 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-7c026c49-818c-49d7-b319-94850bc17e2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:17:56.896003 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c026c49-818c-49d7-b319-94850bc17e2c admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:56.958521 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187e76d2-3c06-4e17-be74-0d6c7fcb6e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:56.959414 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e76d2-3c06-4e17-be74-0d6c7fcb6e43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:56.959631 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e76d2-3c06-4e17-be74-0d6c7fcb6e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:56.959900 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e76d2-3c06-4e17-be74-0d6c7fcb6e43 admin admin] PATH_INFO: `/v3/projects/90162a1c765845638300e9591546af62` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:56.961200 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187e76d2-3c06-4e17-be74-0d6c7fcb6e43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90162a1c765845638300e9591546af62)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:56.963128 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187e76d2-3c06-4e17-be74-0d6c7fcb6e43 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:57.015149 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-187e76d2-3c06-4e17-be74-0d6c7fcb6e43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90162a1c765845638300e9591546af62', 'request_id': 'req-187e76d2-3c06-4e17-be74-0d6c7fcb6e43'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:57.023960 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-187e76d2-3c06-4e17-be74-0d6c7fcb6e43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90162a1c765845638300e9591546af62', 'request_id': 'req-187e76d2-3c06-4e17-be74-0d6c7fcb6e43'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:57.030420 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-187e76d2-3c06-4e17-be74-0d6c7fcb6e43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90162a1c765845638300e9591546af62', 'request_id': 'req-187e76d2-3c06-4e17-be74-0d6c7fcb6e43'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:57.041839 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-187e76d2-3c06-4e17-be74-0d6c7fcb6e43 admin admin] The token cache is being invalidate because project 90162a1c765845638300e9591546af62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:17:57.042122 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-187e76d2-3c06-4e17-be74-0d6c7fcb6e43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:57.042770 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-187e76d2-3c06-4e17-be74-0d6c7fcb6e43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:17:57.044346 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1419/2837] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:17:56 2021] DELETE /identity/v3/projects/90162a1c765845638300e9591546af62 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:17:57.050165 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be21e90-a21f-474c-8e87-0c6ae9860cb5 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:57.050657 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be21e90-a21f-474c-8e87-0c6ae9860cb5 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:57.050773 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be21e90-a21f-474c-8e87-0c6ae9860cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:57.068244 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-3be21e90-a21f-474c-8e87-0c6ae9860cb5 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:17:57.069679 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-3be21e90-a21f-474c-8e87-0c6ae9860cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:17:57.126731 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1419/2838] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:17:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:17:57.134923 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6222b-6535-42b2-9ee2-8d8fcf4bc298 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:57.135208 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6222b-6535-42b2-9ee2-8d8fcf4bc298 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:57.135478 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6222b-6535-42b2-9ee2-8d8fcf4bc298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:57.153915 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-a2a6222b-6535-42b2-9ee2-8d8fcf4bc298 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:17:57.155105 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-a2a6222b-6535-42b2-9ee2-8d8fcf4bc298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:17:57.163464 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1420/2839] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:17:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:17:57.167884 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be21e90-a21f-474c-8e87-0c6ae9860cb5 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:57.179647 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be21e90-a21f-474c-8e87-0c6ae9860cb5 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:57.186040 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb079e6-a4c8-4d25-a2ee-cc7dc1722d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:57.186722 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb079e6-a4c8-4d25-a2ee-cc7dc1722d24 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:57.187000 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb079e6-a4c8-4d25-a2ee-cc7dc1722d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:57.187266 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb079e6-a4c8-4d25-a2ee-cc7dc1722d24 admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:57.188008 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb079e6-a4c8-4d25-a2ee-cc7dc1722d24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 05:17:57.188308 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb079e6-a4c8-4d25-a2ee-cc7dc1722d24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:57.189969 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb079e6-a4c8-4d25-a2ee-cc7dc1722d24 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:57.202467 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1420/2840] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 05:17:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 24 05:17:57.206811 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6222b-6535-42b2-9ee2-8d8fcf4bc298 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:57.217266 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6222b-6535-42b2-9ee2-8d8fcf4bc298 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:57.223207 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e0eb1-4e43-464d-960f-274abca847eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:57.223858 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e0eb1-4e43-464d-960f-274abca847eb admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:57.224137 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e0eb1-4e43-464d-960f-274abca847eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:57.224406 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e0eb1-4e43-464d-960f-274abca847eb admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:57.225341 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857e0eb1-4e43-464d-960f-274abca847eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:57.227246 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857e0eb1-4e43-464d-960f-274abca847eb admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:57.258055 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1421/2841] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:17:57 2021] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:17:57.262870 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb079e6-a4c8-4d25-a2ee-cc7dc1722d24 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:57.276161 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb079e6-a4c8-4d25-a2ee-cc7dc1722d24 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:57.340215 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae981b-66ce-4795-8d60-1975384b3f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:57.340913 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae981b-66ce-4795-8d60-1975384b3f7e admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:57.341192 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae981b-66ce-4795-8d60-1975384b3f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:57.341458 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae981b-66ce-4795-8d60-1975384b3f7e admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:57.342156 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae981b-66ce-4795-8d60-1975384b3f7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:57.344194 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae981b-66ce-4795-8d60-1975384b3f7e admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:57.365249 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1421/2842] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:17:57 2021] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:17:57.370151 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e0eb1-4e43-464d-960f-274abca847eb admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:57.380994 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e0eb1-4e43-464d-960f-274abca847eb admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:57.386470 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46869c7a-f2cf-4bdb-8a62-794c55b7e2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:57.387134 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46869c7a-f2cf-4bdb-8a62-794c55b7e2e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:57.387411 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46869c7a-f2cf-4bdb-8a62-794c55b7e2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:57.387684 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46869c7a-f2cf-4bdb-8a62-794c55b7e2e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:57.388429 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46869c7a-f2cf-4bdb-8a62-794c55b7e2e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:57.390104 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46869c7a-f2cf-4bdb-8a62-794c55b7e2e6 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:57.401102 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1422/2843] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:17:57 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:17:57.406338 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae981b-66ce-4795-8d60-1975384b3f7e admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:57.417180 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae981b-66ce-4795-8d60-1975384b3f7e admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:57.422812 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec84f09-70c7-410d-8887-99e768465908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:57.423466 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec84f09-70c7-410d-8887-99e768465908 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:57.423749 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec84f09-70c7-410d-8887-99e768465908 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:57.424022 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec84f09-70c7-410d-8887-99e768465908 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:57.424798 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec84f09-70c7-410d-8887-99e768465908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:57.426368 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec84f09-70c7-410d-8887-99e768465908 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:57.436477 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1422/2844] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:17:57 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:17:57.440718 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46869c7a-f2cf-4bdb-8a62-794c55b7e2e6 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:57.451177 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46869c7a-f2cf-4bdb-8a62-794c55b7e2e6 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:57.456180 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d64f5e-7c61-4b48-864f-785beb726018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:57.457092 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d64f5e-7c61-4b48-864f-785beb726018 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:57.457362 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d64f5e-7c61-4b48-864f-785beb726018 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:57.457969 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d64f5e-7c61-4b48-864f-785beb726018 admin admin] PATH_INFO: `/v3/projects/9657c044b88d4f1f910024face749e22/users/3418ea6935cd4be5a67ca4317e5eeb17/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:57.473770 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d64f5e-7c61-4b48-864f-785beb726018 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9657c044b88d4f1f910024face749e22, user_id=3418ea6935cd4be5a67ca4317e5eeb17, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:57.477050 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d64f5e-7c61-4b48-864f-785beb726018 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:57.492821 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1423/2845] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:17:57 2021] PUT /identity/v3/projects/9657c044b88d4f1f910024face749e22/users/3418ea6935cd4be5a67ca4317e5eeb17/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:17:57.504489 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c97f47-ee58-4868-8664-346a32da8a55 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:57.504807 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c97f47-ee58-4868-8664-346a32da8a55 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:57.505084 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c97f47-ee58-4868-8664-346a32da8a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:57.532446 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-10c97f47-ee58-4868-8664-346a32da8a55 None None] MFA Rules not processed for user `3418ea6935cd4be5a67ca4317e5eeb17`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:17:57.533693 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-10c97f47-ee58-4868-8664-346a32da8a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:17:57.604012 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1423/2846] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:17:57 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 05:17:57.605359 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d64f5e-7c61-4b48-864f-785beb726018 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:57.668279 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d64f5e-7c61-4b48-864f-785beb726018 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:57.673695 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0757b87-a700-4934-8b37-421ebe5ad86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:57.674354 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0757b87-a700-4934-8b37-421ebe5ad86d admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:57.674634 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0757b87-a700-4934-8b37-421ebe5ad86d admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:57.674911 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0757b87-a700-4934-8b37-421ebe5ad86d admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:57.675620 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0757b87-a700-4934-8b37-421ebe5ad86d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:57.677577 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0757b87-a700-4934-8b37-421ebe5ad86d admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:57.713500 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1424/2847] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:17:57 2021] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:17:57.719204 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c97f47-ee58-4868-8664-346a32da8a55 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:57.733520 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c97f47-ee58-4868-8664-346a32da8a55 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:57.814818 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f39312-dd16-42ff-8548-46014dc27a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:57.815866 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f39312-dd16-42ff-8548-46014dc27a8c admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:57.816337 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f39312-dd16-42ff-8548-46014dc27a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:57.816836 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f39312-dd16-42ff-8548-46014dc27a8c admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:57.817985 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f39312-dd16-42ff-8548-46014dc27a8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:57.820934 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f39312-dd16-42ff-8548-46014dc27a8c admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:57.847645 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1424/2848] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:17:57 2021] POST /identity/v3/users => generated 298 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:17:57.854129 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0757b87-a700-4934-8b37-421ebe5ad86d admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:57.871284 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0757b87-a700-4934-8b37-421ebe5ad86d admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:57.880090 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4172e63a-bf76-4625-bcc1-e1784a64165a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:57.881338 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4172e63a-bf76-4625-bcc1-e1784a64165a admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:57.881637 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4172e63a-bf76-4625-bcc1-e1784a64165a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:57.881908 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4172e63a-bf76-4625-bcc1-e1784a64165a admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:57.882666 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4172e63a-bf76-4625-bcc1-e1784a64165a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:57.884255 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4172e63a-bf76-4625-bcc1-e1784a64165a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:57.894998 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1425/2849] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:17:57 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:17:57.899544 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f39312-dd16-42ff-8548-46014dc27a8c admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:57.909825 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f39312-dd16-42ff-8548-46014dc27a8c admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:57.915364 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b289ec39-0b46-46cc-8cc6-222addf2d53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:57.916263 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289ec39-0b46-46cc-8cc6-222addf2d53c admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:57.916554 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289ec39-0b46-46cc-8cc6-222addf2d53c admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:57.916852 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289ec39-0b46-46cc-8cc6-222addf2d53c admin admin] PATH_INFO: `/v3/projects/32c59258ed57480183a664a176a0c671/users/4263df87541849c1a8fa1b5587d68ecc/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:57.931909 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b289ec39-0b46-46cc-8cc6-222addf2d53c admin admin] RBAC: Authorizing `identity:create_grant(project_id=32c59258ed57480183a664a176a0c671, user_id=4263df87541849c1a8fa1b5587d68ecc, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:57.934632 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b289ec39-0b46-46cc-8cc6-222addf2d53c admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:57.948996 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1425/2850] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:17:57 2021] PUT /identity/v3/projects/32c59258ed57480183a664a176a0c671/users/4263df87541849c1a8fa1b5587d68ecc/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:17:57.953076 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4172e63a-bf76-4625-bcc1-e1784a64165a admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:57.964289 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4172e63a-bf76-4625-bcc1-e1784a64165a admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:58.022439 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c4435-ca97-41e2-8d18-3f2728797b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:58.023121 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c4435-ca97-41e2-8d18-3f2728797b8e admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:58.023404 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c4435-ca97-41e2-8d18-3f2728797b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:58.023680 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c4435-ca97-41e2-8d18-3f2728797b8e admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:58.024419 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c4435-ca97-41e2-8d18-3f2728797b8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:58.026043 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c4435-ca97-41e2-8d18-3f2728797b8e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:58.035815 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1426/2851] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:17:57 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:17:58.040185 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b289ec39-0b46-46cc-8cc6-222addf2d53c admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:58.051070 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b289ec39-0b46-46cc-8cc6-222addf2d53c admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:58.056936 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb7ae8-da67-484f-8251-5117bd62e428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:58.057822 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb7ae8-da67-484f-8251-5117bd62e428 admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:58.058129 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb7ae8-da67-484f-8251-5117bd62e428 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:58.058368 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb7ae8-da67-484f-8251-5117bd62e428 admin admin] PATH_INFO: `/v3/projects/32c59258ed57480183a664a176a0c671/users/4263df87541849c1a8fa1b5587d68ecc/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:58.060756 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb7ae8-da67-484f-8251-5117bd62e428 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32c59258ed57480183a664a176a0c671, user_id=4263df87541849c1a8fa1b5587d68ecc, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:58.063389 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb7ae8-da67-484f-8251-5117bd62e428 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:58.074680 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1426/2852] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:17:58 2021] PUT /identity/v3/projects/32c59258ed57480183a664a176a0c671/users/4263df87541849c1a8fa1b5587d68ecc/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:17:58.085600 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0ef7a-da56-4d3e-a0ed-045b42425ec7 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:58.085890 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0ef7a-da56-4d3e-a0ed-045b42425ec7 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:58.086162 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0ef7a-da56-4d3e-a0ed-045b42425ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:58.115858 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-14f0ef7a-da56-4d3e-a0ed-045b42425ec7 None None] MFA Rules not processed for user `4263df87541849c1a8fa1b5587d68ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:17:58.117115 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-14f0ef7a-da56-4d3e-a0ed-045b42425ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:17:58.194724 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1427/2853] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:17:58 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:17:58.205218 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb7ae8-da67-484f-8251-5117bd62e428 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:17:58.207268 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-7dfb7ae8-da67-484f-8251-5117bd62e428 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:17:58.270290 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb7ae8-da67-484f-8251-5117bd62e428 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:17:58.274789 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bd6949-2470-4a67-9dc6-c2797d21c211 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:17:58.275431 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd6949-2470-4a67-9dc6-c2797d21c211 service cinder] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:17:58.275708 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd6949-2470-4a67-9dc6-c2797d21c211 service cinder] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:17:58.275990 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd6949-2470-4a67-9dc6-c2797d21c211 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:17:58.335506 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bd6949-2470-4a67-9dc6-c2797d21c211 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:17:58.337027 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bd6949-2470-4a67-9dc6-c2797d21c211 service cinder] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:17:58.346467 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1427/2854] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:17:58 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:18:02.610194 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f0ef7a-da56-4d3e-a0ed-045b42425ec7 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:18:02.612715 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-14f0ef7a-da56-4d3e-a0ed-045b42425ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:18:02.627567 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f0ef7a-da56-4d3e-a0ed-045b42425ec7 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:18:02.632230 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b01b0-6918-43b4-ba9f-9fbe029e7197 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:18:02.632958 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b01b0-6918-43b4-ba9f-9fbe029e7197 service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:18:02.633294 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b01b0-6918-43b4-ba9f-9fbe029e7197 service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:18:02.633811 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b01b0-6918-43b4-ba9f-9fbe029e7197 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:18:02.648943 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210b01b0-6918-43b4-ba9f-9fbe029e7197 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:18:02.650516 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210b01b0-6918-43b4-ba9f-9fbe029e7197 service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:18:02.660710 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1428/2855] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:18:02 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:18:07.568044 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bd6949-2470-4a67-9dc6-c2797d21c211 service cinder] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:18:07.632520 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bd6949-2470-4a67-9dc6-c2797d21c211 service cinder] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:18:07.637715 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921951d6-2103-4c85-95bb-31768185e699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:18:07.638573 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921951d6-2103-4c85-95bb-31768185e699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:18:07.638853 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921951d6-2103-4c85-95bb-31768185e699 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:18:07.639128 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921951d6-2103-4c85-95bb-31768185e699 admin admin] PATH_INFO: `/v3/users/3418ea6935cd4be5a67ca4317e5eeb17` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:18:07.640343 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921951d6-2103-4c85-95bb-31768185e699 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3418ea6935cd4be5a67ca4317e5eeb17)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:18:07.642326 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921951d6-2103-4c85-95bb-31768185e699 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:18:07.703107 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-921951d6-2103-4c85-95bb-31768185e699 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3418ea6935cd4be5a67ca4317e5eeb17'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:18:07.704094 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-921951d6-2103-4c85-95bb-31768185e699 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3418ea6935cd4be5a67ca4317e5eeb17'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:18:07.714379 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-921951d6-2103-4c85-95bb-31768185e699 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3418ea6935cd4be5a67ca4317e5eeb17'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:18:07.724499 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-921951d6-2103-4c85-95bb-31768185e699 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3418ea6935cd4be5a67ca4317e5eeb17'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:18:07.725279 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-921951d6-2103-4c85-95bb-31768185e699 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3418ea6935cd4be5a67ca4317e5eeb17'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:18:07.742488 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1428/2856] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:18:07 2021] DELETE /identity/v3/users/3418ea6935cd4be5a67ca4317e5eeb17 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:18:07.747300 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba65312-5eaf-4309-bb0d-24da5c7e479f None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:18:07.747831 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba65312-5eaf-4309-bb0d-24da5c7e479f None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:18:07.747831 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba65312-5eaf-4309-bb0d-24da5c7e479f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:18:07.765484 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-2ba65312-5eaf-4309-bb0d-24da5c7e479f None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:18:07.766697 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-2ba65312-5eaf-4309-bb0d-24da5c7e479f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:18:07.824852 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1429/2857] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:18:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:18:07.837426 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921951d6-2103-4c85-95bb-31768185e699 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:18:07.838945 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-921951d6-2103-4c85-95bb-31768185e699 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:18:07.894001 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921951d6-2103-4c85-95bb-31768185e699 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:18:07.897689 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa8368-c375-49c5-94c6-d81db7980f4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:18:07.898327 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa8368-c375-49c5-94c6-d81db7980f4f service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:18:07.898609 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa8368-c375-49c5-94c6-d81db7980f4f service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:18:07.898880 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa8368-c375-49c5-94c6-d81db7980f4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:18:07.908313 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafa8368-c375-49c5-94c6-d81db7980f4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:18:07.909796 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafa8368-c375-49c5-94c6-d81db7980f4f service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:18:07.919495 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1429/2858] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:18:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:18:08.195074 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba65312-5eaf-4309-bb0d-24da5c7e479f None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:18:08.197523 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-2ba65312-5eaf-4309-bb0d-24da5c7e479f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:18:08.215956 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba65312-5eaf-4309-bb0d-24da5c7e479f None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:18:08.220884 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944a24d-c36c-4176-b54e-917d3d774189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:18:08.221752 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944a24d-c36c-4176-b54e-917d3d774189 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:18:08.222028 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944a24d-c36c-4176-b54e-917d3d774189 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:18:08.222291 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944a24d-c36c-4176-b54e-917d3d774189 admin admin] PATH_INFO: `/v3/projects/9657c044b88d4f1f910024face749e22` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:18:08.223636 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7944a24d-c36c-4176-b54e-917d3d774189 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9657c044b88d4f1f910024face749e22)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:18:08.225529 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7944a24d-c36c-4176-b54e-917d3d774189 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:18:08.277688 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-7944a24d-c36c-4176-b54e-917d3d774189 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9657c044b88d4f1f910024face749e22', 'request_id': 'req-7944a24d-c36c-4176-b54e-917d3d774189'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:18:08.287787 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-7944a24d-c36c-4176-b54e-917d3d774189 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9657c044b88d4f1f910024face749e22', 'request_id': 'req-7944a24d-c36c-4176-b54e-917d3d774189'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:18:08.293203 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-7944a24d-c36c-4176-b54e-917d3d774189 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9657c044b88d4f1f910024face749e22', 'request_id': 'req-7944a24d-c36c-4176-b54e-917d3d774189'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:18:08.304053 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-7944a24d-c36c-4176-b54e-917d3d774189 admin admin] The token cache is being invalidate because project 9657c044b88d4f1f910024face749e22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:18:08.304335 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-7944a24d-c36c-4176-b54e-917d3d774189 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:18:08.304994 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-7944a24d-c36c-4176-b54e-917d3d774189 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:18:08.306608 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1430/2859] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:18:08 2021] DELETE /identity/v3/projects/9657c044b88d4f1f910024face749e22 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:18:08.310677 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa8368-c375-49c5-94c6-d81db7980f4f service neutron] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:18:08.321138 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa8368-c375-49c5-94c6-d81db7980f4f service neutron] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:18:08.380004 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f950e-c8f5-4e5c-bbbe-1b5521e42a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:18:08.380899 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f950e-c8f5-4e5c-bbbe-1b5521e42a38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:18:08.381176 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f950e-c8f5-4e5c-bbbe-1b5521e42a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:18:08.381442 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f950e-c8f5-4e5c-bbbe-1b5521e42a38 admin admin] PATH_INFO: `/v3/users/4263df87541849c1a8fa1b5587d68ecc` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:18:08.382700 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f950e-c8f5-4e5c-bbbe-1b5521e42a38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4263df87541849c1a8fa1b5587d68ecc)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:18:08.384742 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f950e-c8f5-4e5c-bbbe-1b5521e42a38 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:18:08.438332 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-e58f950e-c8f5-4e5c-bbbe-1b5521e42a38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4263df87541849c1a8fa1b5587d68ecc'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:18:08.438928 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-e58f950e-c8f5-4e5c-bbbe-1b5521e42a38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4263df87541849c1a8fa1b5587d68ecc'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:18:08.445509 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-e58f950e-c8f5-4e5c-bbbe-1b5521e42a38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4263df87541849c1a8fa1b5587d68ecc'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:18:08.454189 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-e58f950e-c8f5-4e5c-bbbe-1b5521e42a38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4263df87541849c1a8fa1b5587d68ecc'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:18:08.454827 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-e58f950e-c8f5-4e5c-bbbe-1b5521e42a38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4263df87541849c1a8fa1b5587d68ecc'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:18:08.472363 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1430/2860] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:18:08 2021] DELETE /identity/v3/users/4263df87541849c1a8fa1b5587d68ecc => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 05:18:08.758054 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944a24d-c36c-4176-b54e-917d3d774189 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:18:08.759743 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-7944a24d-c36c-4176-b54e-917d3d774189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:18:08.773269 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944a24d-c36c-4176-b54e-917d3d774189 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:18:08.840606 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c517f5e4-82e2-4e90-8068-78a7000dde9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:18:08.841503 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c517f5e4-82e2-4e90-8068-78a7000dde9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:18:08.841780 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c517f5e4-82e2-4e90-8068-78a7000dde9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:18:08.842051 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c517f5e4-82e2-4e90-8068-78a7000dde9a admin admin] PATH_INFO: `/v3/projects/32c59258ed57480183a664a176a0c671` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:18:08.843271 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c517f5e4-82e2-4e90-8068-78a7000dde9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=32c59258ed57480183a664a176a0c671)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:18:08.845229 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c517f5e4-82e2-4e90-8068-78a7000dde9a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:18:08.893043 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-c517f5e4-82e2-4e90-8068-78a7000dde9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32c59258ed57480183a664a176a0c671', 'request_id': 'req-c517f5e4-82e2-4e90-8068-78a7000dde9a'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:18:08.902002 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-c517f5e4-82e2-4e90-8068-78a7000dde9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32c59258ed57480183a664a176a0c671', 'request_id': 'req-c517f5e4-82e2-4e90-8068-78a7000dde9a'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:18:08.907236 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-c517f5e4-82e2-4e90-8068-78a7000dde9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32c59258ed57480183a664a176a0c671', 'request_id': 'req-c517f5e4-82e2-4e90-8068-78a7000dde9a'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:18:08.918332 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-c517f5e4-82e2-4e90-8068-78a7000dde9a admin admin] The token cache is being invalidate because project 32c59258ed57480183a664a176a0c671 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:18:08.918624 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-c517f5e4-82e2-4e90-8068-78a7000dde9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:18:08.919264 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-c517f5e4-82e2-4e90-8068-78a7000dde9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:18:08.920941 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1431/2861] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:18:08 2021] DELETE /identity/v3/projects/32c59258ed57480183a664a176a0c671 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:18:08.927696 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55569360-1d54-43c5-bf3c-05ba6a87e0b9 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:18:08.928212 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55569360-1d54-43c5-bf3c-05ba6a87e0b9 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:18:08.928322 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55569360-1d54-43c5-bf3c-05ba6a87e0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:18:08.946860 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-55569360-1d54-43c5-bf3c-05ba6a87e0b9 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:18:08.948222 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-55569360-1d54-43c5-bf3c-05ba6a87e0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:18:09.006562 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1431/2862] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:18:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:18:09.015352 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e604e-b9bf-4fca-9730-207113460506 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:18:09.015638 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e604e-b9bf-4fca-9730-207113460506 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:18:09.015916 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e604e-b9bf-4fca-9730-207113460506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:18:09.034748 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-570e604e-b9bf-4fca-9730-207113460506 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:18:09.035935 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-570e604e-b9bf-4fca-9730-207113460506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:18:09.044342 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1432/2863] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:18:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:18:09.048708 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55569360-1d54-43c5-bf3c-05ba6a87e0b9 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:18:09.058587 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55569360-1d54-43c5-bf3c-05ba6a87e0b9 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:18:09.063450 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a674f5b-ccf6-43ed-9a7a-3994f0a24861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:18:09.064101 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a674f5b-ccf6-43ed-9a7a-3994f0a24861 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:18:09.064385 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a674f5b-ccf6-43ed-9a7a-3994f0a24861 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:18:09.064690 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a674f5b-ccf6-43ed-9a7a-3994f0a24861 admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:18:09.065444 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a674f5b-ccf6-43ed-9a7a-3994f0a24861 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 05:18:09.065752 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a674f5b-ccf6-43ed-9a7a-3994f0a24861 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:18:09.067375 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a674f5b-ccf6-43ed-9a7a-3994f0a24861 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:18:09.079217 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1432/2864] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 05:18:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 05:18:09.084353 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e604e-b9bf-4fca-9730-207113460506 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:18:09.094630 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e604e-b9bf-4fca-9730-207113460506 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:18:09.100553 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c421a-4f31-464f-b25e-e4b24f585783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:18:09.101218 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c421a-4f31-464f-b25e-e4b24f585783 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:18:09.101512 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c421a-4f31-464f-b25e-e4b24f585783 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:18:09.101783 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c421a-4f31-464f-b25e-e4b24f585783 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:18:09.102497 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c421a-4f31-464f-b25e-e4b24f585783 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:18:09.104428 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c421a-4f31-464f-b25e-e4b24f585783 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:18:09.135757 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1433/2865] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:18:09 2021] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:18:09.138451 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a674f5b-ccf6-43ed-9a7a-3994f0a24861 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:18:09.148367 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a674f5b-ccf6-43ed-9a7a-3994f0a24861 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:18:09.204158 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f0de61-a66b-4000-a6f2-d453210b6b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:18:09.204770 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0de61-a66b-4000-a6f2-d453210b6b1c admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:18:09.205055 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0de61-a66b-4000-a6f2-d453210b6b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:18:09.205330 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0de61-a66b-4000-a6f2-d453210b6b1c admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:18:09.206032 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f0de61-a66b-4000-a6f2-d453210b6b1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:18:09.208344 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f0de61-a66b-4000-a6f2-d453210b6b1c admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:18:09.229867 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1433/2866] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:18:09 2021] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:18:09.235356 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c421a-4f31-464f-b25e-e4b24f585783 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:18:09.247243 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c421a-4f31-464f-b25e-e4b24f585783 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:18:09.253022 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d59ff-d54d-470d-94dd-253406591a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:18:09.253680 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d59ff-d54d-470d-94dd-253406591a99 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:18:09.253953 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d59ff-d54d-470d-94dd-253406591a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:18:09.254227 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d59ff-d54d-470d-94dd-253406591a99 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:18:09.254981 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d59ff-d54d-470d-94dd-253406591a99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:18:09.256610 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d59ff-d54d-470d-94dd-253406591a99 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:18:09.267176 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1434/2867] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:18:09 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:18:09.273282 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f0de61-a66b-4000-a6f2-d453210b6b1c admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:18:09.285474 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f0de61-a66b-4000-a6f2-d453210b6b1c admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:18:09.291723 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0766034f-80ed-46ad-8847-e534e0165d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:18:09.292389 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0766034f-80ed-46ad-8847-e534e0165d21 admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:18:09.292710 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0766034f-80ed-46ad-8847-e534e0165d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:18:09.292981 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0766034f-80ed-46ad-8847-e534e0165d21 admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:18:09.293734 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0766034f-80ed-46ad-8847-e534e0165d21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:18:09.295356 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0766034f-80ed-46ad-8847-e534e0165d21 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:18:09.306124 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1434/2868] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:18:09 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:18:09.310631 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d59ff-d54d-470d-94dd-253406591a99 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:18:09.320996 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d59ff-d54d-470d-94dd-253406591a99 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:18:09.325785 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd6920e-e70a-4582-acf6-425c3fd66dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:18:09.326667 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6920e-e70a-4582-acf6-425c3fd66dd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:18:09.326944 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6920e-e70a-4582-acf6-425c3fd66dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:18:09.327215 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6920e-e70a-4582-acf6-425c3fd66dd4 admin admin] PATH_INFO: `/v3/projects/9ff67dce1e4d4f438e71cc722eddcb7d/users/c9628c3b72b645b0a24f7ce651beac7b/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:18:09.342380 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd6920e-e70a-4582-acf6-425c3fd66dd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ff67dce1e4d4f438e71cc722eddcb7d, user_id=c9628c3b72b645b0a24f7ce651beac7b, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:18:09.345049 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd6920e-e70a-4582-acf6-425c3fd66dd4 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:18:09.359484 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1435/2869] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:18:09 2021] PUT /identity/v3/projects/9ff67dce1e4d4f438e71cc722eddcb7d/users/c9628c3b72b645b0a24f7ce651beac7b/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:18:09.417518 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaea434-e085-4607-8213-27ab1bcf670f None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:18:09.417825 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaea434-e085-4607-8213-27ab1bcf670f None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:18:09.418074 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaea434-e085-4607-8213-27ab1bcf670f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:18:09.445787 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-beaea434-e085-4607-8213-27ab1bcf670f None None] MFA Rules not processed for user `c9628c3b72b645b0a24f7ce651beac7b`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:18:09.446983 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-beaea434-e085-4607-8213-27ab1bcf670f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:18:09.514943 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1435/2870] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:18:09 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 05:18:09.525882 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd6920e-e70a-4582-acf6-425c3fd66dd4 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:18:09.527916 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-1bd6920e-e70a-4582-acf6-425c3fd66dd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:18:09.587774 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd6920e-e70a-4582-acf6-425c3fd66dd4 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:18:09.592788 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f0b579-3691-49fa-ba69-9f500891e713 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38517ab5a29c438e89634209652d9963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:18:09.593437 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0b579-3691-49fa-ba69-9f500891e713 service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:18:09.593721 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0b579-3691-49fa-ba69-9f500891e713 service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:18:09.593990 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0b579-3691-49fa-ba69-9f500891e713 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:18:09.603004 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f0b579-3691-49fa-ba69-9f500891e713 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:18:09.604628 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f0b579-3691-49fa-ba69-9f500891e713 service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:18:09.615051 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1436/2871] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:18:09 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:18:12.181933 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaea434-e085-4607-8213-27ab1bcf670f None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:18:12.251660 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaea434-e085-4607-8213-27ab1bcf670f None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:18:12.256232 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d83eeb-eb95-4e1d-8496-d41bd807fa83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:18:12.257123 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d83eeb-eb95-4e1d-8496-d41bd807fa83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:18:12.257397 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d83eeb-eb95-4e1d-8496-d41bd807fa83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:18:12.257668 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d83eeb-eb95-4e1d-8496-d41bd807fa83 admin admin] PATH_INFO: `/v3/users/c9628c3b72b645b0a24f7ce651beac7b` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:18:12.258862 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d83eeb-eb95-4e1d-8496-d41bd807fa83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9628c3b72b645b0a24f7ce651beac7b)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:18:12.260850 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d83eeb-eb95-4e1d-8496-d41bd807fa83 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:18:12.315077 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-a3d83eeb-eb95-4e1d-8496-d41bd807fa83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9628c3b72b645b0a24f7ce651beac7b'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:18:12.315784 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-a3d83eeb-eb95-4e1d-8496-d41bd807fa83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9628c3b72b645b0a24f7ce651beac7b'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:18:12.322952 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-a3d83eeb-eb95-4e1d-8496-d41bd807fa83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9628c3b72b645b0a24f7ce651beac7b'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:18:12.332457 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-a3d83eeb-eb95-4e1d-8496-d41bd807fa83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9628c3b72b645b0a24f7ce651beac7b'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:18:12.333951 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-a3d83eeb-eb95-4e1d-8496-d41bd807fa83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9628c3b72b645b0a24f7ce651beac7b'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:18:12.352901 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1436/2872] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:18:12 2021] DELETE /identity/v3/users/c9628c3b72b645b0a24f7ce651beac7b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:18:12.357754 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978a601-8d3d-433f-887a-07eb2ce28d28 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:18:12.358307 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978a601-8d3d-433f-887a-07eb2ce28d28 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:18:12.358307 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978a601-8d3d-433f-887a-07eb2ce28d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:18:12.377315 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-2978a601-8d3d-433f-887a-07eb2ce28d28 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:18:12.378519 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-2978a601-8d3d-433f-887a-07eb2ce28d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:18:12.445598 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1437/2873] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:18:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 05:18:12.455690 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d83eeb-eb95-4e1d-8496-d41bd807fa83 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:18:12.457210 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-a3d83eeb-eb95-4e1d-8496-d41bd807fa83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:18:12.516136 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d83eeb-eb95-4e1d-8496-d41bd807fa83 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:18:12.520183 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8100815d-cdd9-414c-b7de-e48fa2ae2aa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:18:12.520842 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8100815d-cdd9-414c-b7de-e48fa2ae2aa1 service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:18:12.521119 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8100815d-cdd9-414c-b7de-e48fa2ae2aa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:18:12.521392 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8100815d-cdd9-414c-b7de-e48fa2ae2aa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:18:12.531048 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8100815d-cdd9-414c-b7de-e48fa2ae2aa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:18:12.532494 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8100815d-cdd9-414c-b7de-e48fa2ae2aa1 service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:18:12.542161 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1437/2874] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:18:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 24 05:18:12.825927 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978a601-8d3d-433f-887a-07eb2ce28d28 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:18:12.827544 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-2978a601-8d3d-433f-887a-07eb2ce28d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:18:12.840062 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978a601-8d3d-433f-887a-07eb2ce28d28 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:18:12.846112 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060c1c7-6f59-422d-b390-b1f30b5ae21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:18:12.846986 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060c1c7-6f59-422d-b390-b1f30b5ae21e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:18:12.847273 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060c1c7-6f59-422d-b390-b1f30b5ae21e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:18:12.847548 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060c1c7-6f59-422d-b390-b1f30b5ae21e admin admin] PATH_INFO: `/v3/projects/9ff67dce1e4d4f438e71cc722eddcb7d` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:18:12.848955 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3060c1c7-6f59-422d-b390-b1f30b5ae21e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ff67dce1e4d4f438e71cc722eddcb7d)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:18:12.850879 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3060c1c7-6f59-422d-b390-b1f30b5ae21e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:18:12.901531 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-3060c1c7-6f59-422d-b390-b1f30b5ae21e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ff67dce1e4d4f438e71cc722eddcb7d', 'request_id': 'req-3060c1c7-6f59-422d-b390-b1f30b5ae21e'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:18:12.910479 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-3060c1c7-6f59-422d-b390-b1f30b5ae21e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ff67dce1e4d4f438e71cc722eddcb7d', 'request_id': 'req-3060c1c7-6f59-422d-b390-b1f30b5ae21e'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:18:12.916043 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-3060c1c7-6f59-422d-b390-b1f30b5ae21e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ff67dce1e4d4f438e71cc722eddcb7d', 'request_id': 'req-3060c1c7-6f59-422d-b390-b1f30b5ae21e'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:18:12.927218 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-3060c1c7-6f59-422d-b390-b1f30b5ae21e admin admin] The token cache is being invalidate because project 9ff67dce1e4d4f438e71cc722eddcb7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:18:12.927504 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-3060c1c7-6f59-422d-b390-b1f30b5ae21e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:18:12.928138 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-3060c1c7-6f59-422d-b390-b1f30b5ae21e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:18:12.929722 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1438/2875] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:18:12 2021] DELETE /identity/v3/projects/9ff67dce1e4d4f438e71cc722eddcb7d => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:18:12.936021 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82fc92-06aa-4c00-ac63-7a6fabfe5cf3 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:18:12.936336 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82fc92-06aa-4c00-ac63-7a6fabfe5cf3 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:18:12.936633 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82fc92-06aa-4c00-ac63-7a6fabfe5cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:18:12.954190 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-de82fc92-06aa-4c00-ac63-7a6fabfe5cf3 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:18:12.955370 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-de82fc92-06aa-4c00-ac63-7a6fabfe5cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:18:13.014585 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1438/2876] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:18:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:18:13.025925 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e78a7-c1b0-43ef-ae5c-44efac6342ba None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:18:13.026212 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e78a7-c1b0-43ef-ae5c-44efac6342ba None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:18:13.026492 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e78a7-c1b0-43ef-ae5c-44efac6342ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:18:13.046526 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-887e78a7-c1b0-43ef-ae5c-44efac6342ba None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:18:13.047695 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-887e78a7-c1b0-43ef-ae5c-44efac6342ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:18:13.056387 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1439/2877] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:18:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 24 05:18:13.060968 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de82fc92-06aa-4c00-ac63-7a6fabfe5cf3 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:18:13.070978 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de82fc92-06aa-4c00-ac63-7a6fabfe5cf3 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:18:13.078109 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8ba11-7e27-4d47-8092-fd8fe1efdf3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:18:13.079085 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8ba11-7e27-4d47-8092-fd8fe1efdf3b admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:18:13.079362 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8ba11-7e27-4d47-8092-fd8fe1efdf3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:18:13.079696 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8ba11-7e27-4d47-8092-fd8fe1efdf3b admin admin] PATH_INFO: `/v3/domains` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:18:13.080859 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d8ba11-7e27-4d47-8092-fd8fe1efdf3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 24 05:18:13.081273 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d8ba11-7e27-4d47-8092-fd8fe1efdf3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:18:13.084021 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d8ba11-7e27-4d47-8092-fd8fe1efdf3b admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:18:13.098280 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1439/2878] 10.222.0.43 () {58 vars in 1152 bytes} [Fri Dec 24 05:18:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 24 05:18:13.102687 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e78a7-c1b0-43ef-ae5c-44efac6342ba None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:18:13.112369 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e78a7-c1b0-43ef-ae5c-44efac6342ba None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:18:13.118538 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5bad36-f72b-460f-9eec-b145114de228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:18:13.119206 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bad36-f72b-460f-9eec-b145114de228 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:18:13.119482 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bad36-f72b-460f-9eec-b145114de228 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:18:13.119749 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bad36-f72b-460f-9eec-b145114de228 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:18:13.120545 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5bad36-f72b-460f-9eec-b145114de228 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:18:13.122618 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5bad36-f72b-460f-9eec-b145114de228 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:18:13.154082 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1440/2879] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:18:13 2021] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:18:13.155339 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8ba11-7e27-4d47-8092-fd8fe1efdf3b admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:18:13.165245 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8ba11-7e27-4d47-8092-fd8fe1efdf3b admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:18:13.222595 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726627b-33a3-4ac6-ae6b-37650358579d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:18:13.223240 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726627b-33a3-4ac6-ae6b-37650358579d admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:18:13.223516 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726627b-33a3-4ac6-ae6b-37650358579d admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:18:13.223784 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726627b-33a3-4ac6-ae6b-37650358579d admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:18:13.224479 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f726627b-33a3-4ac6-ae6b-37650358579d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:18:13.226444 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f726627b-33a3-4ac6-ae6b-37650358579d admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:18:13.253845 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1440/2880] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:18:13 2021] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:18:13.256415 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5bad36-f72b-460f-9eec-b145114de228 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:18:13.267436 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5bad36-f72b-460f-9eec-b145114de228 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:18:13.271913 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f451575-ed36-4039-891a-0c86f62a4511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:18:13.272573 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f451575-ed36-4039-891a-0c86f62a4511 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:18:13.272879 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f451575-ed36-4039-891a-0c86f62a4511 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:18:13.273150 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f451575-ed36-4039-891a-0c86f62a4511 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:18:13.273886 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f451575-ed36-4039-891a-0c86f62a4511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:18:13.275469 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f451575-ed36-4039-891a-0c86f62a4511 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:18:13.286588 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1441/2881] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:18:13 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:18:13.290659 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726627b-33a3-4ac6-ae6b-37650358579d admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:18:13.301816 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726627b-33a3-4ac6-ae6b-37650358579d admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:18:13.307770 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f2698-1167-40d4-8b66-8ea41f0e1e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:18:13.308987 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f2698-1167-40d4-8b66-8ea41f0e1e9d admin admin] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:18:13.310014 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f2698-1167-40d4-8b66-8ea41f0e1e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:18:13.310014 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f2698-1167-40d4-8b66-8ea41f0e1e9d admin admin] PATH_INFO: `/v3/roles` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:18:13.311678 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f2698-1167-40d4-8b66-8ea41f0e1e9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:18:13.313362 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f2698-1167-40d4-8b66-8ea41f0e1e9d admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:18:13.323900 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1441/2882] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:18:13 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:18:13.328217 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f451575-ed36-4039-891a-0c86f62a4511 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:18:13.338560 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f451575-ed36-4039-891a-0c86f62a4511 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:18:13.343620 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f6be8-7314-46e4-adfc-00d5322e9a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:18:13.344490 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f6be8-7314-46e4-adfc-00d5322e9a72 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:18:13.344804 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f6be8-7314-46e4-adfc-00d5322e9a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:18:13.345073 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f6be8-7314-46e4-adfc-00d5322e9a72 admin admin] PATH_INFO: `/v3/projects/274c3c6f555f48ad93189e73c71c5ffe/users/d7d8af7dfd114b88af9b6ca9e78381fb/roles/19e41972301c400193cf0c53e0462e49` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:18:13.359679 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f6be8-7314-46e4-adfc-00d5322e9a72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=274c3c6f555f48ad93189e73c71c5ffe, user_id=d7d8af7dfd114b88af9b6ca9e78381fb, role_id=19e41972301c400193cf0c53e0462e49)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:18:13.362353 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f6be8-7314-46e4-adfc-00d5322e9a72 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:18:13.377276 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1442/2883] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:18:13 2021] PUT /identity/v3/projects/274c3c6f555f48ad93189e73c71c5ffe/users/d7d8af7dfd114b88af9b6ca9e78381fb/roles/19e41972301c400193cf0c53e0462e49 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 05:18:13.382449 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed632e-12df-4ce4-a0b0-889a421de9b5 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:18:13.382763 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed632e-12df-4ce4-a0b0-889a421de9b5 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:18:13.383032 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed632e-12df-4ce4-a0b0-889a421de9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:18:13.401984 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-19ed632e-12df-4ce4-a0b0-889a421de9b5 None None] MFA Rules not processed for user `d2031cc40bf6488b8dc6976b8c829c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:18:13.403401 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-19ed632e-12df-4ce4-a0b0-889a421de9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:18:13.462991 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1442/2884] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:18:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:18:13.473288 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f6be8-7314-46e4-adfc-00d5322e9a72 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:18:13.475387 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-3e2f6be8-7314-46e4-adfc-00d5322e9a72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:18:13.554995 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f6be8-7314-46e4-adfc-00d5322e9a72 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:18:13.559947 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c529e-cfff-4b0b-b694-d1ba4686503b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:18:13.560623 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c529e-cfff-4b0b-b694-d1ba4686503b service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:18:13.560901 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c529e-cfff-4b0b-b694-d1ba4686503b service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:18:13.561171 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c529e-cfff-4b0b-b694-d1ba4686503b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:18:13.571239 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c529e-cfff-4b0b-b694-d1ba4686503b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:18:13.572714 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c529e-cfff-4b0b-b694-d1ba4686503b service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:18:13.582325 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1443/2885] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:18:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:18:17.483457 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125b7fc-07de-4621-ac9c-8e64f790f5a2 None None] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:18:17.483908 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125b7fc-07de-4621-ac9c-8e64f790f5a2 None None] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:18:17.484020 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125b7fc-07de-4621-ac9c-8e64f790f5a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:18:17.512019 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.auth.core [None req-3125b7fc-07de-4621-ac9c-8e64f790f5a2 None None] MFA Rules not processed for user `d7d8af7dfd114b88af9b6ca9e78381fb`. Rule list: `[]` (Enabled: `True`). {{(pid=79112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:18:17.513802 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-3125b7fc-07de-4621-ac9c-8e64f790f5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:18:17.580603 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1443/2886] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:18:17 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:18:17.585529 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c529e-cfff-4b0b-b694-d1ba4686503b service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:18:17.596465 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c529e-cfff-4b0b-b694-d1ba4686503b service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:18:17.602182 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6b135-32f0-463e-8060-ef34ea0eb326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:18:17.602833 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6b135-32f0-463e-8060-ef34ea0eb326 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:18:17.603111 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6b135-32f0-463e-8060-ef34ea0eb326 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:18:17.603383 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6b135-32f0-463e-8060-ef34ea0eb326 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:18:17.604290 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b6b135-32f0-463e-8060-ef34ea0eb326 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:18:17.606284 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b6b135-32f0-463e-8060-ef34ea0eb326 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:18:17.633629 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1444/2887] 10.222.0.43 () {60 vars in 1152 bytes} [Fri Dec 24 05:18:17 2021] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:18:17.638082 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125b7fc-07de-4621-ac9c-8e64f790f5a2 None None] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:18:17.648934 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125b7fc-07de-4621-ac9c-8e64f790f5a2 None None] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:18:17.707942 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df30c91-56f6-4a4c-bff5-fc8357653bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:18:17.708461 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df30c91-56f6-4a4c-bff5-fc8357653bc0 admin admin] REQUEST_METHOD: `POST` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:18:17.708760 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df30c91-56f6-4a4c-bff5-fc8357653bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:18:17.709193 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df30c91-56f6-4a4c-bff5-fc8357653bc0 admin admin] PATH_INFO: `/v3/users` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:18:17.709929 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df30c91-56f6-4a4c-bff5-fc8357653bc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:18:17.711909 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df30c91-56f6-4a4c-bff5-fc8357653bc0 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:18:17.752764 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1444/2888] 10.222.0.43 () {60 vars in 1143 bytes} [Fri Dec 24 05:18:17 2021] POST /identity/v3/users => generated 292 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 24 05:18:17.754243 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6b135-32f0-463e-8060-ef34ea0eb326 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:18:17.764963 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6b135-32f0-463e-8060-ef34ea0eb326 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:18:17.769545 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e574a92-cfc8-40fb-a191-971101804f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:18:17.770206 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e574a92-cfc8-40fb-a191-971101804f26 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:18:17.770488 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e574a92-cfc8-40fb-a191-971101804f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:18:17.770766 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e574a92-cfc8-40fb-a191-971101804f26 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:18:17.771514 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e574a92-cfc8-40fb-a191-971101804f26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:18:17.774861 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e574a92-cfc8-40fb-a191-971101804f26 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:18:17.791137 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1445/2889] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:18:17 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:18:17.795576 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df30c91-56f6-4a4c-bff5-fc8357653bc0 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:18:17.806303 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df30c91-56f6-4a4c-bff5-fc8357653bc0 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:18:17.811476 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d11fba5-59bf-4f26-94b6-bfa1f77b4107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:18:17.812382 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11fba5-59bf-4f26-94b6-bfa1f77b4107 admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:18:17.812711 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11fba5-59bf-4f26-94b6-bfa1f77b4107 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:18:17.812993 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11fba5-59bf-4f26-94b6-bfa1f77b4107 admin admin] PATH_INFO: `/v3/projects/905e5afd4e554da8aa686e9236199822/users/7616883154ce46cfbb38f4561b8b62a8/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:18:17.829268 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d11fba5-59bf-4f26-94b6-bfa1f77b4107 admin admin] RBAC: Authorizing `identity:create_grant(project_id=905e5afd4e554da8aa686e9236199822, user_id=7616883154ce46cfbb38f4561b8b62a8, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:18:17.832487 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d11fba5-59bf-4f26-94b6-bfa1f77b4107 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:18:17.850105 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1445/2890] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:18:17 2021] PUT /identity/v3/projects/905e5afd4e554da8aa686e9236199822/users/7616883154ce46cfbb38f4561b8b62a8/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 05:18:17.854117 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e574a92-cfc8-40fb-a191-971101804f26 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:18:17.864753 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e574a92-cfc8-40fb-a191-971101804f26 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:18:17.923935 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492d3d1-b778-4bbb-9b3c-531f337e68bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:18:17.924656 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492d3d1-b778-4bbb-9b3c-531f337e68bd admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:18:17.924946 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492d3d1-b778-4bbb-9b3c-531f337e68bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:18:17.925221 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492d3d1-b778-4bbb-9b3c-531f337e68bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:18:17.925969 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0492d3d1-b778-4bbb-9b3c-531f337e68bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:18:17.927591 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0492d3d1-b778-4bbb-9b3c-531f337e68bd admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:18:17.938809 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1446/2891] 10.222.0.43 () {58 vars in 1121 bytes} [Fri Dec 24 05:18:17 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 24 05:18:17.943115 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d11fba5-59bf-4f26-94b6-bfa1f77b4107 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:18:17.954321 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d11fba5-59bf-4f26-94b6-bfa1f77b4107 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:18:17.960969 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d6c57-8935-4ee4-9971-341813fd3ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:18:17.961886 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d6c57-8935-4ee4-9971-341813fd3ffa admin admin] REQUEST_METHOD: `PUT` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:18:17.962142 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d6c57-8935-4ee4-9971-341813fd3ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:18:17.962414 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d6c57-8935-4ee4-9971-341813fd3ffa admin admin] PATH_INFO: `/v3/projects/905e5afd4e554da8aa686e9236199822/users/7616883154ce46cfbb38f4561b8b62a8/roles/d5e6fc257d8541d5a5ed1988eacd5be7` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:18:17.964741 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d6c57-8935-4ee4-9971-341813fd3ffa admin admin] RBAC: Authorizing `identity:create_grant(project_id=905e5afd4e554da8aa686e9236199822, user_id=7616883154ce46cfbb38f4561b8b62a8, role_id=d5e6fc257d8541d5a5ed1988eacd5be7)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:18:17.967434 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d6c57-8935-4ee4-9971-341813fd3ffa admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:18:17.979415 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1446/2892] 10.222.0.43 () {60 vars in 1482 bytes} [Fri Dec 24 05:18:17 2021] PUT /identity/v3/projects/905e5afd4e554da8aa686e9236199822/users/7616883154ce46cfbb38f4561b8b62a8/roles/d5e6fc257d8541d5a5ed1988eacd5be7 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 24 05:18:22.411119 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf25a5-7a05-4259-8aca-b4e8b6825855 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:18:22.411657 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf25a5-7a05-4259-8aca-b4e8b6825855 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:18:22.411657 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf25a5-7a05-4259-8aca-b4e8b6825855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:18:22.439803 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-7fdf25a5-7a05-4259-8aca-b4e8b6825855 None None] MFA Rules not processed for user `7616883154ce46cfbb38f4561b8b62a8`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:18:22.441072 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-7fdf25a5-7a05-4259-8aca-b4e8b6825855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:18:22.513231 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1447/2893] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:18:22 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:18:22.525669 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d6c57-8935-4ee4-9971-341813fd3ffa admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:18:22.528026 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-ad4d6c57-8935-4ee4-9971-341813fd3ffa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:18:22.608970 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d6c57-8935-4ee4-9971-341813fd3ffa admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:18:22.615380 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7cc83-ae1e-4082-bbda-a52f706d8b0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f9ad1e8f8f74edcb44aabe17eb59648', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:18:22.616640 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7cc83-ae1e-4082-bbda-a52f706d8b0c service nova] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:18:22.616869 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7cc83-ae1e-4082-bbda-a52f706d8b0c service nova] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:18:22.617116 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7cc83-ae1e-4082-bbda-a52f706d8b0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:18:22.681145 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde7cc83-ae1e-4082-bbda-a52f706d8b0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:18:22.682774 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde7cc83-ae1e-4082-bbda-a52f706d8b0c service nova] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:18:22.692570 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1447/2894] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:18:22 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:18:23.856991 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ec1f3-e779-4eff-bee6-b86e7cf542a3 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:18:23.857514 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ec1f3-e779-4eff-bee6-b86e7cf542a3 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:18:23.858016 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ec1f3-e779-4eff-bee6-b86e7cf542a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:18:23.876546 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-082ec1f3-e779-4eff-bee6-b86e7cf542a3 None None] MFA Rules not processed for user `d7d8af7dfd114b88af9b6ca9e78381fb`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 24 05:18:23.877750 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-082ec1f3-e779-4eff-bee6-b86e7cf542a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:18:23.885329 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1448/2895] 10.222.0.43 () {58 vars in 957 bytes} [Fri Dec 24 05:18:23 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 24 05:19:01.745585 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7cc83-ae1e-4082-bbda-a52f706d8b0c service nova] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:19:01.756840 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7cc83-ae1e-4082-bbda-a52f706d8b0c service nova] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:19:01.762889 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b27c4-e777-4781-9ac4-678a37a73636 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f9ad1e8f8f74edcb44aabe17eb59648', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:19:01.763542 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b27c4-e777-4781-9ac4-678a37a73636 service nova] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:19:01.763824 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b27c4-e777-4781-9ac4-678a37a73636 service nova] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:19:01.764118 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b27c4-e777-4781-9ac4-678a37a73636 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:19:01.765949 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-615b27c4-e777-4781-9ac4-678a37a73636 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:19:01.782576 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615b27c4-e777-4781-9ac4-678a37a73636 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:19:01.784182 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615b27c4-e777-4781-9ac4-678a37a73636 service nova] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:19:01.795525 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1448/2896] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:19:01 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:19:04.113286 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ec1f3-e779-4eff-bee6-b86e7cf542a3 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:19:04.114872 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-082ec1f3-e779-4eff-bee6-b86e7cf542a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:19:04.175440 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ec1f3-e779-4eff-bee6-b86e7cf542a3 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:19:04.179986 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a594fb-c9f2-44b9-a1c9-5d9c08c87790 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:19:04.180664 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a594fb-c9f2-44b9-a1c9-5d9c08c87790 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:19:04.180952 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a594fb-c9f2-44b9-a1c9-5d9c08c87790 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:19:04.181231 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a594fb-c9f2-44b9-a1c9-5d9c08c87790 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:19:04.190529 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a594fb-c9f2-44b9-a1c9-5d9c08c87790 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:19:04.191963 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a594fb-c9f2-44b9-a1c9-5d9c08c87790 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:19:04.202127 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1449/2897] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:19:04 2021] GET /identity/v3/auth/tokens => generated 3305 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 24 05:20:34.188757 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b27c4-e777-4781-9ac4-678a37a73636 service nova] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:20:34.199208 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b27c4-e777-4781-9ac4-678a37a73636 service nova] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:20:34.203734 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb25e12-a4c1-41bd-ba5a-b672e1d49f65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:20:34.204413 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb25e12-a4c1-41bd-ba5a-b672e1d49f65 service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:20:34.204726 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb25e12-a4c1-41bd-ba5a-b672e1d49f65 service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:20:34.205006 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb25e12-a4c1-41bd-ba5a-b672e1d49f65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:20:34.206989 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-0cb25e12-a4c1-41bd-ba5a-b672e1d49f65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:20:34.219018 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb25e12-a4c1-41bd-ba5a-b672e1d49f65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:20:34.220463 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb25e12-a4c1-41bd-ba5a-b672e1d49f65 service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:20:34.229415 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1449/2898] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:20:34 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:21:20.104984 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a594fb-c9f2-44b9-a1c9-5d9c08c87790 service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:21:20.114556 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a594fb-c9f2-44b9-a1c9-5d9c08c87790 service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:21:20.119314 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413a95e-cedd-4e2b-b242-a46cc7a7f03a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:21:20.120348 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413a95e-cedd-4e2b-b242-a46cc7a7f03a service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:21:20.120843 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413a95e-cedd-4e2b-b242-a46cc7a7f03a service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:21:20.121214 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413a95e-cedd-4e2b-b242-a46cc7a7f03a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:21:20.124223 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-3413a95e-cedd-4e2b-b242-a46cc7a7f03a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:21:20.138508 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3413a95e-cedd-4e2b-b242-a46cc7a7f03a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:21:20.139987 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3413a95e-cedd-4e2b-b242-a46cc7a7f03a service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:21:20.151281 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1450/2899] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:21:20 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:21:21.344394 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb25e12-a4c1-41bd-ba5a-b672e1d49f65 service neutron] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:21:21.354252 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb25e12-a4c1-41bd-ba5a-b672e1d49f65 service neutron] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:21:21.358695 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ff2e0-898e-42e2-be71-837981e2821c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:21:21.359327 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ff2e0-898e-42e2-be71-837981e2821c service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:21:21.359604 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ff2e0-898e-42e2-be71-837981e2821c service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:21:21.359873 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ff2e0-898e-42e2-be71-837981e2821c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:21:21.362014 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-0f4ff2e0-898e-42e2-be71-837981e2821c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:21:21.377067 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4ff2e0-898e-42e2-be71-837981e2821c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:21:21.378524 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4ff2e0-898e-42e2-be71-837981e2821c service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:21:21.390091 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1450/2900] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:21:21 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:21:33.468220 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413a95e-cedd-4e2b-b242-a46cc7a7f03a service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:21:33.481855 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413a95e-cedd-4e2b-b242-a46cc7a7f03a service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:21:33.487803 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f256a903-b244-4d34-baef-da8b49fb23a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:21:33.488447 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256a903-b244-4d34-baef-da8b49fb23a9 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:21:33.488759 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256a903-b244-4d34-baef-da8b49fb23a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:21:33.489023 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256a903-b244-4d34-baef-da8b49fb23a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:21:33.491244 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-f256a903-b244-4d34-baef-da8b49fb23a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:21:33.502138 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f256a903-b244-4d34-baef-da8b49fb23a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:21:33.503569 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f256a903-b244-4d34-baef-da8b49fb23a9 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:21:33.511535 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1451/2901] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:21:33 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:21:33.621087 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ff2e0-898e-42e2-be71-837981e2821c service neutron] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:21:33.630366 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ff2e0-898e-42e2-be71-837981e2821c service neutron] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:21:33.634500 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23f64ac-e28a-4a40-a9d9-89206d9b46e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:21:33.635171 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f64ac-e28a-4a40-a9d9-89206d9b46e6 service neutron] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:21:33.635450 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f64ac-e28a-4a40-a9d9-89206d9b46e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:21:33.635719 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f64ac-e28a-4a40-a9d9-89206d9b46e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:21:33.637711 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-a23f64ac-e28a-4a40-a9d9-89206d9b46e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:21:33.648688 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23f64ac-e28a-4a40-a9d9-89206d9b46e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:21:33.650148 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23f64ac-e28a-4a40-a9d9-89206d9b46e6 service neutron] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:21:33.658628 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1451/2902] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:21:33 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:21:33.764676 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f256a903-b244-4d34-baef-da8b49fb23a9 service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:21:33.766439 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-f256a903-b244-4d34-baef-da8b49fb23a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:21:33.838128 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f256a903-b244-4d34-baef-da8b49fb23a9 service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:21:33.844256 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727012a-7d7c-4d42-ae75-b42360ccdd6d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '430d6177e74c4dbda7fb83d04c75617e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:21:33.845026 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727012a-7d7c-4d42-ae75-b42360ccdd6d service placement] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:21:33.845323 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727012a-7d7c-4d42-ae75-b42360ccdd6d service placement] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:21:33.845603 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727012a-7d7c-4d42-ae75-b42360ccdd6d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:21:33.847535 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-f727012a-7d7c-4d42-ae75-b42360ccdd6d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:21:33.859132 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f727012a-7d7c-4d42-ae75-b42360ccdd6d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:21:33.861137 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f727012a-7d7c-4d42-ae75-b42360ccdd6d service placement] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:21:33.874950 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1452/2903] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:21:33 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:22:45.494564 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23f64ac-e28a-4a40-a9d9-89206d9b46e6 service neutron] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:22:45.496161 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-a23f64ac-e28a-4a40-a9d9-89206d9b46e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:22:45.587605 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23f64ac-e28a-4a40-a9d9-89206d9b46e6 service neutron] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:22:45.592939 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219bb9b5-fa7f-4f28-931a-01faf8f07540 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '430d6177e74c4dbda7fb83d04c75617e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:22:45.593581 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219bb9b5-fa7f-4f28-931a-01faf8f07540 service placement] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:22:45.593845 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219bb9b5-fa7f-4f28-931a-01faf8f07540 service placement] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:22:45.594118 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219bb9b5-fa7f-4f28-931a-01faf8f07540 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:22:45.595919 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-219bb9b5-fa7f-4f28-931a-01faf8f07540 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:22:45.607943 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219bb9b5-fa7f-4f28-931a-01faf8f07540 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:22:45.609560 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219bb9b5-fa7f-4f28-931a-01faf8f07540 service placement] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:22:45.620040 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1452/2904] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:22:45 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:23:13.292476 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727012a-7d7c-4d42-ae75-b42360ccdd6d service placement] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:23:13.293944 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-f727012a-7d7c-4d42-ae75-b42360ccdd6d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:23:13.371468 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727012a-7d7c-4d42-ae75-b42360ccdd6d service placement] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:23:13.380130 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bac96-71cc-4a6e-92f2-a27b37285b2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f9ad1e8f8f74edcb44aabe17eb59648', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:23:13.381357 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bac96-71cc-4a6e-92f2-a27b37285b2d service nova] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:23:13.381715 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bac96-71cc-4a6e-92f2-a27b37285b2d service nova] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:23:13.382337 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bac96-71cc-4a6e-92f2-a27b37285b2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:23:13.385126 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-714bac96-71cc-4a6e-92f2-a27b37285b2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:23:13.403976 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714bac96-71cc-4a6e-92f2-a27b37285b2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:23:13.406897 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714bac96-71cc-4a6e-92f2-a27b37285b2d service nova] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:23:13.445407 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1453/2905] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:23:13 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:23:15.826669 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219bb9b5-fa7f-4f28-931a-01faf8f07540 service placement] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:23:15.840949 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219bb9b5-fa7f-4f28-931a-01faf8f07540 service placement] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:23:15.847554 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f9a71-fa22-4b36-9e62-d25c3bc5d2cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f9ad1e8f8f74edcb44aabe17eb59648', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:23:15.848209 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f9a71-fa22-4b36-9e62-d25c3bc5d2cd service nova] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:23:15.848493 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f9a71-fa22-4b36-9e62-d25c3bc5d2cd service nova] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:23:15.848801 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f9a71-fa22-4b36-9e62-d25c3bc5d2cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:23:15.850788 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-b51f9a71-fa22-4b36-9e62-d25c3bc5d2cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:23:15.864940 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51f9a71-fa22-4b36-9e62-d25c3bc5d2cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:23:15.866547 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51f9a71-fa22-4b36-9e62-d25c3bc5d2cd service nova] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:23:15.877626 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1453/2906] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:23:15 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:23:17.253756 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bac96-71cc-4a6e-92f2-a27b37285b2d service nova] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:23:17.275378 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bac96-71cc-4a6e-92f2-a27b37285b2d service nova] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:23:17.280544 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84d049-c7b7-4cc8-abe9-f43bfddb25d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36f253fbce04e9ea028f02ff57fb272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:23:17.281726 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84d049-c7b7-4cc8-abe9-f43bfddb25d4 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:23:17.282128 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84d049-c7b7-4cc8-abe9-f43bfddb25d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:23:17.282441 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84d049-c7b7-4cc8-abe9-f43bfddb25d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:23:17.360628 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a84d049-c7b7-4cc8-abe9-f43bfddb25d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:23:17.362890 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a84d049-c7b7-4cc8-abe9-f43bfddb25d4 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:23:17.375719 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1454/2907] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:23:17 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 24 05:23:23.662629 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f9a71-fa22-4b36-9e62-d25c3bc5d2cd service nova] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:23:23.673394 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f9a71-fa22-4b36-9e62-d25c3bc5d2cd service nova] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:23:23.678479 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b58a1e7-1c90-4076-a1bf-5247d86c2213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:23:23.679353 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58a1e7-1c90-4076-a1bf-5247d86c2213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:23:23.679634 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58a1e7-1c90-4076-a1bf-5247d86c2213 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:23:23.679907 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58a1e7-1c90-4076-a1bf-5247d86c2213 admin admin] PATH_INFO: `/v3/users/d7d8af7dfd114b88af9b6ca9e78381fb` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:23:23.681173 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b58a1e7-1c90-4076-a1bf-5247d86c2213 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7d8af7dfd114b88af9b6ca9e78381fb)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:23:23.683160 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b58a1e7-1c90-4076-a1bf-5247d86c2213 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:23:23.735808 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-4b58a1e7-1c90-4076-a1bf-5247d86c2213 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7d8af7dfd114b88af9b6ca9e78381fb'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:23:23.736470 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-4b58a1e7-1c90-4076-a1bf-5247d86c2213 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7d8af7dfd114b88af9b6ca9e78381fb'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:23:23.742998 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-4b58a1e7-1c90-4076-a1bf-5247d86c2213 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7d8af7dfd114b88af9b6ca9e78381fb'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:23:23.751301 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-4b58a1e7-1c90-4076-a1bf-5247d86c2213 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7d8af7dfd114b88af9b6ca9e78381fb'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:23:23.751914 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-4b58a1e7-1c90-4076-a1bf-5247d86c2213 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7d8af7dfd114b88af9b6ca9e78381fb'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:23:23.770340 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1454/2908] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:23:23 2021] DELETE /identity/v3/users/d7d8af7dfd114b88af9b6ca9e78381fb => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:23:23.970151 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84d049-c7b7-4cc8-abe9-f43bfddb25d4 service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:23:23.980010 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84d049-c7b7-4cc8-abe9-f43bfddb25d4 service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:23:24.037703 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a51a5-b05c-4c8f-85fa-1eacdddcbb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:23:24.038575 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a51a5-b05c-4c8f-85fa-1eacdddcbb54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:23:24.038847 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a51a5-b05c-4c8f-85fa-1eacdddcbb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:23:24.039118 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a51a5-b05c-4c8f-85fa-1eacdddcbb54 admin admin] PATH_INFO: `/v3/projects/274c3c6f555f48ad93189e73c71c5ffe` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:23:24.040439 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01a51a5-b05c-4c8f-85fa-1eacdddcbb54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=274c3c6f555f48ad93189e73c71c5ffe)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:23:24.042384 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01a51a5-b05c-4c8f-85fa-1eacdddcbb54 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:23:24.097955 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b01a51a5-b05c-4c8f-85fa-1eacdddcbb54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '274c3c6f555f48ad93189e73c71c5ffe', 'request_id': 'req-b01a51a5-b05c-4c8f-85fa-1eacdddcbb54'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:23:24.107344 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b01a51a5-b05c-4c8f-85fa-1eacdddcbb54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '274c3c6f555f48ad93189e73c71c5ffe', 'request_id': 'req-b01a51a5-b05c-4c8f-85fa-1eacdddcbb54'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:23:24.113678 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b01a51a5-b05c-4c8f-85fa-1eacdddcbb54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '274c3c6f555f48ad93189e73c71c5ffe', 'request_id': 'req-b01a51a5-b05c-4c8f-85fa-1eacdddcbb54'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:23:24.125342 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b01a51a5-b05c-4c8f-85fa-1eacdddcbb54 admin admin] The token cache is being invalidate because project 274c3c6f555f48ad93189e73c71c5ffe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:23:24.125654 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b01a51a5-b05c-4c8f-85fa-1eacdddcbb54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:23:24.126343 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b01a51a5-b05c-4c8f-85fa-1eacdddcbb54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:23:24.127974 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1455/2909] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:23:23 2021] DELETE /identity/v3/projects/274c3c6f555f48ad93189e73c71c5ffe => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:23:24.132230 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b58a1e7-1c90-4076-a1bf-5247d86c2213 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:23:24.133850 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-4b58a1e7-1c90-4076-a1bf-5247d86c2213 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:23:24.147172 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b58a1e7-1c90-4076-a1bf-5247d86c2213 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:23:24.208221 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0830436-4575-4b08-99f9-d935d5c86736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:23:24.209159 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0830436-4575-4b08-99f9-d935d5c86736 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:23:24.209461 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0830436-4575-4b08-99f9-d935d5c86736 admin admin] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:23:24.209728 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0830436-4575-4b08-99f9-d935d5c86736 admin admin] PATH_INFO: `/v3/users/7616883154ce46cfbb38f4561b8b62a8` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:23:24.210981 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0830436-4575-4b08-99f9-d935d5c86736 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7616883154ce46cfbb38f4561b8b62a8)` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:23:24.212995 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0830436-4575-4b08-99f9-d935d5c86736 admin admin] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:23:24.266825 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-b0830436-4575-4b08-99f9-d935d5c86736 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7616883154ce46cfbb38f4561b8b62a8'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:23:24.267461 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-b0830436-4575-4b08-99f9-d935d5c86736 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7616883154ce46cfbb38f4561b8b62a8'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:23:24.274099 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-b0830436-4575-4b08-99f9-d935d5c86736 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7616883154ce46cfbb38f4561b8b62a8'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:23:24.283018 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-b0830436-4575-4b08-99f9-d935d5c86736 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7616883154ce46cfbb38f4561b8b62a8'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:23:24.283638 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.notifications [None req-b0830436-4575-4b08-99f9-d935d5c86736 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7616883154ce46cfbb38f4561b8b62a8'} {{(pid=79112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:23:24.301399 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1455/2910] 10.222.0.43 () {58 vars in 1223 bytes} [Fri Dec 24 05:23:24 2021] DELETE /identity/v3/users/7616883154ce46cfbb38f4561b8b62a8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:23:24.483589 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a51a5-b05c-4c8f-85fa-1eacdddcbb54 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:23:24.485512 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-b01a51a5-b05c-4c8f-85fa-1eacdddcbb54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:23:24.499355 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a51a5-b05c-4c8f-85fa-1eacdddcbb54 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:23:24.557013 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b231307-fc20-48af-b36d-51b9b862209e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2031cc40bf6488b8dc6976b8c829c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49af853a7d674e84987f8788493d4239', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:23:24.557895 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b231307-fc20-48af-b36d-51b9b862209e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:23:24.558175 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b231307-fc20-48af-b36d-51b9b862209e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:23:24.558448 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b231307-fc20-48af-b36d-51b9b862209e admin admin] PATH_INFO: `/v3/projects/905e5afd4e554da8aa686e9236199822` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:23:24.560297 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b231307-fc20-48af-b36d-51b9b862209e admin admin] RBAC: Authorizing `identity:delete_project(project_id=905e5afd4e554da8aa686e9236199822)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:23:24.562320 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b231307-fc20-48af-b36d-51b9b862209e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:23:24.611551 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-0b231307-fc20-48af-b36d-51b9b862209e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '905e5afd4e554da8aa686e9236199822', 'request_id': 'req-0b231307-fc20-48af-b36d-51b9b862209e'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:23:24.620930 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-0b231307-fc20-48af-b36d-51b9b862209e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '905e5afd4e554da8aa686e9236199822', 'request_id': 'req-0b231307-fc20-48af-b36d-51b9b862209e'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:23:24.627214 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-0b231307-fc20-48af-b36d-51b9b862209e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '905e5afd4e554da8aa686e9236199822', 'request_id': 'req-0b231307-fc20-48af-b36d-51b9b862209e'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:23:24.638830 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-0b231307-fc20-48af-b36d-51b9b862209e admin admin] The token cache is being invalidate because project 905e5afd4e554da8aa686e9236199822 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 24 05:23:24.639121 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-0b231307-fc20-48af-b36d-51b9b862209e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:23:24.639879 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-0b231307-fc20-48af-b36d-51b9b862209e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 24 05:23:24.641976 dv-cinder-816443-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1456/2911] 10.222.0.43 () {58 vars in 1232 bytes} [Fri Dec 24 05:23:24 2021] DELETE /identity/v3/projects/905e5afd4e554da8aa686e9236199822 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 24 05:27:51.492890 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0830436-4575-4b08-99f9-d935d5c86736 admin admin] Authenticating user token {{(pid=79112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 24 05:27:51.494572 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-b0830436-4575-4b08-99f9-d935d5c86736 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:27:51.576814 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0830436-4575-4b08-99f9-d935d5c86736 admin admin] Validating token access rules against request {{(pid=79112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 24 05:27:51.637162 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc9055d-4378-4217-85a2-458e94197e84 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '430d6177e74c4dbda7fb83d04c75617e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19ba4a2c0224c079c5a8a6a56569fd6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 24 05:27:51.637810 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc9055d-4378-4217-85a2-458e94197e84 service placement] REQUEST_METHOD: `GET` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 24 05:27:51.638097 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc9055d-4378-4217-85a2-458e94197e84 service placement] SCRIPT_NAME: `/identity` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 24 05:27:51.638377 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc9055d-4378-4217-85a2-458e94197e84 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 24 05:27:51.640318 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.fernet_utils [None req-1dc9055d-4378-4217-85a2-458e94197e84 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 24 05:27:51.651879 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc9055d-4378-4217-85a2-458e94197e84 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 24 05:27:51.653519 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc9055d-4378-4217-85a2-458e94197e84 service placement] RBAC: Authorization granted {{(pid=79112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 24 05:27:51.664518 dv-cinder-816443-2-iscsi devstack@keystone.service[79112]: [pid: 79112|app: 0|req: 1456/2912] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Dec 24 05:27:51 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)